Jul 15 16:40:03.784484 ip-10-0-128-117 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.214148    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220243    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220257    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220261    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220264    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220267    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220270    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220273    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:04.244596 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220276    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220279    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220281    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220287    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220290    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220294    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220297    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220300    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220302    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220305    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220307    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220310    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220313    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220316    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220319    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220321    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220323    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220326    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220329    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220331    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:04.245662 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220333    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220336    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220338    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220343    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220345    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220348    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220350    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220353    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220356    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220358    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220361    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220365    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220369    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220372    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220375    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220377    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220380    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220383    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220385    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220388    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:04.246495 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220391    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220393    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220396    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220399    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220402    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220404    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220407    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220409    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220412    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220414    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220417    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220419    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220422    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220424    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220427    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220430    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220432    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220435    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220437    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220440    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:04.247136 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220443    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220446    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220448    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220453    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220456    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220458    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220461    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220464    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220467    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220470    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220473    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220475    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220478    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220481    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220483    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220486    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220488    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220492    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220495    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220497    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:04.247767 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220500    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220502    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220506    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220509    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220512    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220515    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220517    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220520    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220522    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220525    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220529    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.220533    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221247    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221255    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221258    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221261    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221263    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221266    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:04.248420 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221269    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221271    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221274    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221277    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221279    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221282    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221285    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221287    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221290    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221293    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221295    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221298    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221302    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221304    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221307    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221311    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221315    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221318    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221321    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221324    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:04.249057 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221327    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221329    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221333    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221336    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221339    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221342    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221345    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221348    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221351    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221353    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221356    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221358    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221361    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221363    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221366    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221369    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221371    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221374    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221377    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:04.249704 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221379    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221383    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221385    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221388    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221391    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221394    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221396    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221399    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221401    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221403    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221406    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221409    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221411    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221413    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221416    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221418    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221421    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221424    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221427    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221429    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:04.250340 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221432    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221435    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221437    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221440    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221442    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221445    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221447    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221450    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221453    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221455    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221457    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221460    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221463    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221465    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221468    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221472    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221475    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221478    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221481    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221484    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:04.250975 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221487    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221490    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221493    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221496    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221499    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221501    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221504    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221507    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221509    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221512    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221515    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221517    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221520    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221523    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221894    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221898    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221902    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221904    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221907    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:04.252618 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221910    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221913    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221916    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221918    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221921    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221925    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221931    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221934    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221938    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221941    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221944    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221947    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221950    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221953    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221956    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221959    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221961    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221964    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221966    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:04.253212 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221969    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221972    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221974    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221977    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221980    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221982    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221985    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221988    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221990    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221993    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221996    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.221999    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222001    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222004    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222006    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222009    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222011    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222015    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222017    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222021    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:04.253738 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222023    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222026    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222028    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222031    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222033    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222036    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222039    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222041    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222044    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222046    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222049    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222051    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222053    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222056    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222058    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222063    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222065    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222068    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222071    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222073    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:04.254395 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222076    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222078    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222081    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222084    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222086    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222089    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222091    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222094    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222096    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222099    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222103    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222107    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222110    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222113    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222115    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222117    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222120    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222123    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222125    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:04.255027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222128    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222132    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222135    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222138    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222141    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222144    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222146    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222149    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222170    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222174    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222178    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222181    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222184    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222186    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222189    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222192    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222262    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222269    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222294    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222299    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222303    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 16:40:04.255657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222306    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222310    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222314    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222319    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222323    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222326    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222329    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222332    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222335    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222338    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222341    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222344    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222347    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222352    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222354    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222358    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222361    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222364    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222368    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222373    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222376    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222379    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222382    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222385    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 16:40:04.256344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222388    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222391    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222394    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222400    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222404    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222407    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222410    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222413    2567 flags.go:64] FLAG: --enable-server="true"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222415    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222420    2567 flags.go:64] FLAG: --event-burst="100"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222423    2567 flags.go:64] FLAG: --event-qps="50"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222427    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222431    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222433    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222437    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222440    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222443    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222446    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222449    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222452    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222455    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222457    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222460    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222463    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222466    2567 flags.go:64] FLAG: --feature-gates=""
Jul 15 16:40:04.257082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222470    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222472    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222477    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222480    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222484    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222487    2567 flags.go:64] FLAG: --help="false"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222489    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222492    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222495    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222498    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222501    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222505    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222508    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222511    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222514    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222517    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222519    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222523    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222528    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222530    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222534    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222537    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222539    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222542    2567 flags.go:64] FLAG: --lock-file=""
Jul 15 16:40:04.258239 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222545    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222548    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222551    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222556    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222559    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222562    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222564    2567 flags.go:64] FLAG: --logging-format="text"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222567    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222570    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222573    2567 flags.go:64] FLAG: --manifest-url=""
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222578    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222583    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222585    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222590    2567 flags.go:64] FLAG: --max-pods="110"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222593    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222596    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222599    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222602    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222605    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222608    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222610    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222618    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222621    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222624    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 16:40:04.259063 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222627    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222629    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222637    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222640    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222643    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222646    2567 flags.go:64] FLAG: --port="10250"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222649    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222652    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b30688a71a8f0f23"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222655    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222658    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222661    2567 flags.go:64] FLAG: --register-node="true"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222664    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222667    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222670    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222673    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222675    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222679    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222683    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222685    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222689    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222692    2567 flags.go:64] FLAG: --runonce="false"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222695    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222698    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222701    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222704    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 16:40:04.260247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222707    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222709    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222712    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222715    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222718    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222722    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222724    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222727    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222730    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222735    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222737    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222743    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222745    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222748    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222752    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222755    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222758    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222760    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222763    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222766    2567 flags.go:64] FLAG: --v="2"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222770    2567 flags.go:64] FLAG: --version="false"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222774    2567 flags.go:64] FLAG: --vmodule=""
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222777    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.222781    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222895    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:04.261164 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222899    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222903    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222906    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222909    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222912    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222915    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222917    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222920    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222923    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222925    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222928    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222930    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222933    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222936    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222939    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222942    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222946    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222948    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222951    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:04.262757 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222955    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222958    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222962    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222964    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222967    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222970    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222973    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222976    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222979    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222982    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222986    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222990    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222993    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.222996    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223000    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223003    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223006    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223008    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223011    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223013    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:04.263435 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223016    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223018    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223021    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223023    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223026    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223028    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223031    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223034    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223037    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223041    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223043    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223046    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223048    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223051    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223053    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223056    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223058    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223061    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223063    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:04.264563 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223066    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223068    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223071    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223074    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223086    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223089    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223092    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223096    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223098    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223101    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223104    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223107    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223109    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223112    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223114    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223117    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223119    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223122    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223125    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223127    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:04.265244 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223130    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223134    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223139    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223143    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223145    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223148    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223169    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223175    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223179    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223184    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223187    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223189    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223192    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223195    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223198    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223200    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223203    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223206    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223208    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:04.265944 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.223214    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.223219    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.238741    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.238759    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.239600    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.239608    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239681    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239687    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239690    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239694    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239697    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239699    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239702    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239705    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:04.266766 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239708    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239710    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239713    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239716    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239718    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239721    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239724    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239726    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239729    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239732    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239735    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239737    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239740    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239742    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239745    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239748    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239750    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239753    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239760    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239763    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:04.267280 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239766    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239768    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239771    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239773    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239777    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239781    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239784    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239787    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239789    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239792    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239795    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239798    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239801    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239803    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239806    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239808    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239811    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239814    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239817    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:04.267884 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239819    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239822    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239825    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239828    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239831    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239833    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239836    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239838    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239841    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239844    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239846    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239849    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239852    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239855    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239857    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239860    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239862    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239865    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239867    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239870    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:04.385750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239872    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:04.305389 ip-10-0-128-117 systemd[1]: Started Kubernetes Kubelet.
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239874    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239877    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239880    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239885    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239889    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239893    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239896    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239900    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239903    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239906    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239909    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239913    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239916    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239919    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239922    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239925    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239928    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239931    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:04.386515 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239934    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239936    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239939    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239941    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239944    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239947    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239949    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239952    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239955    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239957    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239959    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239962    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.239965    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.239970    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240094    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:04.387316 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240099    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240102    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240107    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240109    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240112    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240115    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240118    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240120    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240123    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240125    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240129    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240132    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240137    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240139    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240143    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240148    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240162    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240165    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240168    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:04.387877 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240171    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240174    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240177    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240180    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240183    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240186    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240188    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240191    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240193    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240196    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240199    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240201    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240204    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240206    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240209    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240213    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240216    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240218    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240221    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240224    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:04.388586 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240226    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240229    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240231    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240234    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240237    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240243    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240245    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240248    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240250    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240253    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240256    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240258    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240261    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240264    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240267    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240269    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240272    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240274    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240276    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240279    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:04.389282 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240282    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240284    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240287    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240289    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240292    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240295    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240297    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240303    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240306    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240309    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240312    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240314    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240317    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240320    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240322    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240325    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240328    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240332    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240335    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:04.390077 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240338    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240340    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240343    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240345    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240348    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240350    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240353    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240356    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240359    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240363    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240365    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240368    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240371    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240373    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240376    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240378    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240381    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240384    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240386    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:04.390761 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:04.240389    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.240395    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.240521    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.243492    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.245010    2567 server.go:1019] "Starting client certificate rotation"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.245109    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.245145    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.248407    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.250969    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.270749    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.273641    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.274030    2567 log.go:25] "Validated CRI v1 image API"
Jul 15 16:40:04.391417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.275356    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 16:40:04.391858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.278529    2567 fs.go:135] Filesystem UUIDs: map[23992f18-bab7-4cb6-b9b9-e02afbc436b5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9092460c-1d03-418a-a390-2fb2cf7712cc:/dev/nvme0n1p3]
Jul 15 16:40:04.391858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.278545    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.283354    2567 manager.go:216] Machine: {Timestamp:2026-07-15 16:40:04.282836922 +0000 UTC m=+0.377775161 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099693 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f3770b6b8826a78be7c2621ba113d SystemUUID:ec2f3770-b6b8-826a-78be-7c2621ba113d BootID:34d1a79e-dabf-45fe-b8fb-d73b9cd0797b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:aa:c3:9c:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:aa:c3:9c:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:05:60:d6:9b:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.283457    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.283575    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.286442    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.286473    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.287342    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.287352    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.287360    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.288398    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.289289    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.292564    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.292697    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.292727    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.292738    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.292748    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.292759    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.292768    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 16:40:04.538426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.293156    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.293177    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.296295    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.298429    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.298467    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299157    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299176    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299183    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299195    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299208    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299215    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299318    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299326    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299335    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299343    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299383    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.299395    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.300290    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.300305    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.304307    2567 server.go:1268] "Started kubelet"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.304379    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.304408    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.304482    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.304769    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.304823    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.305039    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.306862    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.308442    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.314333    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.314351    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.314464    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.314917    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.314921    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.314937    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.315035    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.315042    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.320974    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.321562    2567 factory.go:153] Registering CRI-O factory
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.321583    2567 factory.go:223] Registration of the crio container factory successfully
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.321642    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 16:40:04.539280 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.320523    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-117.ec2.internal.18c2840f7464d692  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-117.ec2.internal,UID:ip-10-0-128-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-117.ec2.internal,},FirstTimestamp:2026-07-15 16:40:04.304279186 +0000 UTC m=+0.399217426,LastTimestamp:2026-07-15 16:40:04.304279186 +0000 UTC m=+0.399217426,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-117.ec2.internal,}"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.321651    2567 factory.go:55] Registering systemd factory
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.321674    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.321697    2567 factory.go:103] Registering Raw factory
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.321710    2567 manager.go:1196] Started watching for new ooms in manager
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.322150    2567 manager.go:349] Starting recovery of all containers
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.325785    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27l7k"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.336259    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27l7k"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.340982    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.340995    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.341412    2567 manager.go:354] Recovery completed
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.349681    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.352418    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.352448    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.352458    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.353000    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.353008    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.353014    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.353032    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.353756    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.353780    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.353792    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.356079    2567 policy_none.go:49] "None policy: Start"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.356103    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.356120    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.357368    2567 policy_none.go:47] "Start"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.403852    2567 manager.go:337] "Starting Device Plugin manager"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.403893    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.403904    2567 server.go:87] "Starting device plugin registration server"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.404213    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.404250    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.404402    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.404516    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.404523    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.404936    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.404983    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.504149    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.504573    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.505517    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.505555    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.505596    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.505618    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.505639    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.505653    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.505672    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.505707    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.508429    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:04.540595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.515855    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.543045 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.515873    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-117.ec2.internal\": node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.560939    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.605702    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"]
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.605784    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.606888    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.606916    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.606927    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.608591    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.608705    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.608734    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.609318    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.609330    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.609339    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.609350    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.609357    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.609371    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.610627    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.610650    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.611300    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.611322    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.611345    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.618758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bfb638634a956f3e226b954e59b0eaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal\" (UID: \"5bfb638634a956f3e226b954e59b0eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.618792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bfb638634a956f3e226b954e59b0eaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal\" (UID: \"5bfb638634a956f3e226b954e59b0eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.618824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be6ba1ae2b4e46007e8cd92cba1cbdb0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-117.ec2.internal\" (UID: \"be6ba1ae2b4e46007e8cd92cba1cbdb0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.637843    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-117.ec2.internal\" not found" node="ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.645688    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-117.ec2.internal\" not found" node="ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.714506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.661353    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.719694    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bfb638634a956f3e226b954e59b0eaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal\" (UID: \"5bfb638634a956f3e226b954e59b0eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.719725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bfb638634a956f3e226b954e59b0eaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal\" (UID: \"5bfb638634a956f3e226b954e59b0eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.719748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be6ba1ae2b4e46007e8cd92cba1cbdb0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-117.ec2.internal\" (UID: \"be6ba1ae2b4e46007e8cd92cba1cbdb0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.719805    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be6ba1ae2b4e46007e8cd92cba1cbdb0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-117.ec2.internal\" (UID: \"be6ba1ae2b4e46007e8cd92cba1cbdb0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.719809    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5bfb638634a956f3e226b954e59b0eaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal\" (UID: \"5bfb638634a956f3e226b954e59b0eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.719818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bfb638634a956f3e226b954e59b0eaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal\" (UID: \"5bfb638634a956f3e226b954e59b0eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.762205    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:04.866238 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.865525    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.037698 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.941475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:05.037698 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:04.948877    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:05.037698 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:04.965979    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.230196 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.067093    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.230196 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.170359    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.230196 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.216242    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:05.244115 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.244087    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 16:40:05.244290 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.244262    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 16:40:05.244354 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.244253    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 16:40:05.271110 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.271077    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.340909 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.340815    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 16:35:05 +0000 UTC" deadline="2028-02-06 13:50:10.362167957 +0000 UTC"
Jul 15 16:40:05.340909 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.340852    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13701h10m5.021320486s"
Jul 15 16:40:05.373455 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.373416    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.476823 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.476775    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.580448 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.580412    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.684768 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.684703    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.787022 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.786977    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.811352 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.811329    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:05.891753 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:05.891714    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-117.ec2.internal\" not found"
Jul 15 16:40:05.901914 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.901883    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:05.915013 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.914987    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:05.924253 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.924231    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 16:40:05.925336 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.925323    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal"
Jul 15 16:40:05.940846 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:05.940791    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 16:40:06.297084 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.296999    2567 apiserver.go:52] "Watching apiserver"
Jul 15 16:40:06.309608 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.309578    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 16:40:06.311387 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.311362    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-n552f","kube-system/konnectivity-agent-h642p","kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal","openshift-image-registry/node-ca-g4z9q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal","openshift-multus/network-metrics-daemon-bwrkn","openshift-network-diagnostics/network-check-target-ph46p","openshift-network-operator/iptables-alerter-wdq2s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j","openshift-cluster-node-tuning-operator/tuned-mdspp","openshift-dns/node-resolver-q45nk","openshift-multus/multus-additional-cni-plugins-p89n2","openshift-multus/multus-pqh2w","openshift-ovn-kubernetes/ovnkube-node-vk6ml"]
Jul 15 16:40:06.313020 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.313002    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:06.313107 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.313089    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:06.314268 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.314247    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.315158 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.315109    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 16:40:06.315606 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.315583    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.316665 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.316642    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 16:40:06.316758 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.316642    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9mstl\""
Jul 15 16:40:06.316814 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.316777    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.316814 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.316647    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 16:40:06.318000 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.317975    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 16:40:06.318090 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.317983    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 16:40:06.318090 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.318020    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 16:40:06.318251 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.318224    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.318311 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.318289    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 16:40:06.318407 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.318389    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 16:40:06.318712 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.318696    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 16:40:06.318764 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.318726    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m6pvw\""
Jul 15 16:40:06.319078 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.319061    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gqtq7\""
Jul 15 16:40:06.319315 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.319299    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 16:40:06.319361 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.319319    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 16:40:06.319573 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.319559    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 16:40:06.319806 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.319787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:06.319891 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.319838    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:06.320517 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.320500    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:40:06.320595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.320522    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 16:40:06.320595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.320527    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 16:40:06.320595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.320547    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cb2js\""
Jul 15 16:40:06.321093 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.321077    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.322308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.322289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.323202 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.323185    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 16:40:06.323313 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.323200    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tvjfp\""
Jul 15 16:40:06.323379 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.323332    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 16:40:06.323468 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.323452    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 16:40:06.323556 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.323540    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.324324 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.324309    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 16:40:06.324520 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.324505    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 16:40:06.324590 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.324543    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 16:40:06.324776 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.324761    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 16:40:06.324863 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.324849    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.325482 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.325466    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7hswm\""
Jul 15 16:40:06.325664 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.325651    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 16:40:06.326098 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.326082    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.326214 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.326184    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:06.326431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.326411    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k7478\""
Jul 15 16:40:06.326633 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.326620    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 16:40:06.326847 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.326831    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 16:40:06.327062 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.327042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:40:06.327173 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.327147    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9xlmj\""
Jul 15 16:40:06.327721 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.327706    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:40:06.327909 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.327894    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-systemd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-ovn\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-cni-bin\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-cni-netd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329470    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329504    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68dzd\" (UniqueName: \"kubernetes.io/projected/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-kube-api-access-68dzd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329536    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfqqp\" (UniqueName: \"kubernetes.io/projected/d4e1682f-2f0a-4945-b01d-5889222a5e7b-kube-api-access-nfqqp\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-slash\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-run-netns\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-var-lib-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-etc-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-env-overrides\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-kubelet\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.330415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-systemd-units\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-node-log\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.329984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-log-socket\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovnkube-config\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovnkube-script-lib\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e1682f-2f0a-4945-b01d-5889222a5e7b-hosts-file\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e1682f-2f0a-4945-b01d-5889222a5e7b-tmp-dir\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330197    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330240    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9722\""
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovn-node-metrics-cert\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.331184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.330552    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 16:40:06.356009 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.355987    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9jqhg"
Jul 15 16:40:06.365573 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.365552    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9jqhg"
Jul 15 16:40:06.416367 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.416344    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 16:40:06.430672 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:06.430785 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430678    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-cni-binary-copy\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.430785 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-var-lib-kubelet\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.430785 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-host\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.430785 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-systemd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.430991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d6993f7-f1bb-4688-903b-506daf290787-multus-daemon-config\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.430991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qmpz\" (UniqueName: \"kubernetes.io/projected/e692baf8-fd87-47de-b13d-a13e658b6036-kube-api-access-2qmpz\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.430991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430870    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-systemd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.430991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.430991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c15626e-2185-4ab7-a7a9-93978773b854-serviceca\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.430991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.430982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovnkube-script-lib\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49428826-e094-4b3a-8cc4-3021fa336170-tmp\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-netns\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431060    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-cnibin\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-modprobe-d\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431118    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56388b74-ab17-4c4c-acdb-73c8f622def6-kubelet-config\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431143    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-system-cni-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-os-release\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-socket-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56388b74-ab17-4c4c-acdb-73c8f622def6-dbus\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.431247 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-ovn\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431275    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-cni-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-cnibin\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431317    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-ovn\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-etc-kubernetes\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-device-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1705e4ce-db05-44b0-818e-d0de09772b10-host-slash\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spplt\" (UniqueName: \"kubernetes.io/projected/9d6993f7-f1bb-4688-903b-506daf290787-kube-api-access-spplt\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfqqp\" (UniqueName: \"kubernetes.io/projected/d4e1682f-2f0a-4945-b01d-5889222a5e7b-kube-api-access-nfqqp\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-slash\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-run-netns\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431485    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-cni-multus\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431500    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-conf-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431514    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-slash\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-registration-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431561    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovnkube-script-lib\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-node-log\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.431637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-run-netns\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431594    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-log-socket\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovnkube-config\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431622    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-node-log\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-log-socket\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-multus-certs\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svtxv\" (UniqueName: \"kubernetes.io/projected/61ff2476-3459-428e-a84e-a51f2744679f-kube-api-access-svtxv\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysctl-d\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltsk7\" (UniqueName: \"kubernetes.io/projected/49428826-e094-4b3a-8cc4-3021fa336170-kube-api-access-ltsk7\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovn-node-metrics-cert\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-system-cni-dir\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431870    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cff1f46-7be5-4a8e-82fd-58a656401570-agent-certs\") pod \"konnectivity-agent-h642p\" (UID: \"6cff1f46-7be5-4a8e-82fd-58a656401570\") " pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431917    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-run\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-lib-modules\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-cni-bin\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.432396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-cni-bin\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.431995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-cni-netd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432017    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovnkube-config\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-cni-netd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432048    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c15626e-2185-4ab7-a7a9-93978773b854-host\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432095    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68dzd\" (UniqueName: \"kubernetes.io/projected/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-kube-api-access-68dzd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-env-overrides\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d6993f7-f1bb-4688-903b-506daf290787-cni-binary-copy\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432229    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cff1f46-7be5-4a8e-82fd-58a656401570-konnectivity-ca\") pod \"konnectivity-agent-h642p\" (UID: \"6cff1f46-7be5-4a8e-82fd-58a656401570\") " pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-kubelet\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-systemd-units\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-kubelet\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432377    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-systemd-units\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-hostroot\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432463    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432458    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e1682f-2f0a-4945-b01d-5889222a5e7b-hosts-file\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e1682f-2f0a-4945-b01d-5889222a5e7b-tmp-dir\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d4e1682f-2f0a-4945-b01d-5889222a5e7b-hosts-file\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qh2r\" (UniqueName: \"kubernetes.io/projected/8b96e872-053b-4450-a7e1-78c603d5a916-kube-api-access-4qh2r\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432547    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-socket-dir-parent\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-cni-bin\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-sys-fs\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-kubernetes\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8krhf\" (UniqueName: \"kubernetes.io/projected/6c15626e-2185-4ab7-a7a9-93978773b854-kube-api-access-8krhf\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432628    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-env-overrides\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-os-release\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.433690 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4e1682f-2f0a-4945-b01d-5889222a5e7b-tmp-dir\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1705e4ce-db05-44b0-818e-d0de09772b10-iptables-alerter-script\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9b54\" (UniqueName: \"kubernetes.io/projected/1705e4ce-db05-44b0-818e-d0de09772b10-kube-api-access-j9b54\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-var-lib-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-etc-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-var-lib-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-etc-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-kubelet\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-run-openvswitch\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-sys\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-k8s-cni-cncf-io\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.432997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysconfig\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.433018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysctl-conf\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.433033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-systemd\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.434528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.433049    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49428826-e094-4b3a-8cc4-3021fa336170-etc-tuned\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.436351 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.436334    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-ovn-node-metrics-cert\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.440985 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.440959    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:06.441091 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.441000    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:06.441091 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.441014    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ln98x for pod openshift-network-diagnostics/network-check-target-ph46p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:06.441210 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.441111    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x podName:c31f3235-cd14-46f2-b0c6-d3811e1b7a32 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:06.941059557 +0000 UTC m=+3.035997796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ln98x" (UniqueName: "kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x") pod "network-check-target-ph46p" (UID: "c31f3235-cd14-46f2-b0c6-d3811e1b7a32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:06.443703 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.443678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfqqp\" (UniqueName: \"kubernetes.io/projected/d4e1682f-2f0a-4945-b01d-5889222a5e7b-kube-api-access-nfqqp\") pod \"node-resolver-q45nk\" (UID: \"d4e1682f-2f0a-4945-b01d-5889222a5e7b\") " pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.443806 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.443678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68dzd\" (UniqueName: \"kubernetes.io/projected/53e5ae0f-1553-4e6e-88ec-ce171bd8a423-kube-api-access-68dzd\") pod \"ovnkube-node-vk6ml\" (UID: \"53e5ae0f-1553-4e6e-88ec-ce171bd8a423\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.514298 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.514225    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfb638634a956f3e226b954e59b0eaa.slice/crio-7dd7839905717dc864947ff8ee28b114cfbbc66d2bfda9c2963838abe277e03e WatchSource:0}: Error finding container 7dd7839905717dc864947ff8ee28b114cfbbc66d2bfda9c2963838abe277e03e: Status 404 returned error can't find the container with id 7dd7839905717dc864947ff8ee28b114cfbbc66d2bfda9c2963838abe277e03e
Jul 15 16:40:06.519554 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.519533    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:40:06.533685 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.533664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d6993f7-f1bb-4688-903b-506daf290787-multus-daemon-config\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.533797 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.533693    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qmpz\" (UniqueName: \"kubernetes.io/projected/e692baf8-fd87-47de-b13d-a13e658b6036-kube-api-access-2qmpz\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.533797 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.533712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.533797 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.533728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c15626e-2185-4ab7-a7a9-93978773b854-serviceca\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.533967 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.533875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-etc-selinux\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.533967 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.533940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49428826-e094-4b3a-8cc4-3021fa336170-tmp\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.534074 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.533977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-netns\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534074 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-cnibin\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.534074 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-cnibin\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.534260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534084    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-netns\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-modprobe-d\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.534260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56388b74-ab17-4c4c-acdb-73c8f622def6-kubelet-config\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.534260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-system-cni-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534186    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-os-release\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534222    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-socket-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.534260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56388b74-ab17-4c4c-acdb-73c8f622def6-dbus\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534259    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/56388b74-ab17-4c4c-acdb-73c8f622def6-kubelet-config\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-cni-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-cnibin\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-modprobe-d\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-etc-kubernetes\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534351    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-os-release\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-device-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534391    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d6993f7-f1bb-4688-903b-506daf290787-multus-daemon-config\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-device-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1705e4ce-db05-44b0-818e-d0de09772b10-host-slash\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534444    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1705e4ce-db05-44b0-818e-d0de09772b10-host-slash\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534446    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spplt\" (UniqueName: \"kubernetes.io/projected/9d6993f7-f1bb-4688-903b-506daf290787-kube-api-access-spplt\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534365    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-system-cni-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-cnibin\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-cni-multus\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534502    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-cni-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-conf-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.534615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6c15626e-2185-4ab7-a7a9-93978773b854-serviceca\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534524    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-etc-kubernetes\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-registration-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534559    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/56388b74-ab17-4c4c-acdb-73c8f622def6-dbus\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-socket-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534579    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-cni-multus\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-multus-certs\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-multus-certs\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svtxv\" (UniqueName: \"kubernetes.io/projected/61ff2476-3459-428e-a84e-a51f2744679f-kube-api-access-svtxv\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-conf-dir\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysctl-d\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534694    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsk7\" (UniqueName: \"kubernetes.io/projected/49428826-e094-4b3a-8cc4-3021fa336170-kube-api-access-ltsk7\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534713    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-registration-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-system-cni-dir\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534805    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysctl-d\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.535578 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cff1f46-7be5-4a8e-82fd-58a656401570-agent-certs\") pod \"konnectivity-agent-h642p\" (UID: \"6cff1f46-7be5-4a8e-82fd-58a656401570\") " pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534838    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-system-cni-dir\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534868    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-run\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534894    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-lib-modules\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c15626e-2185-4ab7-a7a9-93978773b854-host\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-run\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534977    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.534993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d6993f7-f1bb-4688-903b-506daf290787-cni-binary-copy\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cff1f46-7be5-4a8e-82fd-58a656401570-konnectivity-ca\") pod \"konnectivity-agent-h642p\" (UID: \"6cff1f46-7be5-4a8e-82fd-58a656401570\") " pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535023    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-lib-modules\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-hostroot\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.535057    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qh2r\" (UniqueName: \"kubernetes.io/projected/8b96e872-053b-4450-a7e1-78c603d5a916-kube-api-access-4qh2r\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.535130    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret podName:56388b74-ab17-4c4c-acdb-73c8f622def6 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:07.035111721 +0000 UTC m=+3.130049969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret") pod "global-pull-secret-syncer-n552f" (UID: "56388b74-ab17-4c4c-acdb-73c8f622def6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-socket-dir-parent\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.536431 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-cni-bin\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-sys-fs\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-kubernetes\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535294    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8krhf\" (UniqueName: \"kubernetes.io/projected/6c15626e-2185-4ab7-a7a9-93978773b854-kube-api-access-8krhf\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-os-release\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535392    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535419    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1705e4ce-db05-44b0-818e-d0de09772b10-iptables-alerter-script\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535447    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9b54\" (UniqueName: \"kubernetes.io/projected/1705e4ce-db05-44b0-818e-d0de09772b10-kube-api-access-j9b54\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-kubelet\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535506    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-sys\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-sys\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535578    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d6993f7-f1bb-4688-903b-506daf290787-cni-binary-copy\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535565    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-sys-fs\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535057    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c15626e-2185-4ab7-a7a9-93978773b854-host\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-kubernetes\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535652    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e692baf8-fd87-47de-b13d-a13e658b6036-os-release\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.537401 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535182    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-hostroot\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61ff2476-3459-428e-a84e-a51f2744679f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-kubelet\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535732    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cff1f46-7be5-4a8e-82fd-58a656401570-konnectivity-ca\") pod \"konnectivity-agent-h642p\" (UID: \"6cff1f46-7be5-4a8e-82fd-58a656401570\") " pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-k8s-cni-cncf-io\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysconfig\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-var-lib-cni-bin\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysctl-conf\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-systemd\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535888    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-multus-socket-dir-parent\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysconfig\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49428826-e094-4b3a-8cc4-3021fa336170-etc-tuned\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d6993f7-f1bb-4688-903b-506daf290787-host-run-k8s-cni-cncf-io\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-cni-binary-copy\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-sysctl-conf\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.535972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-etc-systemd\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538322 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.536033    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-var-lib-kubelet\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536086    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-host\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:06.536102    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:07.036082675 +0000 UTC m=+3.131020915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536167    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-host\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536173    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49428826-e094-4b3a-8cc4-3021fa336170-var-lib-kubelet\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1705e4ce-db05-44b0-818e-d0de09772b10-iptables-alerter-script\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.536512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e692baf8-fd87-47de-b13d-a13e658b6036-cni-binary-copy\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.537672    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cff1f46-7be5-4a8e-82fd-58a656401570-agent-certs\") pod \"konnectivity-agent-h642p\" (UID: \"6cff1f46-7be5-4a8e-82fd-58a656401570\") " pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.538296    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49428826-e094-4b3a-8cc4-3021fa336170-etc-tuned\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.538858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.538395    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49428826-e094-4b3a-8cc4-3021fa336170-tmp\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.543625 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.543601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svtxv\" (UniqueName: \"kubernetes.io/projected/61ff2476-3459-428e-a84e-a51f2744679f-kube-api-access-svtxv\") pod \"aws-ebs-csi-driver-node-qpz5j\" (UID: \"61ff2476-3459-428e-a84e-a51f2744679f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.543732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.543625    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spplt\" (UniqueName: \"kubernetes.io/projected/9d6993f7-f1bb-4688-903b-506daf290787-kube-api-access-spplt\") pod \"multus-pqh2w\" (UID: \"9d6993f7-f1bb-4688-903b-506daf290787\") " pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.543732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.543660    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qmpz\" (UniqueName: \"kubernetes.io/projected/e692baf8-fd87-47de-b13d-a13e658b6036-kube-api-access-2qmpz\") pod \"multus-additional-cni-plugins-p89n2\" (UID: \"e692baf8-fd87-47de-b13d-a13e658b6036\") " pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.545614 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.545591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8krhf\" (UniqueName: \"kubernetes.io/projected/6c15626e-2185-4ab7-a7a9-93978773b854-kube-api-access-8krhf\") pod \"node-ca-g4z9q\" (UID: \"6c15626e-2185-4ab7-a7a9-93978773b854\") " pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.545803 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.545787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltsk7\" (UniqueName: \"kubernetes.io/projected/49428826-e094-4b3a-8cc4-3021fa336170-kube-api-access-ltsk7\") pod \"tuned-mdspp\" (UID: \"49428826-e094-4b3a-8cc4-3021fa336170\") " pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.545878 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.545861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qh2r\" (UniqueName: \"kubernetes.io/projected/8b96e872-053b-4450-a7e1-78c603d5a916-kube-api-access-4qh2r\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:06.545917 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.545906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9b54\" (UniqueName: \"kubernetes.io/projected/1705e4ce-db05-44b0-818e-d0de09772b10-kube-api-access-j9b54\") pod \"iptables-alerter-wdq2s\" (UID: \"1705e4ce-db05-44b0-818e-d0de09772b10\") " pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.650067 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.649966    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q45nk"
Jul 15 16:40:06.659343 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.659313    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e1682f_2f0a_4945_b01d_5889222a5e7b.slice/crio-e4b5576ce409a105519ecad9c3641bed32dbeeaba4b815be7c95dd1083b3449c WatchSource:0}: Error finding container e4b5576ce409a105519ecad9c3641bed32dbeeaba4b815be7c95dd1083b3449c: Status 404 returned error can't find the container with id e4b5576ce409a105519ecad9c3641bed32dbeeaba4b815be7c95dd1083b3449c
Jul 15 16:40:06.675402 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.675380    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:06.682702 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.682677    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e5ae0f_1553_4e6e_88ec_ce171bd8a423.slice/crio-35ae4c5ff54309b6e0f93af9b1012c1c7503a1d10e4f0f5d6fa1a4d774bc7903 WatchSource:0}: Error finding container 35ae4c5ff54309b6e0f93af9b1012c1c7503a1d10e4f0f5d6fa1a4d774bc7903: Status 404 returned error can't find the container with id 35ae4c5ff54309b6e0f93af9b1012c1c7503a1d10e4f0f5d6fa1a4d774bc7903
Jul 15 16:40:06.685962 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.685946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g4z9q"
Jul 15 16:40:06.693959 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.693933    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c15626e_2185_4ab7_a7a9_93978773b854.slice/crio-edd13398ea486b544c8ede249e728c501b5015c32259b3e21e363b6b88a08954 WatchSource:0}: Error finding container edd13398ea486b544c8ede249e728c501b5015c32259b3e21e363b6b88a08954: Status 404 returned error can't find the container with id edd13398ea486b544c8ede249e728c501b5015c32259b3e21e363b6b88a08954
Jul 15 16:40:06.702450 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.702433    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wdq2s"
Jul 15 16:40:06.709794 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.709769    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1705e4ce_db05_44b0_818e_d0de09772b10.slice/crio-caa10c44f3dd1b10dba4c90913b8cdafdf53802ccbd1528d36ef5ad3800b6a6f WatchSource:0}: Error finding container caa10c44f3dd1b10dba4c90913b8cdafdf53802ccbd1528d36ef5ad3800b6a6f: Status 404 returned error can't find the container with id caa10c44f3dd1b10dba4c90913b8cdafdf53802ccbd1528d36ef5ad3800b6a6f
Jul 15 16:40:06.723345 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.723322    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j"
Jul 15 16:40:06.730562 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.730538    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ff2476_3459_428e_a84e_a51f2744679f.slice/crio-99d2dbf623433c18409a15ee9551d41e1dd40206bf02579fb9624e36acab1d3d WatchSource:0}: Error finding container 99d2dbf623433c18409a15ee9551d41e1dd40206bf02579fb9624e36acab1d3d: Status 404 returned error can't find the container with id 99d2dbf623433c18409a15ee9551d41e1dd40206bf02579fb9624e36acab1d3d
Jul 15 16:40:06.736810 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.736791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pqh2w"
Jul 15 16:40:06.746709 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.746677    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6993f7_f1bb_4688_903b_506daf290787.slice/crio-6c3a0ef4e3473dd44058e8566975439982e637915b3a45993aec39ce07991b71 WatchSource:0}: Error finding container 6c3a0ef4e3473dd44058e8566975439982e637915b3a45993aec39ce07991b71: Status 404 returned error can't find the container with id 6c3a0ef4e3473dd44058e8566975439982e637915b3a45993aec39ce07991b71
Jul 15 16:40:06.757336 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.757316    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:06.770054 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.770035    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mdspp"
Jul 15 16:40:06.775318 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.775299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p89n2"
Jul 15 16:40:06.777336 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.777314    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49428826_e094_4b3a_8cc4_3021fa336170.slice/crio-fbdee50a632496b58d8a8ce2da23e0aa991c4a73d618a264a41ee322d48774a9 WatchSource:0}: Error finding container fbdee50a632496b58d8a8ce2da23e0aa991c4a73d618a264a41ee322d48774a9: Status 404 returned error can't find the container with id fbdee50a632496b58d8a8ce2da23e0aa991c4a73d618a264a41ee322d48774a9
Jul 15 16:40:06.783076 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:06.783053    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode692baf8_fd87_47de_b13d_a13e658b6036.slice/crio-4ada43990c044947b647cbbb0adfaaac492f4561a1c8abcb88708923de169ffb WatchSource:0}: Error finding container 4ada43990c044947b647cbbb0adfaaac492f4561a1c8abcb88708923de169ffb: Status 404 returned error can't find the container with id 4ada43990c044947b647cbbb0adfaaac492f4561a1c8abcb88708923de169ffb
Jul 15 16:40:06.785144 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:06.785128    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:07.039756 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.039665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:07.039756 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.039711    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:07.039756 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.039742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039794    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039845    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039876    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret podName:56388b74-ab17-4c4c-acdb-73c8f622def6 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:08.039858236 +0000 UTC m=+4.134796463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret") pod "global-pull-secret-syncer-n552f" (UID: "56388b74-ab17-4c4c-acdb-73c8f622def6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039879    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039893    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:08.039886161 +0000 UTC m=+4.134824385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039895    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039907    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ln98x for pod openshift-network-diagnostics/network-check-target-ph46p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:07.039966 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.039943    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x podName:c31f3235-cd14-46f2-b0c6-d3811e1b7a32 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:08.039930965 +0000 UTC m=+4.134869190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ln98x" (UniqueName: "kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x") pod "network-check-target-ph46p" (UID: "c31f3235-cd14-46f2-b0c6-d3811e1b7a32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:07.367557 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.367441    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:35:07 +0000 UTC" deadline="2028-02-04 18:51:42.438789368 +0000 UTC"
Jul 15 16:40:07.367557 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.367506    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13658h11m35.071287372s"
Jul 15 16:40:07.506260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.506221    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:07.506435 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:07.506362    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:07.514277 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.514199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mdspp" event={"ID":"49428826-e094-4b3a-8cc4-3021fa336170","Type":"ContainerStarted","Data":"fbdee50a632496b58d8a8ce2da23e0aa991c4a73d618a264a41ee322d48774a9"}
Jul 15 16:40:07.516289 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.516260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h642p" event={"ID":"6cff1f46-7be5-4a8e-82fd-58a656401570","Type":"ContainerStarted","Data":"9aa7f48bef60b6d0e13de59922601040426259d1cb5ce67b87a7e57787306e39"}
Jul 15 16:40:07.518437 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.518410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pqh2w" event={"ID":"9d6993f7-f1bb-4688-903b-506daf290787","Type":"ContainerStarted","Data":"6c3a0ef4e3473dd44058e8566975439982e637915b3a45993aec39ce07991b71"}
Jul 15 16:40:07.519859 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.519832    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wdq2s" event={"ID":"1705e4ce-db05-44b0-818e-d0de09772b10","Type":"ContainerStarted","Data":"caa10c44f3dd1b10dba4c90913b8cdafdf53802ccbd1528d36ef5ad3800b6a6f"}
Jul 15 16:40:07.521201 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.521177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g4z9q" event={"ID":"6c15626e-2185-4ab7-a7a9-93978773b854","Type":"ContainerStarted","Data":"edd13398ea486b544c8ede249e728c501b5015c32259b3e21e363b6b88a08954"}
Jul 15 16:40:07.523437 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.523413    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"35ae4c5ff54309b6e0f93af9b1012c1c7503a1d10e4f0f5d6fa1a4d774bc7903"}
Jul 15 16:40:07.528703 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.528677    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q45nk" event={"ID":"d4e1682f-2f0a-4945-b01d-5889222a5e7b","Type":"ContainerStarted","Data":"e4b5576ce409a105519ecad9c3641bed32dbeeaba4b815be7c95dd1083b3449c"}
Jul 15 16:40:07.531788 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.531761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal" event={"ID":"5bfb638634a956f3e226b954e59b0eaa","Type":"ContainerStarted","Data":"7dd7839905717dc864947ff8ee28b114cfbbc66d2bfda9c2963838abe277e03e"}
Jul 15 16:40:07.534263 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.534197    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerStarted","Data":"4ada43990c044947b647cbbb0adfaaac492f4561a1c8abcb88708923de169ffb"}
Jul 15 16:40:07.536524 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.536501    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j" event={"ID":"61ff2476-3459-428e-a84e-a51f2744679f","Type":"ContainerStarted","Data":"99d2dbf623433c18409a15ee9551d41e1dd40206bf02579fb9624e36acab1d3d"}
Jul 15 16:40:07.624852 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:07.624765    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:07.816051 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:07.816007    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6ba1ae2b4e46007e8cd92cba1cbdb0.slice/crio-5f8d7aa3883c84005faba53d68fbf9385a79591fb3a6ec80f73fa2246a482075 WatchSource:0}: Error finding container 5f8d7aa3883c84005faba53d68fbf9385a79591fb3a6ec80f73fa2246a482075: Status 404 returned error can't find the container with id 5f8d7aa3883c84005faba53d68fbf9385a79591fb3a6ec80f73fa2246a482075
Jul 15 16:40:08.050114 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.050013    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:08.050319 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.050179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:08.050319 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.050285    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:08.050646 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.050594    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:08.050646 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.050619    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:08.050646 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.050633    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ln98x for pod openshift-network-diagnostics/network-check-target-ph46p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:08.050824 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.050698    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x podName:c31f3235-cd14-46f2-b0c6-d3811e1b7a32 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:10.050677865 +0000 UTC m=+6.145616111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ln98x" (UniqueName: "kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x") pod "network-check-target-ph46p" (UID: "c31f3235-cd14-46f2-b0c6-d3811e1b7a32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:08.051182 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.051155    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:08.051480 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.051214    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:10.051198365 +0000 UTC m=+6.146136592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:08.051480 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.051338    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:08.051480 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.051378    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret podName:56388b74-ab17-4c4c-acdb-73c8f622def6 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:10.051365254 +0000 UTC m=+6.146303482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret") pod "global-pull-secret-syncer-n552f" (UID: "56388b74-ab17-4c4c-acdb-73c8f622def6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:08.368453 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.368332    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:35:07 +0000 UTC" deadline="2028-04-04 23:21:57.477614876 +0000 UTC"
Jul 15 16:40:08.368453 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.368393    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15102h41m49.109227706s"
Jul 15 16:40:08.507581 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.506776    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:08.507581 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.506936    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:08.507581 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.507412    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:08.507581 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:08.507526    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:08.572022 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:08.571979    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal" event={"ID":"be6ba1ae2b4e46007e8cd92cba1cbdb0","Type":"ContainerStarted","Data":"5f8d7aa3883c84005faba53d68fbf9385a79591fb3a6ec80f73fa2246a482075"}
Jul 15 16:40:09.506631 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:09.506593    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:09.507116 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:09.506744    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:10.067269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:10.067323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:10.067373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067502    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067570    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067592    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret podName:56388b74-ab17-4c4c-acdb-73c8f622def6 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:14.067567144 +0000 UTC m=+10.162505396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret") pod "global-pull-secret-syncer-n552f" (UID: "56388b74-ab17-4c4c-acdb-73c8f622def6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067623    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:14.067607253 +0000 UTC m=+10.162545495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067740    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067766    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067795    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ln98x for pod openshift-network-diagnostics/network-check-target-ph46p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:10.067880 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.067841    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x podName:c31f3235-cd14-46f2-b0c6-d3811e1b7a32 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:14.06782539 +0000 UTC m=+10.162763630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ln98x" (UniqueName: "kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x") pod "network-check-target-ph46p" (UID: "c31f3235-cd14-46f2-b0c6-d3811e1b7a32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:10.508223 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:10.507363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:10.508223 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.507552    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:10.508223 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:10.507981    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:10.508223 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:10.508119    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:11.506266 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:11.506226    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:11.506464 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:11.506383    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:12.506862 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:12.506773    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:12.506862 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:12.506827    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:12.507417 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:12.506935    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:12.507417 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:12.507092    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:13.506576 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:13.506006    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:13.506576 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:13.506147    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:14.107343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:14.107402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:14.107456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107518    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107571    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107583    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107593    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107599    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret podName:56388b74-ab17-4c4c-acdb-73c8f622def6 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:22.10757615 +0000 UTC m=+18.202514385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret") pod "global-pull-secret-syncer-n552f" (UID: "56388b74-ab17-4c4c-acdb-73c8f622def6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107609    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ln98x for pod openshift-network-diagnostics/network-check-target-ph46p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107643    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:22.107624926 +0000 UTC m=+18.202563153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:14.107695 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.107665    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x podName:c31f3235-cd14-46f2-b0c6-d3811e1b7a32 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:22.107653859 +0000 UTC m=+18.202592091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ln98x" (UniqueName: "kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x") pod "network-check-target-ph46p" (UID: "c31f3235-cd14-46f2-b0c6-d3811e1b7a32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:14.508389 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:14.507527    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:14.508389 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:14.508089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:14.508389 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.508193    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:14.508684 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:14.508517    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:15.506055 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:15.506016    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:15.506591 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:15.506191    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:16.506311 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:16.506272    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:16.506791 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:16.506321    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:16.506791 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:16.506425    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:16.506791 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:16.506561    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:17.506497 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:17.506463    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:17.506883 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:17.506589    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:18.506486 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:18.506450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:18.506629 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:18.506568    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:18.506894 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:18.506646    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:18.506894 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:18.506755    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:19.506037 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:19.505987    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:19.506218 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:19.506115    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:20.507100 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:20.506863    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:20.507527 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:20.506864    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:20.507527 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:20.507227    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:20.507527 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:20.507287    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:21.506376 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:21.506343    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:21.506557 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:21.506461    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:22.165828 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:22.165786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:22.165839    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:22.165883    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.165948    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.165997    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.166013    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret podName:56388b74-ab17-4c4c-acdb-73c8f622def6 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:38.165993528 +0000 UTC m=+34.260931750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret") pod "global-pull-secret-syncer-n552f" (UID: "56388b74-ab17-4c4c-acdb-73c8f622def6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.166036    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.166048    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:38.166031284 +0000 UTC m=+34.260969510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.166057    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.166070    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ln98x for pod openshift-network-diagnostics/network-check-target-ph46p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:22.166380 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.166117    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x podName:c31f3235-cd14-46f2-b0c6-d3811e1b7a32 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:38.166102148 +0000 UTC m=+34.261040383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ln98x" (UniqueName: "kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x") pod "network-check-target-ph46p" (UID: "c31f3235-cd14-46f2-b0c6-d3811e1b7a32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:22.506397 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:22.506311    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:22.506638 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.506456    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:22.506638 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:22.506522    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:22.506753 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:22.506651    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:23.506505 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:23.506469    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:23.506904 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:23.506599    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:24.506976 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:24.506940    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:24.507465 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:24.507047    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:24.507465 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:24.507093    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:24.507465 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:24.507207    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:25.506467 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:25.506422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:25.506643 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:25.506562    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:26.505990 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:26.505939    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:26.506461 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:26.505995    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:26.506461 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:26.506102    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:26.506461 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:26.506245    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:27.506365 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.506335    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:27.506683 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:27.506464    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:27.621989 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.621963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"b0554dd8a9ab5796ac06574eab22833470302baf90020984fc6fca4b902ba91d"}
Jul 15 16:40:27.624124 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.624097    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal" event={"ID":"be6ba1ae2b4e46007e8cd92cba1cbdb0","Type":"ContainerStarted","Data":"d474340f7953ed298051000a22248e2e36f2b2826a5fde026ab2c20dfc325269"}
Jul 15 16:40:27.625593 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.625567    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mdspp" event={"ID":"49428826-e094-4b3a-8cc4-3021fa336170","Type":"ContainerStarted","Data":"d546dc9c0db13f9f9d6a903cd683110f93e2b648cc3b1d292c3cadbd1ea63f9d"}
Jul 15 16:40:27.627046 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.626996    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pqh2w" event={"ID":"9d6993f7-f1bb-4688-903b-506daf290787","Type":"ContainerStarted","Data":"b6c8d077988730fc25ceb1fa03374f92ef9ebf484bf93a4d11bee53f7e2a62d7"}
Jul 15 16:40:27.638505 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.638450    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-117.ec2.internal" podStartSLOduration=21.638432535 podStartE2EDuration="21.638432535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:27.637983899 +0000 UTC m=+23.732922144" watchObservedRunningTime="2026-07-15 16:40:27.638432535 +0000 UTC m=+23.733370780"
Jul 15 16:40:27.655618 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.655562    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pqh2w" podStartSLOduration=1.961570831 podStartE2EDuration="22.655542434s" totalImagesPullingTime="20.693971603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:27.654679928 +0000 UTC m=+23.749618176" watchObservedRunningTime="2026-07-15 16:40:27.655542434 +0000 UTC m=+23.750480681"
Jul 15 16:40:27.674865 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:27.674821    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mdspp" podStartSLOduration=2.0692089989999998 podStartE2EDuration="22.674807037s" totalImagesPullingTime="20.605598038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:27.674430666 +0000 UTC m=+23.769368910" watchObservedRunningTime="2026-07-15 16:40:27.674807037 +0000 UTC m=+23.769745281"
Jul 15 16:40:28.506629 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.506442    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:28.507484 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.506442    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:28.507484 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:28.506730    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:28.507484 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:28.506777    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:28.630359 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.630311    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q45nk" event={"ID":"d4e1682f-2f0a-4945-b01d-5889222a5e7b","Type":"ContainerStarted","Data":"739b56ac5a6c5fcd75a6b975b4f2ac86296b6034844fc7f6caa69f3fdbf428bb"}
Jul 15 16:40:28.631732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.631707    2567 generic.go:356] "Generic (PLEG): container finished" podID="5bfb638634a956f3e226b954e59b0eaa" containerID="92c9f262573866a3b602cdde6574c3bdfc2e41c64799266ca5de644fc36c879f" exitCode=0
Jul 15 16:40:28.631840 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.631778    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal" event={"ID":"5bfb638634a956f3e226b954e59b0eaa","Type":"ContainerDied","Data":"92c9f262573866a3b602cdde6574c3bdfc2e41c64799266ca5de644fc36c879f"}
Jul 15 16:40:28.633281 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.633256    2567 generic.go:356] "Generic (PLEG): container finished" podID="e692baf8-fd87-47de-b13d-a13e658b6036" containerID="b9c3df5f34be324824c34018199b0b8025bd35efe82c9944093696daccd322f5" exitCode=0
Jul 15 16:40:28.633372 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.633339    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerDied","Data":"b9c3df5f34be324824c34018199b0b8025bd35efe82c9944093696daccd322f5"}
Jul 15 16:40:28.634985 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.634961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j" event={"ID":"61ff2476-3459-428e-a84e-a51f2744679f","Type":"ContainerStarted","Data":"3a9f2375f91425ff1d97330a12f0ff1f1cb3b94e3c7dc1fe87050a3090db341b"}
Jul 15 16:40:28.636441 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.636410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h642p" event={"ID":"6cff1f46-7be5-4a8e-82fd-58a656401570","Type":"ContainerStarted","Data":"640a77bb66030c65008344cf4566b9d68cff22da0afdf9f875a4f785827caa26"}
Jul 15 16:40:28.637720 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.637702    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g4z9q" event={"ID":"6c15626e-2185-4ab7-a7a9-93978773b854","Type":"ContainerStarted","Data":"7c361a9aa22011778b4daaf50ba66c8e6ea93f912538924c71212709f652145f"}
Jul 15 16:40:28.640267 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.640250    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:40:28.640548 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.640531    2567 generic.go:356] "Generic (PLEG): container finished" podID="53e5ae0f-1553-4e6e-88ec-ce171bd8a423" containerID="870e15f1481a874a390785d6d73ce30e224ac3d4d4741a9e238ee5d262cb7ba7" exitCode=1
Jul 15 16:40:28.640627 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.640608    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"2daad5aca446dda3473e5d659bf32f399f05224282fc6c9a407c8b9b4d74275a"}
Jul 15 16:40:28.640677 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.640666    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"53b7e3bd4edda0eb1ee17cb97aba67a94f12194e36a7db7fcf73077df2c4a052"}
Jul 15 16:40:28.640710 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.640698    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"71136ce9a6b5dcf874895c4e1c27879a65524fc4519ac196dc30687a91654919"}
Jul 15 16:40:28.640743 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.640726    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"88e9f6e4bfb88807d1ee628c1be7f87cd8fe442f68e341d1ca9ef647bfd1b685"}
Jul 15 16:40:28.640775 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.640753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerDied","Data":"870e15f1481a874a390785d6d73ce30e224ac3d4d4741a9e238ee5d262cb7ba7"}
Jul 15 16:40:28.648188 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.648130    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q45nk" podStartSLOduration=2.941937072 podStartE2EDuration="23.648115945s" totalImagesPullingTime="20.706178873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:28.648041941 +0000 UTC m=+24.742980179" watchObservedRunningTime="2026-07-15 16:40:28.648115945 +0000 UTC m=+24.743054189"
Jul 15 16:40:28.661717 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.661642    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h642p" podStartSLOduration=3.061556033 podStartE2EDuration="23.66162741s" totalImagesPullingTime="20.600071377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:28.66145039 +0000 UTC m=+24.756388634" watchObservedRunningTime="2026-07-15 16:40:28.66162741 +0000 UTC m=+24.756565654"
Jul 15 16:40:28.690141 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:28.689890    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g4z9q" podStartSLOduration=3.018297255 podStartE2EDuration="23.689868481s" totalImagesPullingTime="20.671571226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:28.689259647 +0000 UTC m=+24.784197893" watchObservedRunningTime="2026-07-15 16:40:28.689868481 +0000 UTC m=+24.784806730"
Jul 15 16:40:29.453252 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.453205    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:29.453852 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.453830    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:29.506103 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.506079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:29.506264 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:29.506199    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:29.593353 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.593324    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 16:40:29.644219 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.644183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wdq2s" event={"ID":"1705e4ce-db05-44b0-818e-d0de09772b10","Type":"ContainerStarted","Data":"27b51a53f9ebbc3e5211c7b71921d729e10227ee8af4a1a0e54d75447ea6397c"}
Jul 15 16:40:29.646189 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.646148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal" event={"ID":"5bfb638634a956f3e226b954e59b0eaa","Type":"ContainerStarted","Data":"8e0e80a049147d89df2317be27085305b32019ba59060e8dbbf0902b92d5f648"}
Jul 15 16:40:29.648308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.648219    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j" event={"ID":"61ff2476-3459-428e-a84e-a51f2744679f","Type":"ContainerStarted","Data":"4fb35ca4b7769a113bbff83002db9c79c1d8ef815159a97c92a8562f9097b783"}
Jul 15 16:40:29.648799 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.648777    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:29.649181 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.649149    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h642p"
Jul 15 16:40:29.660031 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:29.659975    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wdq2s" podStartSLOduration=3.9866514840000002 podStartE2EDuration="24.659959561s" totalImagesPullingTime="20.673308077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:29.659913246 +0000 UTC m=+25.754851493" watchObservedRunningTime="2026-07-15 16:40:29.659959561 +0000 UTC m=+25.754897806"
Jul 15 16:40:30.421584 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:30.421449    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T16:40:29.593347115Z","UUID":"e04f45bd-b964-4d06-ade4-9181de72974a","Handler":null,"Name":"","Endpoint":""}
Jul 15 16:40:30.423053 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:30.423032    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 16:40:30.423193 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:30.423069    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 16:40:30.506022 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:30.505986    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:30.506208 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:30.506133    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:30.506208 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:30.506115    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:30.506328 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:30.506287    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:30.654082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:30.654052    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:40:30.654586 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:30.654555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"bd8a23a1449898d1c7f59c62ca47213e50cfd86328c3b12f507ef3656a6003f7"}
Jul 15 16:40:31.506089 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:31.506050    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:31.506278 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:31.506183    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:31.659452 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:31.659414    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j" event={"ID":"61ff2476-3459-428e-a84e-a51f2744679f","Type":"ContainerStarted","Data":"b95b8ae635cb9f31dd900151218c89fe893995eac63f1f3beb154aaf4d479baa"}
Jul 15 16:40:31.679746 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:31.679694    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-117.ec2.internal" podStartSLOduration=25.679679081 podStartE2EDuration="25.679679081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:29.697037758 +0000 UTC m=+25.791976004" watchObservedRunningTime="2026-07-15 16:40:31.679679081 +0000 UTC m=+27.774617363"
Jul 15 16:40:31.679928 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:31.679899    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qpz5j" podStartSLOduration=3.607676 podStartE2EDuration="26.679887125s" totalImagesPullingTime="23.072211125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:31.679044494 +0000 UTC m=+27.773982740" watchObservedRunningTime="2026-07-15 16:40:31.679887125 +0000 UTC m=+27.774825371"
Jul 15 16:40:32.506493 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:32.506409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:32.506663 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:32.506557    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:32.506663 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:32.506609    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:32.506739 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:32.506710    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:33.506592 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.506371    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:33.507263 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:33.506618    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:33.666352 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.666322    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:40:33.666725 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.666699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"aaf109d8944cd56322d0b599869472cf55018e57021db3165c4af480e75f17f4"}
Jul 15 16:40:33.667109 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.667088    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:33.667221 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.667132    2567 scope.go:117] "RemoveContainer" containerID="870e15f1481a874a390785d6d73ce30e224ac3d4d4741a9e238ee5d262cb7ba7"
Jul 15 16:40:33.667221 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.667176    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:33.668602 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.668578    2567 generic.go:356] "Generic (PLEG): container finished" podID="e692baf8-fd87-47de-b13d-a13e658b6036" containerID="b16ad7c217f5ac89e831488679b7a54c8402e8b52fac2ef6a76ea9315679034b" exitCode=0
Jul 15 16:40:33.668692 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.668626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerDied","Data":"b16ad7c217f5ac89e831488679b7a54c8402e8b52fac2ef6a76ea9315679034b"}
Jul 15 16:40:33.683660 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:33.683635    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:34.507699 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.507533    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:34.508204 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.507579    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:34.508204 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:34.507810    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:34.508204 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:34.507880    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:34.623364 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.623331    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n552f"]
Jul 15 16:40:34.625999 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.625977    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ph46p"]
Jul 15 16:40:34.626116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.626080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:34.626206 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:34.626184    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:34.628850 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.628826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bwrkn"]
Jul 15 16:40:34.674024 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.674002    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:40:34.674384 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.674368    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:34.674435 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.674398    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" event={"ID":"53e5ae0f-1553-4e6e-88ec-ce171bd8a423","Type":"ContainerStarted","Data":"89e628064ac244696acb6e9bdb1afc3f4f29b9d082fd671a9beeff7aaad571e1"}
Jul 15 16:40:34.674517 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:34.674496    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:34.674584 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.674565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:34.674710 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.674600    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:34.674857 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:34.674830    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:34.689824 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.689802    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:40:34.703147 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:34.703108    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml" podStartSLOduration=8.953546408 podStartE2EDuration="29.703092647s" totalImagesPullingTime="20.749546239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:34.702950935 +0000 UTC m=+30.797889180" watchObservedRunningTime="2026-07-15 16:40:34.703092647 +0000 UTC m=+30.798030889"
Jul 15 16:40:35.678606 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:35.678574    2567 generic.go:356] "Generic (PLEG): container finished" podID="e692baf8-fd87-47de-b13d-a13e658b6036" containerID="cf0db8b6ed33ee1a743fa1e199bb9fd2c05e8887b003059f431d84eb4c27b788" exitCode=0
Jul 15 16:40:35.679112 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:35.678657    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerDied","Data":"cf0db8b6ed33ee1a743fa1e199bb9fd2c05e8887b003059f431d84eb4c27b788"}
Jul 15 16:40:36.506170 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:36.506123    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:36.506397 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:36.506123    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:36.506397 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:36.506272    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:36.506397 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:36.506123    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:36.506592 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:36.506432    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:36.506783 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:36.506752    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:37.684644 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:37.684608    2567 generic.go:356] "Generic (PLEG): container finished" podID="e692baf8-fd87-47de-b13d-a13e658b6036" containerID="4b63933c0fd4577b0903c47f52c7eaa9427338c3ebe3ba803b5a1976524b3258" exitCode=0
Jul 15 16:40:37.685021 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:37.684654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerDied","Data":"4b63933c0fd4577b0903c47f52c7eaa9427338c3ebe3ba803b5a1976524b3258"}
Jul 15 16:40:38.187386 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:38.187350    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:38.187386 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:38.187388    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:38.187415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187509    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187513    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187529    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187548    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187561    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ln98x for pod openshift-network-diagnostics/network-check-target-ph46p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187563    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:10.187548586 +0000 UTC m=+66.282486808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:38.187604 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187604    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret podName:56388b74-ab17-4c4c-acdb-73c8f622def6 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:10.187590965 +0000 UTC m=+66.282529189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret") pod "global-pull-secret-syncer-n552f" (UID: "56388b74-ab17-4c4c-acdb-73c8f622def6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:38.187853 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.187615    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x podName:c31f3235-cd14-46f2-b0c6-d3811e1b7a32 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:10.187609077 +0000 UTC m=+66.282547299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ln98x" (UniqueName: "kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x") pod "network-check-target-ph46p" (UID: "c31f3235-cd14-46f2-b0c6-d3811e1b7a32") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:38.506487 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:38.506394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:38.506636 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:38.506394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:38.506636 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:38.506515    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:38.506636 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.506509    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n552f" podUID="56388b74-ab17-4c4c-acdb-73c8f622def6"
Jul 15 16:40:38.506636 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.506614    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ph46p" podUID="c31f3235-cd14-46f2-b0c6-d3811e1b7a32"
Jul 15 16:40:38.506838 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:38.506677    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:40:40.265831 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.265633    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-117.ec2.internal" event="NodeReady"
Jul 15 16:40:40.266246 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.265949    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 16:40:40.301392 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.301362    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"]
Jul 15 16:40:40.303394 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.303377    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.305869 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.305850    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cbbw5\""
Jul 15 16:40:40.306266 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.306245    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 16:40:40.306395 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.306373    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 16:40:40.306500 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.306462    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 16:40:40.316497 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.316467    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 16:40:40.322765 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.322719    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"]
Jul 15 16:40:40.332701 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.332668    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5gfpv"]
Jul 15 16:40:40.334491 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.334471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.337149 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.337103    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 16:40:40.337467 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.337449    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 16:40:40.337574 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.337475    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gzkx\""
Jul 15 16:40:40.339110 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.339085    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gflqs"]
Jul 15 16:40:40.340838 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.340818    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.347490 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.347467    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-554wc\""
Jul 15 16:40:40.348196 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.348175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 16:40:40.348440 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.348422    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 16:40:40.348525 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.348460    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 16:40:40.365569 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.365526    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gfpv"]
Jul 15 16:40:40.366357 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.366332    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gflqs"]
Jul 15 16:40:40.402816 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.402736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-installation-pull-secrets\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.402816 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.402781    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a46929ed-ba85-4911-bbec-0cc70dceed17-ca-trust-extracted\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.403017 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.402855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-trusted-ca\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.403017 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.402927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-image-registry-private-configuration\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.403017 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.402968    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.403184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.403003    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxg5l\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-kube-api-access-dxg5l\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.403184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.403091    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-certificates\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.403184 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.403131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-bound-sa-token\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.503837 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.503804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.504026 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.503855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2ckt\" (UniqueName: \"kubernetes.io/projected/a8982b58-c491-4f5b-a84b-acdc2fbb5871-kube-api-access-n2ckt\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.504026 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.503877    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnqt\" (UniqueName: \"kubernetes.io/projected/f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15-kube-api-access-jmnqt\") pod \"ingress-canary-gflqs\" (UID: \"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15\") " pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.504026 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.503911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8982b58-c491-4f5b-a84b-acdc2fbb5871-config-volume\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.504026 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.503955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-installation-pull-secrets\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504026 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.503977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15-cert\") pod \"ingress-canary-gflqs\" (UID: \"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15\") " pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.504026 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a46929ed-ba85-4911-bbec-0cc70dceed17-ca-trust-extracted\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504334 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504195    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-trusted-ca\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504334 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-image-registry-private-configuration\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504334 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504334 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxg5l\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-kube-api-access-dxg5l\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504334 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504316    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-certificates\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504530 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-bound-sa-token\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.504530 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8982b58-c491-4f5b-a84b-acdc2fbb5871-tmp-dir\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.504530 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:40.504388    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:40:40.504530 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:40.504404    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:40:40.504530 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:40.504462    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:41.004439649 +0000 UTC m=+37.099377872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:40:40.504781 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.504759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a46929ed-ba85-4911-bbec-0cc70dceed17-ca-trust-extracted\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.505081 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.505055    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-certificates\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.505455 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.505435    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-trusted-ca\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.505975 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.505952    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:40:40.506078 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.506011    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:40:40.506078 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.506018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:40:40.508642 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.508334    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 16:40:40.508642 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.508347    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 16:40:40.508642 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.508414    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p9xs\""
Jul 15 16:40:40.508642 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.508419    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlftd\""
Jul 15 16:40:40.508642 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.508334    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 16:40:40.508959 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.508655    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 16:40:40.509823 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.509795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-image-registry-private-configuration\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.509984 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.509961    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-installation-pull-secrets\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.513672 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.513629    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-bound-sa-token\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.514114 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.514096    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxg5l\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-kube-api-access-dxg5l\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:40.604754 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.604717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8982b58-c491-4f5b-a84b-acdc2fbb5871-tmp-dir\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.604940 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.604763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.604940 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:40.604877    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:40.604940 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.604913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2ckt\" (UniqueName: \"kubernetes.io/projected/a8982b58-c491-4f5b-a84b-acdc2fbb5871-kube-api-access-n2ckt\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.604940 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:40.604936    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:41.104916968 +0000 UTC m=+37.199855209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:40.605171 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.604966    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnqt\" (UniqueName: \"kubernetes.io/projected/f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15-kube-api-access-jmnqt\") pod \"ingress-canary-gflqs\" (UID: \"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15\") " pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.605171 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.605005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8982b58-c491-4f5b-a84b-acdc2fbb5871-config-volume\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.605171 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.605045    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15-cert\") pod \"ingress-canary-gflqs\" (UID: \"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15\") " pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.605171 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.605123    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8982b58-c491-4f5b-a84b-acdc2fbb5871-tmp-dir\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.606096 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.606072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8982b58-c491-4f5b-a84b-acdc2fbb5871-config-volume\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.607771 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.607747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15-cert\") pod \"ingress-canary-gflqs\" (UID: \"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15\") " pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.617707 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.617655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnqt\" (UniqueName: \"kubernetes.io/projected/f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15-kube-api-access-jmnqt\") pod \"ingress-canary-gflqs\" (UID: \"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15\") " pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.618056 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.618032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2ckt\" (UniqueName: \"kubernetes.io/projected/a8982b58-c491-4f5b-a84b-acdc2fbb5871-kube-api-access-n2ckt\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:40.652257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.652228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gflqs"
Jul 15 16:40:40.797881 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:40.797838    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gflqs"]
Jul 15 16:40:41.008462 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:41.008379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:41.008628 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:41.008517    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:40:41.008628 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:41.008536    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:40:41.008628 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:41.008592    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:42.008577225 +0000 UTC m=+38.103515448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:40:41.109230 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:41.109189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:41.109410 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:41.109347    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:41.109460 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:41.109432    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:42.109413036 +0000 UTC m=+38.204351286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:42.017880 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.017837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:42.018825 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:42.018015    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:40:42.018825 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:42.018037    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:40:42.018825 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:42.018104    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:44.018086295 +0000 UTC m=+40.113024521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:40:42.119175 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.119119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:42.119350 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:42.119267    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:42.119350 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:42.119338    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:44.119321396 +0000 UTC m=+40.214259630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:42.170910 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.170873    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"]
Jul 15 16:40:42.173777 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.173754    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"]
Jul 15 16:40:42.173918 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.173895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.175621 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.175586    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.177460 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.177429    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7gv6d\""
Jul 15 16:40:42.177460 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.177449    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 16:40:42.177637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.177507    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 16:40:42.177891 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.177426    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 16:40:42.178105 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.178083    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 16:40:42.180586 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.178469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 16:40:42.184081 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.184031    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"]
Jul 15 16:40:42.186922 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.186901    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"]
Jul 15 16:40:42.206240 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.206215    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"]
Jul 15 16:40:42.208249 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.208230    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.210524 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.210507    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 16:40:42.210524 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.210520    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 16:40:42.210828 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.210811    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 16:40:42.210923 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.210849    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 16:40:42.221698 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.221664    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"]
Jul 15 16:40:42.276852 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:42.276781    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ef9fac_7a4c_492b_9e54_4da1f2d5cc15.slice/crio-5acd10958ebd0497d365baa182dd83e9d4ee2bcf244580cf305d27aa2773a81e WatchSource:0}: Error finding container 5acd10958ebd0497d365baa182dd83e9d4ee2bcf244580cf305d27aa2773a81e: Status 404 returned error can't find the container with id 5acd10958ebd0497d365baa182dd83e9d4ee2bcf244580cf305d27aa2773a81e
Jul 15 16:40:42.320955 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.320781    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4d69cc0-c711-4731-8794-7df27b8bc0ce-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.321056 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.320996    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8dd7574b-cf74-4e95-bd68-263f51741a5e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf4df488b-dnjlp\" (UID: \"8dd7574b-cf74-4e95-bd68-263f51741a5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.321056 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321024    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plgdw\" (UniqueName: \"kubernetes.io/projected/8dd7574b-cf74-4e95-bd68-263f51741a5e-kube-api-access-plgdw\") pod \"managed-serviceaccount-addon-agent-7cf4df488b-dnjlp\" (UID: \"8dd7574b-cf74-4e95-bd68-263f51741a5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.321138 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-hub\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.321232 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08dd5dbe-1d4d-4195-b7a0-01850612c465-tmp\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.321274 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.321308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.321347 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw7st\" (UniqueName: \"kubernetes.io/projected/d4d69cc0-c711-4731-8794-7df27b8bc0ce-kube-api-access-vw7st\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.321382 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321374    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08dd5dbe-1d4d-4195-b7a0-01850612c465-klusterlet-config\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.321421 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-ca\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.321454 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.321436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rkgw\" (UniqueName: \"kubernetes.io/projected/08dd5dbe-1d4d-4195-b7a0-01850612c465-kube-api-access-9rkgw\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.422479 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4d69cc0-c711-4731-8794-7df27b8bc0ce-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.422634 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8dd7574b-cf74-4e95-bd68-263f51741a5e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf4df488b-dnjlp\" (UID: \"8dd7574b-cf74-4e95-bd68-263f51741a5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.422634 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plgdw\" (UniqueName: \"kubernetes.io/projected/8dd7574b-cf74-4e95-bd68-263f51741a5e-kube-api-access-plgdw\") pod \"managed-serviceaccount-addon-agent-7cf4df488b-dnjlp\" (UID: \"8dd7574b-cf74-4e95-bd68-263f51741a5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.422634 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422542    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-hub\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.422634 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08dd5dbe-1d4d-4195-b7a0-01850612c465-tmp\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.422814 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.422814 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422778    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.422907 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw7st\" (UniqueName: \"kubernetes.io/projected/d4d69cc0-c711-4731-8794-7df27b8bc0ce-kube-api-access-vw7st\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.422907 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08dd5dbe-1d4d-4195-b7a0-01850612c465-klusterlet-config\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.422907 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-ca\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.423046 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422920    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08dd5dbe-1d4d-4195-b7a0-01850612c465-tmp\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.423046 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.422934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rkgw\" (UniqueName: \"kubernetes.io/projected/08dd5dbe-1d4d-4195-b7a0-01850612c465-kube-api-access-9rkgw\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.423330 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.423304    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4d69cc0-c711-4731-8794-7df27b8bc0ce-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.426308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.426286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-hub\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.426784 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.426760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.426873 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.426803    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-ca\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.426873 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.426841    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4d69cc0-c711-4731-8794-7df27b8bc0ce-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.426947 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.426896    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8dd7574b-cf74-4e95-bd68-263f51741a5e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf4df488b-dnjlp\" (UID: \"8dd7574b-cf74-4e95-bd68-263f51741a5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.427017 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.426994    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/08dd5dbe-1d4d-4195-b7a0-01850612c465-klusterlet-config\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.431361 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.431338    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plgdw\" (UniqueName: \"kubernetes.io/projected/8dd7574b-cf74-4e95-bd68-263f51741a5e-kube-api-access-plgdw\") pod \"managed-serviceaccount-addon-agent-7cf4df488b-dnjlp\" (UID: \"8dd7574b-cf74-4e95-bd68-263f51741a5e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.431516 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.431497    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw7st\" (UniqueName: \"kubernetes.io/projected/d4d69cc0-c711-4731-8794-7df27b8bc0ce-kube-api-access-vw7st\") pod \"cluster-proxy-proxy-agent-54746b9949-6rw9z\" (UID: \"d4d69cc0-c711-4731-8794-7df27b8bc0ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.431855 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.431832    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rkgw\" (UniqueName: \"kubernetes.io/projected/08dd5dbe-1d4d-4195-b7a0-01850612c465-kube-api-access-9rkgw\") pod \"klusterlet-addon-workmgr-8445cc78-g95vh\" (UID: \"08dd5dbe-1d4d-4195-b7a0-01850612c465\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.495838 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.495810    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:40:42.503632 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.503605    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:42.518492 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.518454    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:40:42.638724 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.638689    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"]
Jul 15 16:40:42.642099 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.642077    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"]
Jul 15 16:40:42.643747 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:42.643709    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dd7574b_cf74_4e95_bd68_263f51741a5e.slice/crio-f9cf54176124577721e913969208747fd9bbbb92b213124d0e09dcbc74328dc2 WatchSource:0}: Error finding container f9cf54176124577721e913969208747fd9bbbb92b213124d0e09dcbc74328dc2: Status 404 returned error can't find the container with id f9cf54176124577721e913969208747fd9bbbb92b213124d0e09dcbc74328dc2
Jul 15 16:40:42.644317 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:42.644293    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08dd5dbe_1d4d_4195_b7a0_01850612c465.slice/crio-93caa3e8b95f56ab2536067c15f3b7e1174a48301494c878c2d97caebf7f355c WatchSource:0}: Error finding container 93caa3e8b95f56ab2536067c15f3b7e1174a48301494c878c2d97caebf7f355c: Status 404 returned error can't find the container with id 93caa3e8b95f56ab2536067c15f3b7e1174a48301494c878c2d97caebf7f355c
Jul 15 16:40:42.656934 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.656908    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"]
Jul 15 16:40:42.659627 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:40:42.659600    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4d69cc0_c711_4731_8794_7df27b8bc0ce.slice/crio-fa1ef96062bace1491c20d30d72de5749624f51ae7bebac1dcb3abc590a7bbe3 WatchSource:0}: Error finding container fa1ef96062bace1491c20d30d72de5749624f51ae7bebac1dcb3abc590a7bbe3: Status 404 returned error can't find the container with id fa1ef96062bace1491c20d30d72de5749624f51ae7bebac1dcb3abc590a7bbe3
Jul 15 16:40:42.698301 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.698270    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gflqs" event={"ID":"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15","Type":"ContainerStarted","Data":"5acd10958ebd0497d365baa182dd83e9d4ee2bcf244580cf305d27aa2773a81e"}
Jul 15 16:40:42.700996 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.700974    2567 generic.go:356] "Generic (PLEG): container finished" podID="e692baf8-fd87-47de-b13d-a13e658b6036" containerID="6d1bbdd7357587664f41d81c0390042d2b3516b4ace8a7cab913fa3886d2ec26" exitCode=0
Jul 15 16:40:42.701119 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.701052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerDied","Data":"6d1bbdd7357587664f41d81c0390042d2b3516b4ace8a7cab913fa3886d2ec26"}
Jul 15 16:40:42.702211 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.702188    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" event={"ID":"d4d69cc0-c711-4731-8794-7df27b8bc0ce","Type":"ContainerStarted","Data":"fa1ef96062bace1491c20d30d72de5749624f51ae7bebac1dcb3abc590a7bbe3"}
Jul 15 16:40:42.703182 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.703148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" event={"ID":"08dd5dbe-1d4d-4195-b7a0-01850612c465","Type":"ContainerStarted","Data":"93caa3e8b95f56ab2536067c15f3b7e1174a48301494c878c2d97caebf7f355c"}
Jul 15 16:40:42.704210 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:42.704172    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" event={"ID":"8dd7574b-cf74-4e95-bd68-263f51741a5e","Type":"ContainerStarted","Data":"f9cf54176124577721e913969208747fd9bbbb92b213124d0e09dcbc74328dc2"}
Jul 15 16:40:43.715295 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:43.714706    2567 generic.go:356] "Generic (PLEG): container finished" podID="e692baf8-fd87-47de-b13d-a13e658b6036" containerID="6ae36d80f15fe067f4bd191990b15efee2ec039d86f70691ca4a4c4b038ba6e6" exitCode=0
Jul 15 16:40:43.715295 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:43.714779    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerDied","Data":"6ae36d80f15fe067f4bd191990b15efee2ec039d86f70691ca4a4c4b038ba6e6"}
Jul 15 16:40:44.040896 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:44.040584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:44.040896 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:44.040866    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:40:44.040896 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:44.040890    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:40:44.041221 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:44.040963    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:48.04094225 +0000 UTC m=+44.135880490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:40:44.142261 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:44.142221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:44.142434 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:44.142418    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:44.142506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:44.142484    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:48.142465528 +0000 UTC m=+44.237403755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:44.737426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:44.737389    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p89n2" event={"ID":"e692baf8-fd87-47de-b13d-a13e658b6036","Type":"ContainerStarted","Data":"0f4d7c1bf01ceb87259015e99897a69c85881a7df8bb0c6451c554c3af6b0df9"}
Jul 15 16:40:44.763527 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:44.762886    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p89n2" podStartSLOduration=7.61010875 podStartE2EDuration="39.762863889s" totalImagesPullingTime="32.152755139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:44.761112043 +0000 UTC m=+40.856050289" watchObservedRunningTime="2026-07-15 16:40:44.762863889 +0000 UTC m=+40.857802137"
Jul 15 16:40:48.077311 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:48.075138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:48.077311 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:48.075399    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:40:48.077311 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:48.075416    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:40:48.077311 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:48.075484    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:56.075465582 +0000 UTC m=+52.170403827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:40:48.176234 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:48.176190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:48.176403 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:48.176351    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:48.176461 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:48.176437    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:56.176415018 +0000 UTC m=+52.271353315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:50.755655 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.755598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gflqs" event={"ID":"f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15","Type":"ContainerStarted","Data":"b2eafea6f86ba23eaaeaba5018d023f69fa82e0ab133d845f15dd5ee59310eb3"}
Jul 15 16:40:50.758817 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.758787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" event={"ID":"d4d69cc0-c711-4731-8794-7df27b8bc0ce","Type":"ContainerStarted","Data":"f62addeb43a986e00c08c4b038332a8b75cf00e0c008673c82ccd273a5ff84ef"}
Jul 15 16:40:50.758944 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.758830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" event={"ID":"d4d69cc0-c711-4731-8794-7df27b8bc0ce","Type":"ContainerStarted","Data":"b0824d665317c207e4fb3b0cf48921c956bc12795a70e403055b2e17cc30f18c"}
Jul 15 16:40:50.760482 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.760456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" event={"ID":"08dd5dbe-1d4d-4195-b7a0-01850612c465","Type":"ContainerStarted","Data":"67dd803e2377519a76d17ea9fc38f9736ab67c8b1cef4b10396819c1cd3f4b12"}
Jul 15 16:40:50.761877 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.761840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" event={"ID":"8dd7574b-cf74-4e95-bd68-263f51741a5e","Type":"ContainerStarted","Data":"1a40596525146bf3eecd0a7244042704690c9ffa63b4aaf7cd6f0e0bc7a16777"}
Jul 15 16:40:50.770376 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.770280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:50.770845 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.770603    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gflqs" podStartSLOduration=2.553378672 podStartE2EDuration="10.770586578s" totalImagesPullingTime="8.217207906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:50.770377999 +0000 UTC m=+46.865316278" watchObservedRunningTime="2026-07-15 16:40:50.770586578 +0000 UTC m=+46.865524825"
Jul 15 16:40:50.771741 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.771676    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:40:50.785861 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.785812    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" podStartSLOduration=0.917325463 podStartE2EDuration="8.785796108s" totalImagesPullingTime="7.868470645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:50.785266654 +0000 UTC m=+46.880204900" watchObservedRunningTime="2026-07-15 16:40:50.785796108 +0000 UTC m=+46.880734330"
Jul 15 16:40:50.800618 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:50.800571    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" podStartSLOduration=0.950194212 podStartE2EDuration="8.800551983s" totalImagesPullingTime="7.850357771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:50.799463896 +0000 UTC m=+46.894402139" watchObservedRunningTime="2026-07-15 16:40:50.800551983 +0000 UTC m=+46.895490227"
Jul 15 16:40:51.766353 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:51.766315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" event={"ID":"d4d69cc0-c711-4731-8794-7df27b8bc0ce","Type":"ContainerStarted","Data":"8c602f62682a869b5b87722f156aa75f353fae49f6be803e9e4a2186393299d8"}
Jul 15 16:40:51.784952 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:51.784901    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" podStartSLOduration=1.945749772 podStartE2EDuration="9.784885534s" totalImagesPullingTime="7.839135762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:51.784566577 +0000 UTC m=+47.879504822" watchObservedRunningTime="2026-07-15 16:40:51.784885534 +0000 UTC m=+47.879823776"
Jul 15 16:40:56.137725 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:56.137684    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:40:56.138238 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:56.137861    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:40:56.138238 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:56.137888    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:40:56.138238 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:56.137990    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:12.137967996 +0000 UTC m=+68.232906239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:40:56.238400 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:40:56.238358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:40:56.238603 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:56.238537    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:56.238670 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:40:56.238626    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:12.238606359 +0000 UTC m=+68.333544592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:41:06.699639 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:06.699612    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk6ml"
Jul 15 16:41:10.248786 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.248728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:41:10.248786 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.248798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:41:10.249307 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.248850    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:41:10.251766 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.251745    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 16:41:10.251766 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.251757    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 16:41:10.251868 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.251746    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 16:41:10.259920 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:10.259895    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 16:41:10.260040 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:10.259972    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:14.259955362 +0000 UTC m=+130.354893584 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : secret "metrics-daemon-secret" not found
Jul 15 16:41:10.262060 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.262043    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 16:41:10.262707 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.262686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/56388b74-ab17-4c4c-acdb-73c8f622def6-original-pull-secret\") pod \"global-pull-secret-syncer-n552f\" (UID: \"56388b74-ab17-4c4c-acdb-73c8f622def6\") " pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:41:10.272981 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.272961    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln98x\" (UniqueName: \"kubernetes.io/projected/c31f3235-cd14-46f2-b0c6-d3811e1b7a32-kube-api-access-ln98x\") pod \"network-check-target-ph46p\" (UID: \"c31f3235-cd14-46f2-b0c6-d3811e1b7a32\") " pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:41:10.533506 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.533477    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlftd\""
Jul 15 16:41:10.541437 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.541409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:41:10.543684 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.543664    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n552f"
Jul 15 16:41:10.669603 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.669572    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ph46p"]
Jul 15 16:41:10.672483 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:41:10.672449    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31f3235_cd14_46f2_b0c6_d3811e1b7a32.slice/crio-8c40082757afdd0075b43798b5d8a39ac0c5a244d1eacf2f92a5b86102ee59ce WatchSource:0}: Error finding container 8c40082757afdd0075b43798b5d8a39ac0c5a244d1eacf2f92a5b86102ee59ce: Status 404 returned error can't find the container with id 8c40082757afdd0075b43798b5d8a39ac0c5a244d1eacf2f92a5b86102ee59ce
Jul 15 16:41:10.684879 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.684854    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n552f"]
Jul 15 16:41:10.688139 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:41:10.688116    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56388b74_ab17_4c4c_acdb_73c8f622def6.slice/crio-8be3502481fa7124c180448a677a582207ea40a10a82f150ee255f4a25113782 WatchSource:0}: Error finding container 8be3502481fa7124c180448a677a582207ea40a10a82f150ee255f4a25113782: Status 404 returned error can't find the container with id 8be3502481fa7124c180448a677a582207ea40a10a82f150ee255f4a25113782
Jul 15 16:41:10.826293 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.826204    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n552f" event={"ID":"56388b74-ab17-4c4c-acdb-73c8f622def6","Type":"ContainerStarted","Data":"8be3502481fa7124c180448a677a582207ea40a10a82f150ee255f4a25113782"}
Jul 15 16:41:10.827278 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:10.827256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ph46p" event={"ID":"c31f3235-cd14-46f2-b0c6-d3811e1b7a32","Type":"ContainerStarted","Data":"8c40082757afdd0075b43798b5d8a39ac0c5a244d1eacf2f92a5b86102ee59ce"}
Jul 15 16:41:12.164484 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:12.164384    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:41:12.165055 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:12.164545    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:41:12.165055 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:12.164562    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:41:12.165055 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:12.164635    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:44.164613551 +0000 UTC m=+100.259551788 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:41:12.265871 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:12.265836    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:41:12.266067 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:12.266020    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:41:12.266138 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:12.266101    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:44.266079056 +0000 UTC m=+100.361017281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:41:15.847616 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:15.847525    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n552f" event={"ID":"56388b74-ab17-4c4c-acdb-73c8f622def6","Type":"ContainerStarted","Data":"890f349b62dd0ccacd86334f4b5afad4bc3bed0f402601d532b0dc2aca6f3307"}
Jul 15 16:41:15.848863 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:15.848839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ph46p" event={"ID":"c31f3235-cd14-46f2-b0c6-d3811e1b7a32","Type":"ContainerStarted","Data":"715385b681df75fa32dd0bf2ab0f1a9ab176bdb5e2ef63b28d9b6c01a67ae1f6"}
Jul 15 16:41:15.849022 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:15.849006    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:41:15.863550 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:15.863509    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n552f" podStartSLOduration=65.98886957 podStartE2EDuration="1m10.863496446s" totalImagesPullingTime="4.874626876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:41:15.863439126 +0000 UTC m=+71.958377370" watchObservedRunningTime="2026-07-15 16:41:15.863496446 +0000 UTC m=+71.958434691"
Jul 15 16:41:15.879838 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:15.879790    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ph46p" podStartSLOduration=66.002233952 podStartE2EDuration="1m10.879776187s" totalImagesPullingTime="4.877542235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:41:15.878975225 +0000 UTC m=+71.973913471" watchObservedRunningTime="2026-07-15 16:41:15.879776187 +0000 UTC m=+71.974714410"
Jul 15 16:41:44.218278 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:44.218236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:41:44.218679 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:44.218364    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:41:44.218679 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:44.218384    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:41:44.218679 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:44.218439    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:48.218424657 +0000 UTC m=+164.313362881 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:41:44.319358 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:44.319318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:41:44.319510 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:44.319465    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:41:44.319549 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:41:44.319526    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:48.319509079 +0000 UTC m=+164.414447318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:41:46.853939 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:41:46.853906    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ph46p"
Jul 15 16:42:14.342869 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:14.342819    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:42:14.343388 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:14.342981    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 16:42:14.343388 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:14.343058    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs podName:8b96e872-053b-4450-a7e1-78c603d5a916 nodeName:}" failed. No retries permitted until 2026-07-15 16:44:16.343039656 +0000 UTC m=+252.437977884 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs") pod "network-metrics-daemon-bwrkn" (UID: "8b96e872-053b-4450-a7e1-78c603d5a916") : secret "metrics-daemon-secret" not found
Jul 15 16:42:43.318798 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:43.318756    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17"
Jul 15 16:42:43.346924 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:43.346890    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5gfpv" podUID="a8982b58-c491-4f5b-a84b-acdc2fbb5871"
Jul 15 16:42:43.537122 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:43.537074    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bwrkn" podUID="8b96e872-053b-4450-a7e1-78c603d5a916"
Jul 15 16:42:44.102718 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:44.102689    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:42:44.102718 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:44.102718    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:42:48.298040 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:48.298000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:42:48.298506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:48.298181    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:42:48.298506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:48.298201    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c4d6cd4c9-pknh2: secret "image-registry-tls" not found
Jul 15 16:42:48.298506 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:48.298256    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls podName:a46929ed-ba85-4911-bbec-0cc70dceed17 nodeName:}" failed. No retries permitted until 2026-07-15 16:44:50.298240234 +0000 UTC m=+286.393178457 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls") pod "image-registry-7c4d6cd4c9-pknh2" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17") : secret "image-registry-tls" not found
Jul 15 16:42:48.398634 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:48.398598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:42:48.398765 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:48.398747    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:42:48.398826 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:48.398817    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls podName:a8982b58-c491-4f5b-a84b-acdc2fbb5871 nodeName:}" failed. No retries permitted until 2026-07-15 16:44:50.398803273 +0000 UTC m=+286.493741499 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls") pod "dns-default-5gfpv" (UID: "a8982b58-c491-4f5b-a84b-acdc2fbb5871") : secret "dns-default-metrics-tls" not found
Jul 15 16:42:50.771444 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:50.771395    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" podUID="08dd5dbe-1d4d-4195-b7a0-01850612c465" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Jul 15 16:42:51.123527 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:51.123489    2567 generic.go:356] "Generic (PLEG): container finished" podID="08dd5dbe-1d4d-4195-b7a0-01850612c465" containerID="67dd803e2377519a76d17ea9fc38f9736ab67c8b1cef4b10396819c1cd3f4b12" exitCode=1
Jul 15 16:42:51.123722 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:51.123562    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" event={"ID":"08dd5dbe-1d4d-4195-b7a0-01850612c465","Type":"ContainerDied","Data":"67dd803e2377519a76d17ea9fc38f9736ab67c8b1cef4b10396819c1cd3f4b12"}
Jul 15 16:42:51.123934 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:51.123920    2567 scope.go:117] "RemoveContainer" containerID="67dd803e2377519a76d17ea9fc38f9736ab67c8b1cef4b10396819c1cd3f4b12"
Jul 15 16:42:51.124890 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:51.124869    2567 generic.go:356] "Generic (PLEG): container finished" podID="8dd7574b-cf74-4e95-bd68-263f51741a5e" containerID="1a40596525146bf3eecd0a7244042704690c9ffa63b4aaf7cd6f0e0bc7a16777" exitCode=255
Jul 15 16:42:51.124976 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:51.124892    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" event={"ID":"8dd7574b-cf74-4e95-bd68-263f51741a5e","Type":"ContainerDied","Data":"1a40596525146bf3eecd0a7244042704690c9ffa63b4aaf7cd6f0e0bc7a16777"}
Jul 15 16:42:51.125200 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:51.125177    2567 scope.go:117] "RemoveContainer" containerID="1a40596525146bf3eecd0a7244042704690c9ffa63b4aaf7cd6f0e0bc7a16777"
Jul 15 16:42:52.129260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:52.129222    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" event={"ID":"08dd5dbe-1d4d-4195-b7a0-01850612c465","Type":"ContainerStarted","Data":"357b5b687f5e13406a0498d777e931ef5af6d3d62f202e940bc1a01ee776db41"}
Jul 15 16:42:52.129694 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:52.129522    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:42:52.130125 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:52.130108    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:42:52.131106 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:52.131087    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" event={"ID":"8dd7574b-cf74-4e95-bd68-263f51741a5e","Type":"ContainerStarted","Data":"b38c0ef29263e52d674d3d9eeba8b28dca07da380fbe1ad13662bfdc6fd58acb"}
Jul 15 16:42:56.374734 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.374657    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pgzbs"]
Jul 15 16:42:56.376458 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.376442    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.378922 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.378901    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 16:42:56.379731 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.379706    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 16:42:56.379731 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.379715    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 16:42:56.379858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.379743    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 16:42:56.379858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.379789    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r79jc\""
Jul 15 16:42:56.388110 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.388086    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pgzbs"]
Jul 15 16:42:56.556004 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.555967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7e2767-985d-4718-af6e-a2833042f62d-data-volume\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.556004 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.556004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d7e2767-985d-4718-af6e-a2833042f62d-crio-socket\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.556246 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.556098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfs28\" (UniqueName: \"kubernetes.io/projected/0d7e2767-985d-4718-af6e-a2833042f62d-kube-api-access-bfs28\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.556246 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.556136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.556246 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.556174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657340 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.657260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7e2767-985d-4718-af6e-a2833042f62d-data-volume\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657340 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.657299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d7e2767-985d-4718-af6e-a2833042f62d-crio-socket\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657492 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.657382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d7e2767-985d-4718-af6e-a2833042f62d-crio-socket\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657492 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.657424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfs28\" (UniqueName: \"kubernetes.io/projected/0d7e2767-985d-4718-af6e-a2833042f62d-kube-api-access-bfs28\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657492 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.657452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657492 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.657479    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657688 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:56.657529    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:42:56.657688 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:56.657628    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:42:57.157606612 +0000 UTC m=+173.252544855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : configmap "kube-rbac-proxy" not found
Jul 15 16:42:56.657688 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:56.657633    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:56.657688 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.657662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d7e2767-985d-4718-af6e-a2833042f62d-data-volume\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:56.657826 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:56.657694    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:42:57.157681024 +0000 UTC m=+173.252619251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:56.667615 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:56.667587    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfs28\" (UniqueName: \"kubernetes.io/projected/0d7e2767-985d-4718-af6e-a2833042f62d-kube-api-access-bfs28\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:57.161592 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:57.161558    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:57.161592 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:57.161593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:57.161800 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:57.161678    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:42:57.161800 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:57.161707    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:57.161800 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:57.161751    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.161730676 +0000 UTC m=+174.256668903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : configmap "kube-rbac-proxy" not found
Jul 15 16:42:57.161800 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:57.161769    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.161757526 +0000 UTC m=+174.256695750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:57.506644 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:57.506548    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:42:58.169785 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:58.169748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:58.169785 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:58.169786    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:42:58.170013 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:58.169873    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:42:58.170013 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:58.169890    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:58.170013 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:58.169948    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:43:00.169934426 +0000 UTC m=+176.264872648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:58.170190 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:42:58.170032    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:43:00.170004789 +0000 UTC m=+176.264943022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : configmap "kube-rbac-proxy" not found
Jul 15 16:42:59.187784 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:59.187756    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q45nk_d4e1682f-2f0a-4945-b01d-5889222a5e7b/dns-node-resolver/0.log"
Jul 15 16:42:59.987074 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:42:59.987047    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g4z9q_6c15626e-2185-4ab7-a7a9-93978773b854/node-ca/0.log"
Jul 15 16:43:00.187937 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:00.187901    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:00.188358 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:00.187941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:00.188358 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:00.188022    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:43:00.188358 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:00.188090    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:43:04.188074007 +0000 UTC m=+180.283012252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : configmap "kube-rbac-proxy" not found
Jul 15 16:43:00.188358 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:00.188137    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:00.188358 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:00.188220    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:43:04.188204178 +0000 UTC m=+180.283142420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:00.989750 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:00.989711    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gflqs_f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15/serve-healthcheck-canary/0.log"
Jul 15 16:43:04.221993 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:04.221956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:04.221993 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:04.221997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:04.222444 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:04.222093    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:43:04.222444 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:04.222121    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:04.222444 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:04.222197    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:43:12.222180991 +0000 UTC m=+188.317119518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : configmap "kube-rbac-proxy" not found
Jul 15 16:43:04.222444 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:04.222213    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls podName:0d7e2767-985d-4718-af6e-a2833042f62d nodeName:}" failed. No retries permitted until 2026-07-15 16:43:12.222206911 +0000 UTC m=+188.317145137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pgzbs" (UID: "0d7e2767-985d-4718-af6e-a2833042f62d") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:12.284827 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:12.284791    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:12.284827 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:12.284833    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:12.285351 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:12.285331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d7e2767-985d-4718-af6e-a2833042f62d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:12.287118 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:12.287101    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d7e2767-985d-4718-af6e-a2833042f62d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pgzbs\" (UID: \"0d7e2767-985d-4718-af6e-a2833042f62d\") " pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:12.587671 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:12.587591    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r79jc\""
Jul 15 16:43:12.595370 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:12.595352    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pgzbs"
Jul 15 16:43:12.720917 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:12.720886    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pgzbs"]
Jul 15 16:43:12.724145 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:43:12.724108    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7e2767_985d_4718_af6e_a2833042f62d.slice/crio-33bbe838330eb572ca832cb51792dc60c24c8b9d80f2e70a7e38c7737d9aa14b WatchSource:0}: Error finding container 33bbe838330eb572ca832cb51792dc60c24c8b9d80f2e70a7e38c7737d9aa14b: Status 404 returned error can't find the container with id 33bbe838330eb572ca832cb51792dc60c24c8b9d80f2e70a7e38c7737d9aa14b
Jul 15 16:43:13.192056 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:13.192019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pgzbs" event={"ID":"0d7e2767-985d-4718-af6e-a2833042f62d","Type":"ContainerStarted","Data":"33bbe838330eb572ca832cb51792dc60c24c8b9d80f2e70a7e38c7737d9aa14b"}
Jul 15 16:43:20.217999 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:20.217904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pgzbs" event={"ID":"0d7e2767-985d-4718-af6e-a2833042f62d","Type":"ContainerStarted","Data":"77332df77bdf89efb6ade521be674b9bdc8d17b5fb87447eaf9b75ff7080f5f6"}
Jul 15 16:43:24.238276 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:24.238244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pgzbs" event={"ID":"0d7e2767-985d-4718-af6e-a2833042f62d","Type":"ContainerStarted","Data":"acb7298969717845ffdd42730a5f7f5b24b177a4c9772fd3dc5e9c3fb6ed4f90"}
Jul 15 16:43:28.252446 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:28.252412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pgzbs" event={"ID":"0d7e2767-985d-4718-af6e-a2833042f62d","Type":"ContainerStarted","Data":"d40c12c48dc301d7e9159ef5f026e5c8e191c88919fdc01baa72dde8cd6ad613"}
Jul 15 16:43:28.272234 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:28.272140    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pgzbs" podStartSLOduration=17.919557936 podStartE2EDuration="32.272124667s" totalImagesPullingTime="14.352566731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:42:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:28.270688285 +0000 UTC m=+204.365626531" watchObservedRunningTime="2026-07-15 16:43:28.272124667 +0000 UTC m=+204.367062954"
Jul 15 16:43:32.519638 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:32.519601    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" podUID="d4d69cc0-c711-4731-8794-7df27b8bc0ce" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 15 16:43:36.315934 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.315901    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kfp9g"]
Jul 15 16:43:36.318062 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.318047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.320534 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.320509    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 16:43:36.320654 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.320535    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 16:43:36.320654 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.320600    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zrvq\""
Jul 15 16:43:36.320654 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.320635    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 16:43:36.320907 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.320893    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 16:43:36.321273 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.321257    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 16:43:36.321329 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.321260    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 16:43:36.377726 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.377691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-sys\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.377726 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.377724    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-root\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.377927 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.377745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-accelerators-collector-config\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.377927 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.377863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-wtmp\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.377927 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.377898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cg5j\" (UniqueName: \"kubernetes.io/projected/449eabd7-6e61-47f7-84ec-c4f952988793-kube-api-access-7cg5j\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.378020 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.377927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/449eabd7-6e61-47f7-84ec-c4f952988793-metrics-client-ca\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.378020 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.377977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.378080 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.378018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.378080 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.378048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-textfile\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-sys\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478657 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-root\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-accelerators-collector-config\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-sys\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-wtmp\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-root\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478773    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cg5j\" (UniqueName: \"kubernetes.io/projected/449eabd7-6e61-47f7-84ec-c4f952988793-kube-api-access-7cg5j\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/449eabd7-6e61-47f7-84ec-c4f952988793-metrics-client-ca\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478841    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-wtmp\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.478898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.478875    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.479334 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:36.478986    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 16:43:36.479334 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:36.479056    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls podName:449eabd7-6e61-47f7-84ec-c4f952988793 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:36.979036717 +0000 UTC m=+213.073974954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls") pod "node-exporter-kfp9g" (UID: "449eabd7-6e61-47f7-84ec-c4f952988793") : secret "node-exporter-tls" not found
Jul 15 16:43:36.479334 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.479073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-textfile\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.479434 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.479390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-textfile\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.479434 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.479400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-accelerators-collector-config\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.479434 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.479414    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/449eabd7-6e61-47f7-84ec-c4f952988793-metrics-client-ca\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.481316 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.481297    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.487572 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.487547    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cg5j\" (UniqueName: \"kubernetes.io/projected/449eabd7-6e61-47f7-84ec-c4f952988793-kube-api-access-7cg5j\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.983598 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:36.983559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:36.983775 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:36.983705    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 16:43:36.983815 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:43:36.983778    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls podName:449eabd7-6e61-47f7-84ec-c4f952988793 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:37.983762992 +0000 UTC m=+214.078701216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls") pod "node-exporter-kfp9g" (UID: "449eabd7-6e61-47f7-84ec-c4f952988793") : secret "node-exporter-tls" not found
Jul 15 16:43:37.994010 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:37.993969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:37.996340 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:37.996316    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/449eabd7-6e61-47f7-84ec-c4f952988793-node-exporter-tls\") pod \"node-exporter-kfp9g\" (UID: \"449eabd7-6e61-47f7-84ec-c4f952988793\") " pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:38.127073 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:38.127038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kfp9g"
Jul 15 16:43:38.136755 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:43:38.136726    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449eabd7_6e61_47f7_84ec_c4f952988793.slice/crio-0573b4947a104bc4a2af99f16e1e25887043138cfcd33a72b399cd906d345bb8 WatchSource:0}: Error finding container 0573b4947a104bc4a2af99f16e1e25887043138cfcd33a72b399cd906d345bb8: Status 404 returned error can't find the container with id 0573b4947a104bc4a2af99f16e1e25887043138cfcd33a72b399cd906d345bb8
Jul 15 16:43:38.281947 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:38.281912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfp9g" event={"ID":"449eabd7-6e61-47f7-84ec-c4f952988793","Type":"ContainerStarted","Data":"0573b4947a104bc4a2af99f16e1e25887043138cfcd33a72b399cd906d345bb8"}
Jul 15 16:43:42.297066 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:42.297031    2567 generic.go:356] "Generic (PLEG): container finished" podID="449eabd7-6e61-47f7-84ec-c4f952988793" containerID="0d2f244baf08c895d7c1aa9f432d111a0a7fc5d666bd64bf061db08c3d6ba235" exitCode=0
Jul 15 16:43:42.297483 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:42.297122    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfp9g" event={"ID":"449eabd7-6e61-47f7-84ec-c4f952988793","Type":"ContainerDied","Data":"0d2f244baf08c895d7c1aa9f432d111a0a7fc5d666bd64bf061db08c3d6ba235"}
Jul 15 16:43:42.520026 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:42.519990    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" podUID="d4d69cc0-c711-4731-8794-7df27b8bc0ce" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 15 16:43:43.302354 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:43.302317    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfp9g" event={"ID":"449eabd7-6e61-47f7-84ec-c4f952988793","Type":"ContainerStarted","Data":"8be8f814cfa8ac3da8502900987ce141456393c44f0ab9328c457bac4d36cc5a"}
Jul 15 16:43:43.302738 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:43.302380    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfp9g" event={"ID":"449eabd7-6e61-47f7-84ec-c4f952988793","Type":"ContainerStarted","Data":"5106f8f5dbcbd62d7e59902cd3eb98b8e4e7cea92eda457f76fddcf33c01a1c6"}
Jul 15 16:43:43.321953 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:43.321907    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kfp9g" podStartSLOduration=3.9610335340000002 podStartE2EDuration="7.321889766s" totalImagesPullingTime="3.295857758s" totalInitContainerRuntime="64.998474ms" isStatefulPod=true podCreationTimestamp="2026-07-15 16:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:43.320535988 +0000 UTC m=+219.415474245" watchObservedRunningTime="2026-07-15 16:43:43.321889766 +0000 UTC m=+219.416828048"
Jul 15 16:43:52.520297 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:52.520257    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" podUID="d4d69cc0-c711-4731-8794-7df27b8bc0ce" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 15 16:43:52.520745 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:52.520326    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z"
Jul 15 16:43:52.520787 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:52.520746    2567 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8c602f62682a869b5b87722f156aa75f353fae49f6be803e9e4a2186393299d8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 15 16:43:52.520819 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:52.520793    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" podUID="d4d69cc0-c711-4731-8794-7df27b8bc0ce" containerName="service-proxy" containerID="cri-o://8c602f62682a869b5b87722f156aa75f353fae49f6be803e9e4a2186393299d8" gracePeriod=30
Jul 15 16:43:53.336998 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:53.336964    2567 generic.go:356] "Generic (PLEG): container finished" podID="d4d69cc0-c711-4731-8794-7df27b8bc0ce" containerID="8c602f62682a869b5b87722f156aa75f353fae49f6be803e9e4a2186393299d8" exitCode=2
Jul 15 16:43:53.337172 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:53.337037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" event={"ID":"d4d69cc0-c711-4731-8794-7df27b8bc0ce","Type":"ContainerDied","Data":"8c602f62682a869b5b87722f156aa75f353fae49f6be803e9e4a2186393299d8"}
Jul 15 16:43:53.337172 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:43:53.337081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54746b9949-6rw9z" event={"ID":"d4d69cc0-c711-4731-8794-7df27b8bc0ce","Type":"ContainerStarted","Data":"3a314c80d9ea3b62f05feeba18431ff4acff911cf05b3db57e17be3f92e4e242"}
Jul 15 16:44:16.388087 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:16.388047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:44:16.390405 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:16.390382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b96e872-053b-4450-a7e1-78c603d5a916-metrics-certs\") pod \"network-metrics-daemon-bwrkn\" (UID: \"8b96e872-053b-4450-a7e1-78c603d5a916\") " pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:44:16.410840 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:16.410811    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p9xs\""
Jul 15 16:44:16.418882 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:16.418862    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bwrkn"
Jul 15 16:44:16.565274 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:16.565244    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bwrkn"]
Jul 15 16:44:16.568611 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:44:16.568589    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b96e872_053b_4450_a7e1_78c603d5a916.slice/crio-4cab3705bd5dde5345e57688a76a893bb7e2b55e07ddc5c60914da1507bd4e42 WatchSource:0}: Error finding container 4cab3705bd5dde5345e57688a76a893bb7e2b55e07ddc5c60914da1507bd4e42: Status 404 returned error can't find the container with id 4cab3705bd5dde5345e57688a76a893bb7e2b55e07ddc5c60914da1507bd4e42
Jul 15 16:44:17.420675 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:17.420641    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwrkn" event={"ID":"8b96e872-053b-4450-a7e1-78c603d5a916","Type":"ContainerStarted","Data":"4cab3705bd5dde5345e57688a76a893bb7e2b55e07ddc5c60914da1507bd4e42"}
Jul 15 16:44:20.431043 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:20.431004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwrkn" event={"ID":"8b96e872-053b-4450-a7e1-78c603d5a916","Type":"ContainerStarted","Data":"1a015620a40a280a1b3d8cea3c6f82a6bffcfcd789f720743772a1dd81b26505"}
Jul 15 16:44:20.431573 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:20.431079    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bwrkn" event={"ID":"8b96e872-053b-4450-a7e1-78c603d5a916","Type":"ContainerStarted","Data":"d17a0166b0eebd619d992153d26ce4a4fd2d1cea533d2a05cdb79ecc0d19ad3d"}
Jul 15 16:44:20.447770 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:20.447720    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bwrkn" podStartSLOduration=252.03250564 podStartE2EDuration="4m15.447704093s" totalImagesPullingTime="3.415198453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:20.446802781 +0000 UTC m=+256.541741026" watchObservedRunningTime="2026-07-15 16:44:20.447704093 +0000 UTC m=+256.542642337"
Jul 15 16:44:27.306017 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:27.305941    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfp9g_449eabd7-6e61-47f7-84ec-c4f952988793/init-textfile/0.log"
Jul 15 16:44:27.507296 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:27.507267    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfp9g_449eabd7-6e61-47f7-84ec-c4f952988793/node-exporter/0.log"
Jul 15 16:44:27.707106 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:27.707031    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfp9g_449eabd7-6e61-47f7-84ec-c4f952988793/kube-rbac-proxy/0.log"
Jul 15 16:44:34.905854 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:34.905827    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q45nk_d4e1682f-2f0a-4945-b01d-5889222a5e7b/dns-node-resolver/0.log"
Jul 15 16:44:35.705806 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:35.705778    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g4z9q_6c15626e-2185-4ab7-a7a9-93978773b854/node-ca/0.log"
Jul 15 16:44:36.705791 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:36.705764    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gflqs_f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15/serve-healthcheck-canary/0.log"
Jul 15 16:44:47.103315 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:44:47.103268    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17"
Jul 15 16:44:47.103315 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:44:47.103268    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5gfpv" podUID="a8982b58-c491-4f5b-a84b-acdc2fbb5871"
Jul 15 16:44:47.515094 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:47.515021    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:44:47.515260 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:47.515021    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:44:50.367210 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.367141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:44:50.369540 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.369517    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"image-registry-7c4d6cd4c9-pknh2\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") " pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:44:50.468494 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.468452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:44:50.470610 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.470590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8982b58-c491-4f5b-a84b-acdc2fbb5871-metrics-tls\") pod \"dns-default-5gfpv\" (UID: \"a8982b58-c491-4f5b-a84b-acdc2fbb5871\") " pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:44:50.519397 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.519366    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gzkx\""
Jul 15 16:44:50.519397 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.519366    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cbbw5\""
Jul 15 16:44:50.526938 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.526910    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:44:50.526938 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.526919    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:44:50.670355 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.670323    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"]
Jul 15 16:44:50.672764 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:44:50.672729    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46929ed_ba85_4911_bbec_0cc70dceed17.slice/crio-ad240deabf40557afec53a6903a7e770b448db07d93adec17441599015cc3ccb WatchSource:0}: Error finding container ad240deabf40557afec53a6903a7e770b448db07d93adec17441599015cc3ccb: Status 404 returned error can't find the container with id ad240deabf40557afec53a6903a7e770b448db07d93adec17441599015cc3ccb
Jul 15 16:44:50.681602 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:50.681581    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gfpv"]
Jul 15 16:44:50.684857 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:44:50.684837    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8982b58_c491_4f5b_a84b_acdc2fbb5871.slice/crio-9ad0768c1caf43c44efa624914fa63b7896684aace0160650bf81f9897b08bbc WatchSource:0}: Error finding container 9ad0768c1caf43c44efa624914fa63b7896684aace0160650bf81f9897b08bbc: Status 404 returned error can't find the container with id 9ad0768c1caf43c44efa624914fa63b7896684aace0160650bf81f9897b08bbc
Jul 15 16:44:51.528812 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.528775    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" event={"ID":"a46929ed-ba85-4911-bbec-0cc70dceed17","Type":"ContainerStarted","Data":"659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf"}
Jul 15 16:44:51.529308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.528833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" event={"ID":"a46929ed-ba85-4911-bbec-0cc70dceed17","Type":"ContainerStarted","Data":"ad240deabf40557afec53a6903a7e770b448db07d93adec17441599015cc3ccb"}
Jul 15 16:44:51.529308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.528865    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:44:51.530866 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.530837    2567 generic.go:356] "Generic (PLEG): container finished" podID="08dd5dbe-1d4d-4195-b7a0-01850612c465" containerID="357b5b687f5e13406a0498d777e931ef5af6d3d62f202e940bc1a01ee776db41" exitCode=1
Jul 15 16:44:51.530996 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.530882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" event={"ID":"08dd5dbe-1d4d-4195-b7a0-01850612c465","Type":"ContainerDied","Data":"357b5b687f5e13406a0498d777e931ef5af6d3d62f202e940bc1a01ee776db41"}
Jul 15 16:44:51.530996 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.530933    2567 scope.go:117] "RemoveContainer" containerID="67dd803e2377519a76d17ea9fc38f9736ab67c8b1cef4b10396819c1cd3f4b12"
Jul 15 16:44:51.531246 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.531229    2567 scope.go:117] "RemoveContainer" containerID="357b5b687f5e13406a0498d777e931ef5af6d3d62f202e940bc1a01ee776db41"
Jul 15 16:44:51.531424 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:44:51.531400    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8445cc78-g95vh_open-cluster-management-agent-addon(08dd5dbe-1d4d-4195-b7a0-01850612c465)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" podUID="08dd5dbe-1d4d-4195-b7a0-01850612c465"
Jul 15 16:44:51.533041 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.533012    2567 generic.go:356] "Generic (PLEG): container finished" podID="8dd7574b-cf74-4e95-bd68-263f51741a5e" containerID="b38c0ef29263e52d674d3d9eeba8b28dca07da380fbe1ad13662bfdc6fd58acb" exitCode=255
Jul 15 16:44:51.533131 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.533094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" event={"ID":"8dd7574b-cf74-4e95-bd68-263f51741a5e","Type":"ContainerDied","Data":"b38c0ef29263e52d674d3d9eeba8b28dca07da380fbe1ad13662bfdc6fd58acb"}
Jul 15 16:44:51.533425 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.533408    2567 scope.go:117] "RemoveContainer" containerID="b38c0ef29263e52d674d3d9eeba8b28dca07da380fbe1ad13662bfdc6fd58acb"
Jul 15 16:44:51.533595 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:44:51.533564    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7cf4df488b-dnjlp_open-cluster-management-agent-addon(8dd7574b-cf74-4e95-bd68-263f51741a5e)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" podUID="8dd7574b-cf74-4e95-bd68-263f51741a5e"
Jul 15 16:44:51.534333 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.534310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gfpv" event={"ID":"a8982b58-c491-4f5b-a84b-acdc2fbb5871","Type":"ContainerStarted","Data":"9ad0768c1caf43c44efa624914fa63b7896684aace0160650bf81f9897b08bbc"}
Jul 15 16:44:51.542695 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.542677    2567 scope.go:117] "RemoveContainer" containerID="1a40596525146bf3eecd0a7244042704690c9ffa63b4aaf7cd6f0e0bc7a16777"
Jul 15 16:44:51.551623 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:51.551564    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" podStartSLOduration=286.551545187 podStartE2EDuration="4m46.551545187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:51.550459426 +0000 UTC m=+287.645397672" watchObservedRunningTime="2026-07-15 16:44:51.551545187 +0000 UTC m=+287.646483436"
Jul 15 16:44:52.130005 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:52.129971    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:44:52.496832 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:52.496746    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp"
Jul 15 16:44:52.503893 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:52.503862    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:44:52.541120 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:52.541085    2567 scope.go:117] "RemoveContainer" containerID="357b5b687f5e13406a0498d777e931ef5af6d3d62f202e940bc1a01ee776db41"
Jul 15 16:44:52.541575 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:44:52.541320    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8445cc78-g95vh_open-cluster-management-agent-addon(08dd5dbe-1d4d-4195-b7a0-01850612c465)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" podUID="08dd5dbe-1d4d-4195-b7a0-01850612c465"
Jul 15 16:44:52.542759 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:52.542742    2567 scope.go:117] "RemoveContainer" containerID="b38c0ef29263e52d674d3d9eeba8b28dca07da380fbe1ad13662bfdc6fd58acb"
Jul 15 16:44:52.542909 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:44:52.542888    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7cf4df488b-dnjlp_open-cluster-management-agent-addon(8dd7574b-cf74-4e95-bd68-263f51741a5e)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" podUID="8dd7574b-cf74-4e95-bd68-263f51741a5e"
Jul 15 16:44:53.547450 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:53.547412    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gfpv" event={"ID":"a8982b58-c491-4f5b-a84b-acdc2fbb5871","Type":"ContainerStarted","Data":"cd8fb93aa25118288eab3a1c7d9eed5bf7d362c15f8e460fc38347e43c3647ad"}
Jul 15 16:44:53.547828 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:53.547513    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gfpv" event={"ID":"a8982b58-c491-4f5b-a84b-acdc2fbb5871","Type":"ContainerStarted","Data":"5c526fb7838752f3a8120c1bfe20778ce2785351ff60f2f8d77a4a12be1fddf8"}
Jul 15 16:44:53.547828 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:53.547693    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:44:53.547828 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:53.547824    2567 scope.go:117] "RemoveContainer" containerID="357b5b687f5e13406a0498d777e931ef5af6d3d62f202e940bc1a01ee776db41"
Jul 15 16:44:53.547979 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:44:53.547960    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8445cc78-g95vh_open-cluster-management-agent-addon(08dd5dbe-1d4d-4195-b7a0-01850612c465)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" podUID="08dd5dbe-1d4d-4195-b7a0-01850612c465"
Jul 15 16:44:53.565672 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:44:53.565626    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5gfpv" podStartSLOduration=251.583557115 podStartE2EDuration="4m13.565611604s" totalImagesPullingTime="1.982054489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:53.564862524 +0000 UTC m=+289.659800770" watchObservedRunningTime="2026-07-15 16:44:53.565611604 +0000 UTC m=+289.660549849"
Jul 15 16:45:03.553077 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:03.553048    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5gfpv"
Jul 15 16:45:04.342609 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:04.342582    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:45:04.342884 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:04.342864    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:45:04.345399 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:04.345384    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 16:45:04.507971 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:04.507941    2567 scope.go:117] "RemoveContainer" containerID="b38c0ef29263e52d674d3d9eeba8b28dca07da380fbe1ad13662bfdc6fd58acb"
Jul 15 16:45:04.582975 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:04.582940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf4df488b-dnjlp" event={"ID":"8dd7574b-cf74-4e95-bd68-263f51741a5e","Type":"ContainerStarted","Data":"b0bacd0465d02e8a3fb7e2ba1ea911f8753c677ff236328d5a5e4cf6d74b332d"}
Jul 15 16:45:05.506618 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:05.506587    2567 scope.go:117] "RemoveContainer" containerID="357b5b687f5e13406a0498d777e931ef5af6d3d62f202e940bc1a01ee776db41"
Jul 15 16:45:05.589325 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:05.589284    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" event={"ID":"08dd5dbe-1d4d-4195-b7a0-01850612c465","Type":"ContainerStarted","Data":"69aa14bc0f0fd5efd7a1ff5c716baf1afae0a1bdd9ace6413ddbbc3b83ed7ecd"}
Jul 15 16:45:05.589742 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:05.589575    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:45:05.590560 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:05.590532    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh" podUID="08dd5dbe-1d4d-4195-b7a0-01850612c465" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Jul 15 16:45:06.594031 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:06.594005    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8445cc78-g95vh"
Jul 15 16:45:10.531966 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:10.531932    2567 patch_prober.go:28] interesting pod/image-registry-7c4d6cd4c9-pknh2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:45:10.532381 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:10.531982    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:45:10.788609 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:10.788524    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"]
Jul 15 16:45:10.792707 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:10.792678    2567 patch_prober.go:28] interesting pod/image-registry-7c4d6cd4c9-pknh2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:45:10.792850 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:10.792736    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:45:20.793550 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:20.793520    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:45:35.807862 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:35.807805    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17" containerName="registry" containerID="cri-o://659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf" gracePeriod=30
Jul 15 16:45:37.041410 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.041380    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:45:37.108018 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.107986    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-image-registry-private-configuration\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108228 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108034    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-trusted-ca\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108228 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108059    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-bound-sa-token\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108228 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108085    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-installation-pull-secrets\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108228 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108114    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108228 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108142    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-certificates\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108228 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108193    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a46929ed-ba85-4911-bbec-0cc70dceed17-ca-trust-extracted\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108228 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108224    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxg5l\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-kube-api-access-dxg5l\") pod \"a46929ed-ba85-4911-bbec-0cc70dceed17\" (UID: \"a46929ed-ba85-4911-bbec-0cc70dceed17\") "
Jul 15 16:45:37.108815 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108775    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:37.108923 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.108871    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:37.110833 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.110800    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:37.110967 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.110937    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:37.111078 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.110975    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-kube-api-access-dxg5l" (OuterVolumeSpecName: "kube-api-access-dxg5l") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "kube-api-access-dxg5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:45:37.111078 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.111048    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:45:37.111188 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.111137    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:45:37.116968 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.116942    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a46929ed-ba85-4911-bbec-0cc70dceed17-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a46929ed-ba85-4911-bbec-0cc70dceed17" (UID: "a46929ed-ba85-4911-bbec-0cc70dceed17"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209175    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-image-registry-private-configuration\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209204    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-trusted-ca\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209215    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-bound-sa-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209224    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a46929ed-ba85-4911-bbec-0cc70dceed17-installation-pull-secrets\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209233    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-tls\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209241    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a46929ed-ba85-4911-bbec-0cc70dceed17-registry-certificates\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209249    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a46929ed-ba85-4911-bbec-0cc70dceed17-ca-trust-extracted\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.209257 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.209257    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxg5l\" (UniqueName: \"kubernetes.io/projected/a46929ed-ba85-4911-bbec-0cc70dceed17-kube-api-access-dxg5l\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:45:37.697703 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.697669    2567 generic.go:356] "Generic (PLEG): container finished" podID="a46929ed-ba85-4911-bbec-0cc70dceed17" containerID="659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf" exitCode=0
Jul 15 16:45:37.697703 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.697708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" event={"ID":"a46929ed-ba85-4911-bbec-0cc70dceed17","Type":"ContainerDied","Data":"659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf"}
Jul 15 16:45:37.697911 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.697714    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"
Jul 15 16:45:37.697911 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.697750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4d6cd4c9-pknh2" event={"ID":"a46929ed-ba85-4911-bbec-0cc70dceed17","Type":"ContainerDied","Data":"ad240deabf40557afec53a6903a7e770b448db07d93adec17441599015cc3ccb"}
Jul 15 16:45:37.697911 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.697770    2567 scope.go:117] "RemoveContainer" containerID="659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf"
Jul 15 16:45:37.706402 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.706382    2567 scope.go:117] "RemoveContainer" containerID="659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf"
Jul 15 16:45:37.706697 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:45:37.706675    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf\": container with ID starting with 659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf not found: ID does not exist" containerID="659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf"
Jul 15 16:45:37.706752 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.706705    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf"} err="failed to get container status \"659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf\": rpc error: code = NotFound desc = could not find container \"659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf\": container with ID starting with 659bd30354400576f0d4badbbbcd0b7f520ef1c040260a8685c1d8e6b11083cf not found: ID does not exist"
Jul 15 16:45:37.719439 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.719407    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"]
Jul 15 16:45:37.723823 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:37.723802    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c4d6cd4c9-pknh2"]
Jul 15 16:45:38.510811 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:45:38.510775    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17" path="/var/lib/kubelet/pods/a46929ed-ba85-4911-bbec-0cc70dceed17/volumes"
Jul 15 16:47:43.103900 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.103822    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"]
Jul 15 16:47:43.104378 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.104104    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17" containerName="registry"
Jul 15 16:47:43.104378 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.104118    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17" containerName="registry"
Jul 15 16:47:43.104378 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.104173    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46929ed-ba85-4911-bbec-0cc70dceed17" containerName="registry"
Jul 15 16:47:43.106902 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.106886    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.109331 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.109309    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:47:43.109452 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.109353    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 16:47:43.109511 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.109460    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mjddj\""
Jul 15 16:47:43.128246 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.128212    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"]
Jul 15 16:47:43.181593 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.181558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q47bk\" (UniqueName: \"kubernetes.io/projected/9f561e6a-e845-4374-af2f-d854aaf7bdf2-kube-api-access-q47bk\") pod \"cert-manager-operator-controller-manager-55c444bf86-g2bhv\" (UID: \"9f561e6a-e845-4374-af2f-d854aaf7bdf2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.181593 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.181601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f561e6a-e845-4374-af2f-d854aaf7bdf2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g2bhv\" (UID: \"9f561e6a-e845-4374-af2f-d854aaf7bdf2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.282423 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.282381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q47bk\" (UniqueName: \"kubernetes.io/projected/9f561e6a-e845-4374-af2f-d854aaf7bdf2-kube-api-access-q47bk\") pod \"cert-manager-operator-controller-manager-55c444bf86-g2bhv\" (UID: \"9f561e6a-e845-4374-af2f-d854aaf7bdf2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.282613 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.282436    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f561e6a-e845-4374-af2f-d854aaf7bdf2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g2bhv\" (UID: \"9f561e6a-e845-4374-af2f-d854aaf7bdf2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.282820 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.282799    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f561e6a-e845-4374-af2f-d854aaf7bdf2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-g2bhv\" (UID: \"9f561e6a-e845-4374-af2f-d854aaf7bdf2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.291126 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.291098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q47bk\" (UniqueName: \"kubernetes.io/projected/9f561e6a-e845-4374-af2f-d854aaf7bdf2-kube-api-access-q47bk\") pod \"cert-manager-operator-controller-manager-55c444bf86-g2bhv\" (UID: \"9f561e6a-e845-4374-af2f-d854aaf7bdf2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.415254 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.415120    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"
Jul 15 16:47:43.557199 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.557146    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv"]
Jul 15 16:47:43.561027 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:47:43.560998    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f561e6a_e845_4374_af2f_d854aaf7bdf2.slice/crio-d54af2e0dbb9156da07eca4e32a28110e5d4a1c74cf8a4e8d1c0df98905af532 WatchSource:0}: Error finding container d54af2e0dbb9156da07eca4e32a28110e5d4a1c74cf8a4e8d1c0df98905af532: Status 404 returned error can't find the container with id d54af2e0dbb9156da07eca4e32a28110e5d4a1c74cf8a4e8d1c0df98905af532
Jul 15 16:47:43.563651 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:43.563632    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:47:44.100724 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:44.100681    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv" event={"ID":"9f561e6a-e845-4374-af2f-d854aaf7bdf2","Type":"ContainerStarted","Data":"d54af2e0dbb9156da07eca4e32a28110e5d4a1c74cf8a4e8d1c0df98905af532"}
Jul 15 16:47:46.111446 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:46.111409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv" event={"ID":"9f561e6a-e845-4374-af2f-d854aaf7bdf2","Type":"ContainerStarted","Data":"f563550cd1503221f6c3967906719fc2022a954dc5433120084629cb89ae11b2"}
Jul 15 16:47:46.133030 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:46.132981    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-g2bhv" podStartSLOduration=0.694495822 podStartE2EDuration="3.132962687s" totalImagesPullingTime="2.438466865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:47:46.132798525 +0000 UTC m=+462.227736782" watchObservedRunningTime="2026-07-15 16:47:46.132962687 +0000 UTC m=+462.227900932"
Jul 15 16:47:49.816099 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.816068    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"]
Jul 15 16:47:49.819326 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.819311    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:49.821699 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.821676    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 16:47:49.822554 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.822537    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 16:47:49.822645 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.822562    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8fzl\""
Jul 15 16:47:49.827319 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.827297    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"]
Jul 15 16:47:49.932483 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.932447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp9vg\" (UniqueName: \"kubernetes.io/projected/69169b04-5c5f-4409-a924-52a4e599cb3c-kube-api-access-fp9vg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:49.932653 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.932490    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:49.932653 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:49.932507    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.033666 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.033636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp9vg\" (UniqueName: \"kubernetes.io/projected/69169b04-5c5f-4409-a924-52a4e599cb3c-kube-api-access-fp9vg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.033666 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.033673    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.033913 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.033696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.034051 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.034033    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.034114 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.034096    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.042210 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.042188    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp9vg\" (UniqueName: \"kubernetes.io/projected/69169b04-5c5f-4409-a924-52a4e599cb3c-kube-api-access-fp9vg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.128321 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.128242    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:47:50.250841 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:50.250819    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"]
Jul 15 16:47:50.253103 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:47:50.253079    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69169b04_5c5f_4409_a924_52a4e599cb3c.slice/crio-736bf871da45d83f906647c9e3e02aabda7197a8a8a6b04e12130ec19a753f27 WatchSource:0}: Error finding container 736bf871da45d83f906647c9e3e02aabda7197a8a8a6b04e12130ec19a753f27: Status 404 returned error can't find the container with id 736bf871da45d83f906647c9e3e02aabda7197a8a8a6b04e12130ec19a753f27
Jul 15 16:47:51.131217 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:51.131175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk" event={"ID":"69169b04-5c5f-4409-a924-52a4e599cb3c","Type":"ContainerStarted","Data":"736bf871da45d83f906647c9e3e02aabda7197a8a8a6b04e12130ec19a753f27"}
Jul 15 16:47:58.158345 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.158305    2567 generic.go:356] "Generic (PLEG): container finished" podID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerID="a64f1efd3597b7ac531793d071dbed4e4512375ee950e16b5ead5f9ca5fb90e0" exitCode=0
Jul 15 16:47:58.158784 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.158384    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk" event={"ID":"69169b04-5c5f-4409-a924-52a4e599cb3c","Type":"ContainerDied","Data":"a64f1efd3597b7ac531793d071dbed4e4512375ee950e16b5ead5f9ca5fb90e0"}
Jul 15 16:47:58.347418 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.347387    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g5z4s"]
Jul 15 16:47:58.350435 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.350412    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.352732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.352710    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-64c9l\""
Jul 15 16:47:58.352987 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.352972    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 16:47:58.353074 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.353015    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 16:47:58.359826 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.359799    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g5z4s"]
Jul 15 16:47:58.402739 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.402699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36fd5a55-c75e-4268-88a8-becdf97b6508-bound-sa-token\") pod \"cert-manager-55b4d954d5-g5z4s\" (UID: \"36fd5a55-c75e-4268-88a8-becdf97b6508\") " pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.402924 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.402748    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6stq\" (UniqueName: \"kubernetes.io/projected/36fd5a55-c75e-4268-88a8-becdf97b6508-kube-api-access-j6stq\") pod \"cert-manager-55b4d954d5-g5z4s\" (UID: \"36fd5a55-c75e-4268-88a8-becdf97b6508\") " pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.503773 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.503680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36fd5a55-c75e-4268-88a8-becdf97b6508-bound-sa-token\") pod \"cert-manager-55b4d954d5-g5z4s\" (UID: \"36fd5a55-c75e-4268-88a8-becdf97b6508\") " pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.503773 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.503730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6stq\" (UniqueName: \"kubernetes.io/projected/36fd5a55-c75e-4268-88a8-becdf97b6508-kube-api-access-j6stq\") pod \"cert-manager-55b4d954d5-g5z4s\" (UID: \"36fd5a55-c75e-4268-88a8-becdf97b6508\") " pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.511128 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.511091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36fd5a55-c75e-4268-88a8-becdf97b6508-bound-sa-token\") pod \"cert-manager-55b4d954d5-g5z4s\" (UID: \"36fd5a55-c75e-4268-88a8-becdf97b6508\") " pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.511524 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.511504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6stq\" (UniqueName: \"kubernetes.io/projected/36fd5a55-c75e-4268-88a8-becdf97b6508-kube-api-access-j6stq\") pod \"cert-manager-55b4d954d5-g5z4s\" (UID: \"36fd5a55-c75e-4268-88a8-becdf97b6508\") " pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.659807 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.659764    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g5z4s"
Jul 15 16:47:58.802265 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:58.802229    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g5z4s"]
Jul 15 16:47:58.805703 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:47:58.805675    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36fd5a55_c75e_4268_88a8_becdf97b6508.slice/crio-e89a3d71128ecac117d58798d32b2c831bfb48a64f81d1bcaa20aad4b87416a8 WatchSource:0}: Error finding container e89a3d71128ecac117d58798d32b2c831bfb48a64f81d1bcaa20aad4b87416a8: Status 404 returned error can't find the container with id e89a3d71128ecac117d58798d32b2c831bfb48a64f81d1bcaa20aad4b87416a8
Jul 15 16:47:59.163717 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:47:59.163538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g5z4s" event={"ID":"36fd5a55-c75e-4268-88a8-becdf97b6508","Type":"ContainerStarted","Data":"e89a3d71128ecac117d58798d32b2c831bfb48a64f81d1bcaa20aad4b87416a8"}
Jul 15 16:48:01.174108 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:01.174071    2567 generic.go:356] "Generic (PLEG): container finished" podID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerID="8028feade540e53b7da66e5c5e333af079684c2332a64b02f5f76714f22f4d08" exitCode=0
Jul 15 16:48:01.174599 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:01.174118    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk" event={"ID":"69169b04-5c5f-4409-a924-52a4e599cb3c","Type":"ContainerDied","Data":"8028feade540e53b7da66e5c5e333af079684c2332a64b02f5f76714f22f4d08"}
Jul 15 16:48:02.178899 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:02.178856    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g5z4s" event={"ID":"36fd5a55-c75e-4268-88a8-becdf97b6508","Type":"ContainerStarted","Data":"091608a2b936ad1a25a55b051b0b09ffdc6bce1d91451c7b666ade98c22a592c"}
Jul 15 16:48:02.196612 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:02.196558    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-g5z4s" podStartSLOduration=1.5270224190000001 podStartE2EDuration="4.196542095s" totalImagesPullingTime="2.669519676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:02.195237801 +0000 UTC m=+478.290176047" watchObservedRunningTime="2026-07-15 16:48:02.196542095 +0000 UTC m=+478.291480339"
Jul 15 16:48:11.215979 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:11.215944    2567 generic.go:356] "Generic (PLEG): container finished" podID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerID="4b77f53399e4968127c1af7c1c9f4d25c0691c2467116824eb0601fb1201ee9a" exitCode=0
Jul 15 16:48:11.216407 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:11.216032    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk" event={"ID":"69169b04-5c5f-4409-a924-52a4e599cb3c","Type":"ContainerDied","Data":"4b77f53399e4968127c1af7c1c9f4d25c0691c2467116824eb0601fb1201ee9a"}
Jul 15 16:48:12.368420 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.368385    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:48:12.513012 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.512931    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-util\") pod \"69169b04-5c5f-4409-a924-52a4e599cb3c\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") "
Jul 15 16:48:12.513012 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.512981    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp9vg\" (UniqueName: \"kubernetes.io/projected/69169b04-5c5f-4409-a924-52a4e599cb3c-kube-api-access-fp9vg\") pod \"69169b04-5c5f-4409-a924-52a4e599cb3c\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") "
Jul 15 16:48:12.513012 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.513007    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-bundle\") pod \"69169b04-5c5f-4409-a924-52a4e599cb3c\" (UID: \"69169b04-5c5f-4409-a924-52a4e599cb3c\") "
Jul 15 16:48:12.513409 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.513387    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-bundle" (OuterVolumeSpecName: "bundle") pod "69169b04-5c5f-4409-a924-52a4e599cb3c" (UID: "69169b04-5c5f-4409-a924-52a4e599cb3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:48:12.515171 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.515127    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69169b04-5c5f-4409-a924-52a4e599cb3c-kube-api-access-fp9vg" (OuterVolumeSpecName: "kube-api-access-fp9vg") pod "69169b04-5c5f-4409-a924-52a4e599cb3c" (UID: "69169b04-5c5f-4409-a924-52a4e599cb3c"). InnerVolumeSpecName "kube-api-access-fp9vg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:48:12.517681 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.517655    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-util" (OuterVolumeSpecName: "util") pod "69169b04-5c5f-4409-a924-52a4e599cb3c" (UID: "69169b04-5c5f-4409-a924-52a4e599cb3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:48:12.614250 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.614204    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-util\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:48:12.614250 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.614246    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp9vg\" (UniqueName: \"kubernetes.io/projected/69169b04-5c5f-4409-a924-52a4e599cb3c-kube-api-access-fp9vg\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:48:12.614445 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:12.614262    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69169b04-5c5f-4409-a924-52a4e599cb3c-bundle\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:48:13.224224 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:13.224183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk" event={"ID":"69169b04-5c5f-4409-a924-52a4e599cb3c","Type":"ContainerDied","Data":"736bf871da45d83f906647c9e3e02aabda7197a8a8a6b04e12130ec19a753f27"}
Jul 15 16:48:13.224396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:13.224238    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="736bf871da45d83f906647c9e3e02aabda7197a8a8a6b04e12130ec19a753f27"
Jul 15 16:48:13.224396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:13.224197    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9szdk"
Jul 15 16:48:19.024589 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024550    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"]
Jul 15 16:48:19.025190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024880    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerName="pull"
Jul 15 16:48:19.025190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024896    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerName="pull"
Jul 15 16:48:19.025190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024910    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerName="util"
Jul 15 16:48:19.025190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024917    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerName="util"
Jul 15 16:48:19.025190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024928    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerName="extract"
Jul 15 16:48:19.025190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024936    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerName="extract"
Jul 15 16:48:19.025190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.024987    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="69169b04-5c5f-4409-a924-52a4e599cb3c" containerName="extract"
Jul 15 16:48:19.026859 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.026840    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.029284 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.029261    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:48:19.029384 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.029307    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 16:48:19.029384 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.029344    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-99fzt\""
Jul 15 16:48:19.034937 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.034918    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"]
Jul 15 16:48:19.163050 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.163014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b066f42f-8e3d-417e-9b00-ad2caa71409f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s58zd\" (UID: \"b066f42f-8e3d-417e-9b00-ad2caa71409f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.163256 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.163061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzmdq\" (UniqueName: \"kubernetes.io/projected/b066f42f-8e3d-417e-9b00-ad2caa71409f-kube-api-access-wzmdq\") pod \"openshift-lws-operator-fd8ccff4c-s58zd\" (UID: \"b066f42f-8e3d-417e-9b00-ad2caa71409f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.263965 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.263925    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b066f42f-8e3d-417e-9b00-ad2caa71409f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s58zd\" (UID: \"b066f42f-8e3d-417e-9b00-ad2caa71409f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.264095 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.263979    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmdq\" (UniqueName: \"kubernetes.io/projected/b066f42f-8e3d-417e-9b00-ad2caa71409f-kube-api-access-wzmdq\") pod \"openshift-lws-operator-fd8ccff4c-s58zd\" (UID: \"b066f42f-8e3d-417e-9b00-ad2caa71409f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.264387 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.264369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b066f42f-8e3d-417e-9b00-ad2caa71409f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s58zd\" (UID: \"b066f42f-8e3d-417e-9b00-ad2caa71409f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.272258 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.272234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzmdq\" (UniqueName: \"kubernetes.io/projected/b066f42f-8e3d-417e-9b00-ad2caa71409f-kube-api-access-wzmdq\") pod \"openshift-lws-operator-fd8ccff4c-s58zd\" (UID: \"b066f42f-8e3d-417e-9b00-ad2caa71409f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.335350 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.335254    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"
Jul 15 16:48:19.458081 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:19.457876    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd"]
Jul 15 16:48:19.460538 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:48:19.460508    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb066f42f_8e3d_417e_9b00_ad2caa71409f.slice/crio-c855fb70182c46190964fc8925ed933b8e52176ecd173e37bffdebe685a61198 WatchSource:0}: Error finding container c855fb70182c46190964fc8925ed933b8e52176ecd173e37bffdebe685a61198: Status 404 returned error can't find the container with id c855fb70182c46190964fc8925ed933b8e52176ecd173e37bffdebe685a61198
Jul 15 16:48:20.250335 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:20.250301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd" event={"ID":"b066f42f-8e3d-417e-9b00-ad2caa71409f","Type":"ContainerStarted","Data":"c855fb70182c46190964fc8925ed933b8e52176ecd173e37bffdebe685a61198"}
Jul 15 16:48:22.260290 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:22.260260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd" event={"ID":"b066f42f-8e3d-417e-9b00-ad2caa71409f","Type":"ContainerStarted","Data":"741a5c4280909b755766e2b6760e39a3400e08e48dbac65523beadcbfb484d81"}
Jul 15 16:48:22.277198 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:22.277130    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s58zd" podStartSLOduration=1.520664081 podStartE2EDuration="3.27711444s" totalImagesPullingTime="1.756450359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:22.275499103 +0000 UTC m=+498.370437347" watchObservedRunningTime="2026-07-15 16:48:22.27711444 +0000 UTC m=+498.372052684"
Jul 15 16:48:41.943369 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.943333    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"]
Jul 15 16:48:41.964932 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.964899    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"]
Jul 15 16:48:41.965076 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.965018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:41.967318 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.967290    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 16:48:41.967444 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.967399    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 16:48:41.967635 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.967614    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-htrvj\""
Jul 15 16:48:41.967763 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.967635    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 16:48:41.967763 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:41.967646    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 16:48:42.130417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.130377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be3759e9-51ce-4662-a32d-f781230813de-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.130417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.130415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwqwt\" (UniqueName: \"kubernetes.io/projected/be3759e9-51ce-4662-a32d-f781230813de-kube-api-access-wwqwt\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.130626 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.130474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be3759e9-51ce-4662-a32d-f781230813de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.130626 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.130503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be3759e9-51ce-4662-a32d-f781230813de-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.130626 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.130532    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be3759e9-51ce-4662-a32d-f781230813de-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.231382 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.231284    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be3759e9-51ce-4662-a32d-f781230813de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.231382 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.231326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be3759e9-51ce-4662-a32d-f781230813de-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.231382 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.231369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be3759e9-51ce-4662-a32d-f781230813de-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.231605 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.231407    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be3759e9-51ce-4662-a32d-f781230813de-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.231605 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.231431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwqwt\" (UniqueName: \"kubernetes.io/projected/be3759e9-51ce-4662-a32d-f781230813de-kube-api-access-wwqwt\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.231801 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.231780    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be3759e9-51ce-4662-a32d-f781230813de-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.233797 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.233758    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be3759e9-51ce-4662-a32d-f781230813de-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.233906 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.233844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be3759e9-51ce-4662-a32d-f781230813de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.233950 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.233907    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be3759e9-51ce-4662-a32d-f781230813de-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.242046 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.242024    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwqwt\" (UniqueName: \"kubernetes.io/projected/be3759e9-51ce-4662-a32d-f781230813de-kube-api-access-wwqwt\") pod \"opendatahub-operator-controller-manager-9487b7458-6pszw\" (UID: \"be3759e9-51ce-4662-a32d-f781230813de\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.275176 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.275109    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:42.427614 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:42.427581    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"]
Jul 15 16:48:42.430874 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:48:42.430847    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3759e9_51ce_4662_a32d_f781230813de.slice/crio-5b8101e5393f65921f58548e43bcbee801155964ccc0704bde5aabbf47f2dee7 WatchSource:0}: Error finding container 5b8101e5393f65921f58548e43bcbee801155964ccc0704bde5aabbf47f2dee7: Status 404 returned error can't find the container with id 5b8101e5393f65921f58548e43bcbee801155964ccc0704bde5aabbf47f2dee7
Jul 15 16:48:43.342571 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:43.342530    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw" event={"ID":"be3759e9-51ce-4662-a32d-f781230813de","Type":"ContainerStarted","Data":"5b8101e5393f65921f58548e43bcbee801155964ccc0704bde5aabbf47f2dee7"}
Jul 15 16:48:46.361917 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:46.361883    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw" event={"ID":"be3759e9-51ce-4662-a32d-f781230813de","Type":"ContainerStarted","Data":"59802b5bc65c16eed7a858a04084692290e33c6c82ad34e8fa14b9a8daac87d4"}
Jul 15 16:48:47.367940 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:47.367906    2567 generic.go:356] "Generic (PLEG): container finished" podID="be3759e9-51ce-4662-a32d-f781230813de" containerID="59802b5bc65c16eed7a858a04084692290e33c6c82ad34e8fa14b9a8daac87d4" exitCode=0
Jul 15 16:48:47.368322 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:47.367983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw" event={"ID":"be3759e9-51ce-4662-a32d-f781230813de","Type":"ContainerDied","Data":"59802b5bc65c16eed7a858a04084692290e33c6c82ad34e8fa14b9a8daac87d4"}
Jul 15 16:48:48.374224 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:48.374194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw" event={"ID":"be3759e9-51ce-4662-a32d-f781230813de","Type":"ContainerStarted","Data":"e3653c2f787849d3f70cf941f722504c9a2a03f0c6211136b556277dafa640df"}
Jul 15 16:48:48.374602 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:48.374330    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:48:48.396791 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:48.396738    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw" podStartSLOduration=2.630706289 podStartE2EDuration="7.396719809s" totalImagesPullingTime="3.734729834s" totalInitContainerRuntime="1.031283686s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:48.396005769 +0000 UTC m=+524.490944038" watchObservedRunningTime="2026-07-15 16:48:48.396719809 +0000 UTC m=+524.491658106"
Jul 15 16:48:59.380300 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:48:59.380219    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-6pszw"
Jul 15 16:49:03.410926 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.410892    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"]
Jul 15 16:49:03.413951 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.413930    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.417055 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.417035    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 16:49:03.417187 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.417035    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 16:49:03.417784 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.417767    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-48b2t\""
Jul 15 16:49:03.418443 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.418430    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 16:49:03.419217 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.419198    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 16:49:03.436566 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.436538    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"]
Jul 15 16:49:03.485510 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.485474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f23f2409-0021-42ad-892b-b7e505340971-tls-certs\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.485510 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.485508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw49n\" (UniqueName: \"kubernetes.io/projected/f23f2409-0021-42ad-892b-b7e505340971-kube-api-access-rw49n\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.485719 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.485530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23f2409-0021-42ad-892b-b7e505340971-tmp\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.489429 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.489405    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8rfw9"]
Jul 15 16:49:03.492366 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.492348    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:03.495347 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.495322    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 16:49:03.495439 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.495356    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9l6lr\""
Jul 15 16:49:03.508700 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.508670    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8rfw9"]
Jul 15 16:49:03.586465 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.586429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d9zs\" (UniqueName: \"kubernetes.io/projected/af3ac226-cd42-48e4-bac9-803eb66fe87d-kube-api-access-2d9zs\") pod \"odh-model-controller-7998c67dc4-8rfw9\" (UID: \"af3ac226-cd42-48e4-bac9-803eb66fe87d\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:03.586656 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.586479    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f23f2409-0021-42ad-892b-b7e505340971-tls-certs\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.586656 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.586497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw49n\" (UniqueName: \"kubernetes.io/projected/f23f2409-0021-42ad-892b-b7e505340971-kube-api-access-rw49n\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.586656 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.586516    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23f2409-0021-42ad-892b-b7e505340971-tmp\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.586656 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.586548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af3ac226-cd42-48e4-bac9-803eb66fe87d-cert\") pod \"odh-model-controller-7998c67dc4-8rfw9\" (UID: \"af3ac226-cd42-48e4-bac9-803eb66fe87d\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:03.588878 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.588850    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23f2409-0021-42ad-892b-b7e505340971-tmp\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.589119 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.589101    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f23f2409-0021-42ad-892b-b7e505340971-tls-certs\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.599426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.599402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw49n\" (UniqueName: \"kubernetes.io/projected/f23f2409-0021-42ad-892b-b7e505340971-kube-api-access-rw49n\") pod \"kube-auth-proxy-fbd7ccb4-9jnkk\" (UID: \"f23f2409-0021-42ad-892b-b7e505340971\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.687866 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.687761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af3ac226-cd42-48e4-bac9-803eb66fe87d-cert\") pod \"odh-model-controller-7998c67dc4-8rfw9\" (UID: \"af3ac226-cd42-48e4-bac9-803eb66fe87d\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:03.687866 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.687821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d9zs\" (UniqueName: \"kubernetes.io/projected/af3ac226-cd42-48e4-bac9-803eb66fe87d-kube-api-access-2d9zs\") pod \"odh-model-controller-7998c67dc4-8rfw9\" (UID: \"af3ac226-cd42-48e4-bac9-803eb66fe87d\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:03.688100 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:49:03.687920    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 16:49:03.688100 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:49:03.687993    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af3ac226-cd42-48e4-bac9-803eb66fe87d-cert podName:af3ac226-cd42-48e4-bac9-803eb66fe87d nodeName:}" failed. No retries permitted until 2026-07-15 16:49:04.187971276 +0000 UTC m=+540.282909511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/af3ac226-cd42-48e4-bac9-803eb66fe87d-cert") pod "odh-model-controller-7998c67dc4-8rfw9" (UID: "af3ac226-cd42-48e4-bac9-803eb66fe87d") : secret "odh-model-controller-webhook-cert" not found
Jul 15 16:49:03.696427 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.696402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d9zs\" (UniqueName: \"kubernetes.io/projected/af3ac226-cd42-48e4-bac9-803eb66fe87d-kube-api-access-2d9zs\") pod \"odh-model-controller-7998c67dc4-8rfw9\" (UID: \"af3ac226-cd42-48e4-bac9-803eb66fe87d\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:03.723308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.723273    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"
Jul 15 16:49:03.854062 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:03.854038    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk"]
Jul 15 16:49:03.856475 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:49:03.856440    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23f2409_0021_42ad_892b_b7e505340971.slice/crio-0a90420cff60491b820d1bef68e8ff4cd716066011330a1f85126078d9abed94 WatchSource:0}: Error finding container 0a90420cff60491b820d1bef68e8ff4cd716066011330a1f85126078d9abed94: Status 404 returned error can't find the container with id 0a90420cff60491b820d1bef68e8ff4cd716066011330a1f85126078d9abed94
Jul 15 16:49:04.191436 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.191396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af3ac226-cd42-48e4-bac9-803eb66fe87d-cert\") pod \"odh-model-controller-7998c67dc4-8rfw9\" (UID: \"af3ac226-cd42-48e4-bac9-803eb66fe87d\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:04.193791 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.193761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af3ac226-cd42-48e4-bac9-803eb66fe87d-cert\") pod \"odh-model-controller-7998c67dc4-8rfw9\" (UID: \"af3ac226-cd42-48e4-bac9-803eb66fe87d\") " pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:04.211573 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.211545    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vn8m9"]
Jul 15 16:49:04.215643 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.215625    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.219396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.219376    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 16:49:04.249278 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.249244    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vn8m9"]
Jul 15 16:49:04.292415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.292383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxmq4\" (UniqueName: \"kubernetes.io/projected/30ad39dc-0f1a-4833-aa56-9b217e8baca3-kube-api-access-vxmq4\") pod \"model-serving-api-54d89bd5fc-vn8m9\" (UID: \"30ad39dc-0f1a-4833-aa56-9b217e8baca3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.292595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.292452    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ad39dc-0f1a-4833-aa56-9b217e8baca3-tls-certs\") pod \"model-serving-api-54d89bd5fc-vn8m9\" (UID: \"30ad39dc-0f1a-4833-aa56-9b217e8baca3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.393181 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.393129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxmq4\" (UniqueName: \"kubernetes.io/projected/30ad39dc-0f1a-4833-aa56-9b217e8baca3-kube-api-access-vxmq4\") pod \"model-serving-api-54d89bd5fc-vn8m9\" (UID: \"30ad39dc-0f1a-4833-aa56-9b217e8baca3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.393363 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.393232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ad39dc-0f1a-4833-aa56-9b217e8baca3-tls-certs\") pod \"model-serving-api-54d89bd5fc-vn8m9\" (UID: \"30ad39dc-0f1a-4833-aa56-9b217e8baca3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.396698 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.396679    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 16:49:04.402537 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.402509    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxmq4\" (UniqueName: \"kubernetes.io/projected/30ad39dc-0f1a-4833-aa56-9b217e8baca3-kube-api-access-vxmq4\") pod \"model-serving-api-54d89bd5fc-vn8m9\" (UID: \"30ad39dc-0f1a-4833-aa56-9b217e8baca3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.404550 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.404529    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9l6lr\""
Jul 15 16:49:04.405772 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.405753    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30ad39dc-0f1a-4833-aa56-9b217e8baca3-tls-certs\") pod \"model-serving-api-54d89bd5fc-vn8m9\" (UID: \"30ad39dc-0f1a-4833-aa56-9b217e8baca3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.412487 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.412458    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:04.440199 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.440146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk" event={"ID":"f23f2409-0021-42ad-892b-b7e505340971","Type":"ContainerStarted","Data":"0a90420cff60491b820d1bef68e8ff4cd716066011330a1f85126078d9abed94"}
Jul 15 16:49:04.525126 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.525093    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:04.551638 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.551606    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8rfw9"]
Jul 15 16:49:04.555518 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:49:04.555493    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3ac226_cd42_48e4_bac9_803eb66fe87d.slice/crio-eaefbc83ef12aa374ada3b65721e4f77dc39ff9eff5e19111d24f8f47f40a731 WatchSource:0}: Error finding container eaefbc83ef12aa374ada3b65721e4f77dc39ff9eff5e19111d24f8f47f40a731: Status 404 returned error can't find the container with id eaefbc83ef12aa374ada3b65721e4f77dc39ff9eff5e19111d24f8f47f40a731
Jul 15 16:49:04.650039 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.650001    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"]
Jul 15 16:49:04.653784 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.653752    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.656359 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.656314    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 16:49:04.656494 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.656470    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s76ms\""
Jul 15 16:49:04.656560 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.656341    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 16:49:04.656813 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.656794    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 16:49:04.657070 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.657043    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 16:49:04.664341 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.664312    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"]
Jul 15 16:49:04.681262 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.681223    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vn8m9"]
Jul 15 16:49:04.683993 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:49:04.683964    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ad39dc_0f1a_4833_aa56_9b217e8baca3.slice/crio-ac995042a4b4fdf65c841a29fd6703b768d3c743cf889dcbab4a7865f35451cc WatchSource:0}: Error finding container ac995042a4b4fdf65c841a29fd6703b768d3c743cf889dcbab4a7865f35451cc: Status 404 returned error can't find the container with id ac995042a4b4fdf65c841a29fd6703b768d3c743cf889dcbab4a7865f35451cc
Jul 15 16:49:04.695424 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.695397    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.695558 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.695433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.695558 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.695492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.695558 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.695518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.695718 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.695593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2sjt\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-kube-api-access-z2sjt\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.695718 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.695635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.695718 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.695681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a68db586-c4fb-42dc-ad96-d4469f1f4e14-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.796840 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.796791    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.797043 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.796848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.797043 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.796881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.797043 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.796909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.797043 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.796940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2sjt\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-kube-api-access-z2sjt\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.797043 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.796969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.797043 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.796994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a68db586-c4fb-42dc-ad96-d4469f1f4e14-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.797629 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.797601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.799867 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.799844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-cacerts\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.799983 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.799910    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.799983 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.799941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.800138 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.800113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a68db586-c4fb-42dc-ad96-d4469f1f4e14-local-certs\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.805794 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.805765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-token\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.806054 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.806028    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2sjt\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-kube-api-access-z2sjt\") pod \"istiod-openshift-gateway-7574459656-hvc5h\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:04.967129 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:04.967098    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:05.115126 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:05.115102    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"]
Jul 15 16:49:05.117796 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:49:05.117763    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68db586_c4fb_42dc_ad96_d4469f1f4e14.slice/crio-76532fb6df45746d058fddde391fbd4d1cc6a2262a13d745c21cd316dd21986a WatchSource:0}: Error finding container 76532fb6df45746d058fddde391fbd4d1cc6a2262a13d745c21cd316dd21986a: Status 404 returned error can't find the container with id 76532fb6df45746d058fddde391fbd4d1cc6a2262a13d745c21cd316dd21986a
Jul 15 16:49:05.449282 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:05.449096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" event={"ID":"a68db586-c4fb-42dc-ad96-d4469f1f4e14","Type":"ContainerStarted","Data":"76532fb6df45746d058fddde391fbd4d1cc6a2262a13d745c21cd316dd21986a"}
Jul 15 16:49:05.451144 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:05.451051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9" event={"ID":"30ad39dc-0f1a-4833-aa56-9b217e8baca3","Type":"ContainerStarted","Data":"ac995042a4b4fdf65c841a29fd6703b768d3c743cf889dcbab4a7865f35451cc"}
Jul 15 16:49:05.453634 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:05.453569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9" event={"ID":"af3ac226-cd42-48e4-bac9-803eb66fe87d","Type":"ContainerStarted","Data":"eaefbc83ef12aa374ada3b65721e4f77dc39ff9eff5e19111d24f8f47f40a731"}
Jul 15 16:49:09.584561 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:09.584525    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 16:49:09.592265 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:09.592214    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:49:09.592372 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:09.592295    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:49:10.479298 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.479262    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9" event={"ID":"af3ac226-cd42-48e4-bac9-803eb66fe87d","Type":"ContainerStarted","Data":"0e9ef27c4365a0b8ca0be018d3a3154918e639828e2d27606ee02f93fa60e895"}
Jul 15 16:49:10.479487 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.479319    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:10.480686 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.480660    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk" event={"ID":"f23f2409-0021-42ad-892b-b7e505340971","Type":"ContainerStarted","Data":"2c734cb8f64558a10b5e4417727ca5a95b6b5a76f7da8bfa6cb936bb3a55ac60"}
Jul 15 16:49:10.482102 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.482082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" event={"ID":"a68db586-c4fb-42dc-ad96-d4469f1f4e14","Type":"ContainerStarted","Data":"76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d"}
Jul 15 16:49:10.482284 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.482265    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:10.483518 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.483492    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9" event={"ID":"30ad39dc-0f1a-4833-aa56-9b217e8baca3","Type":"ContainerStarted","Data":"4a884881a2a6ef991ced8b5bc18d470ea2efbd2155ff6b426fe497b141a13e08"}
Jul 15 16:49:10.483635 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.483621    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:10.484081 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.484064    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hvc5h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 16:49:10.484168 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.484103    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" podUID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:49:10.508567 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.508504    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9" podStartSLOduration=2.474342215 podStartE2EDuration="7.508485099s" totalImagesPullingTime="5.034142884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:10.507916457 +0000 UTC m=+546.602854702" watchObservedRunningTime="2026-07-15 16:49:10.508485099 +0000 UTC m=+546.603423387"
Jul 15 16:49:10.531371 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.531309    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-9jnkk" podStartSLOduration=1.807646379 podStartE2EDuration="7.531287945s" totalImagesPullingTime="5.723641566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:10.530698408 +0000 UTC m=+546.625636688" watchObservedRunningTime="2026-07-15 16:49:10.531287945 +0000 UTC m=+546.626226191"
Jul 15 16:49:10.557146 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.557095    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" podStartSLOduration=2.08477263 podStartE2EDuration="6.557080603s" totalImagesPullingTime="4.472307973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:10.55550804 +0000 UTC m=+546.650446332" watchObservedRunningTime="2026-07-15 16:49:10.557080603 +0000 UTC m=+546.652018848"
Jul 15 16:49:10.577269 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:10.577219    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9" podStartSLOduration=1.6776754889999999 podStartE2EDuration="6.577201519s" totalImagesPullingTime="4.89952603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:10.575782194 +0000 UTC m=+546.670720440" watchObservedRunningTime="2026-07-15 16:49:10.577201519 +0000 UTC m=+546.672139765"
Jul 15 16:49:11.010877 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.010843    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"]
Jul 15 16:49:11.014170 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.014134    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.017442 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.017423    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-q72fd\""
Jul 15 16:49:11.052718 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.052718 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d65a846-e695-46bf-8e23-a21c04951b64-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.052905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.052905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052827    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxkxk\" (UniqueName: \"kubernetes.io/projected/0d65a846-e695-46bf-8e23-a21c04951b64-kube-api-access-qxkxk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.052905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.053042 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d65a846-e695-46bf-8e23-a21c04951b64-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.053042 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052936    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.053042 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d65a846-e695-46bf-8e23-a21c04951b64-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.053042 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.052994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.115783 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.115746    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"]
Jul 15 16:49:11.154293 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154456 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxkxk\" (UniqueName: \"kubernetes.io/projected/0d65a846-e695-46bf-8e23-a21c04951b64-kube-api-access-qxkxk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154502 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154540 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d65a846-e695-46bf-8e23-a21c04951b64-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154540 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154612 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d65a846-e695-46bf-8e23-a21c04951b64-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154612 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154710 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154710 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d65a846-e695-46bf-8e23-a21c04951b64-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154710 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154931 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.154995 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.154949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.155149 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.155117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.155270 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.155250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d65a846-e695-46bf-8e23-a21c04951b64-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.156835 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.156813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d65a846-e695-46bf-8e23-a21c04951b64-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.157123 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.157107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d65a846-e695-46bf-8e23-a21c04951b64-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.168907 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.168876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxkxk\" (UniqueName: \"kubernetes.io/projected/0d65a846-e695-46bf-8e23-a21c04951b64-kube-api-access-qxkxk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.168907 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.168901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d65a846-e695-46bf-8e23-a21c04951b64-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vmvbk\" (UID: \"0d65a846-e695-46bf-8e23-a21c04951b64\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.323873 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.323836    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:11.471016 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.470987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"]
Jul 15 16:49:11.472802 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:49:11.472775    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d65a846_e695_46bf_8e23_a21c04951b64.slice/crio-4a0b0a610a6c2cb0beabc7c40c5a738aa664351dc9514f05fb4ac65de4eb007e WatchSource:0}: Error finding container 4a0b0a610a6c2cb0beabc7c40c5a738aa664351dc9514f05fb4ac65de4eb007e: Status 404 returned error can't find the container with id 4a0b0a610a6c2cb0beabc7c40c5a738aa664351dc9514f05fb4ac65de4eb007e
Jul 15 16:49:11.488250 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.488203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk" event={"ID":"0d65a846-e695-46bf-8e23-a21c04951b64","Type":"ContainerStarted","Data":"4a0b0a610a6c2cb0beabc7c40c5a738aa664351dc9514f05fb4ac65de4eb007e"}
Jul 15 16:49:11.489045 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:11.489025    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:13.323186 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.323139    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"]
Jul 15 16:49:13.330075 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.330048    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.332900 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.332856    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"]
Jul 15 16:49:13.333134 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.333103    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dj9xr\""
Jul 15 16:49:13.334033 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.334008    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 16:49:13.336432 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.336397    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:13.339201 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.338960    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qjk56\""
Jul 15 16:49:13.339674 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.339652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"]
Jul 15 16:49:13.339674 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.339669    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 16:49:13.357953 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.357922    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"]
Jul 15 16:49:13.376767 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.376738    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thlwn\" (UniqueName: \"kubernetes.io/projected/e0383adb-3496-4d46-9c66-4c70b7e34d54-kube-api-access-thlwn\") pod \"kserve-controller-manager-d6f4b65b8-lpx5x\" (UID: \"e0383adb-3496-4d46-9c66-4c70b7e34d54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.376939 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.376812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0383adb-3496-4d46-9c66-4c70b7e34d54-cert\") pod \"kserve-controller-manager-d6f4b65b8-lpx5x\" (UID: \"e0383adb-3496-4d46-9c66-4c70b7e34d54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.376939 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.376851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e58f5b32-f225-4087-9ad8-c988d68cf33b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8hbll\" (UID: \"e58f5b32-f225-4087-9ad8-c988d68cf33b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:13.376939 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.376918    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2qj\" (UniqueName: \"kubernetes.io/projected/e58f5b32-f225-4087-9ad8-c988d68cf33b-kube-api-access-gd2qj\") pod \"llmisvc-controller-manager-777c6bd7d5-8hbll\" (UID: \"e58f5b32-f225-4087-9ad8-c988d68cf33b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:13.478181 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.478128    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2qj\" (UniqueName: \"kubernetes.io/projected/e58f5b32-f225-4087-9ad8-c988d68cf33b-kube-api-access-gd2qj\") pod \"llmisvc-controller-manager-777c6bd7d5-8hbll\" (UID: \"e58f5b32-f225-4087-9ad8-c988d68cf33b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:13.478375 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.478233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thlwn\" (UniqueName: \"kubernetes.io/projected/e0383adb-3496-4d46-9c66-4c70b7e34d54-kube-api-access-thlwn\") pod \"kserve-controller-manager-d6f4b65b8-lpx5x\" (UID: \"e0383adb-3496-4d46-9c66-4c70b7e34d54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.478375 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.478272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0383adb-3496-4d46-9c66-4c70b7e34d54-cert\") pod \"kserve-controller-manager-d6f4b65b8-lpx5x\" (UID: \"e0383adb-3496-4d46-9c66-4c70b7e34d54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.478375 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.478296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e58f5b32-f225-4087-9ad8-c988d68cf33b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8hbll\" (UID: \"e58f5b32-f225-4087-9ad8-c988d68cf33b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:13.481042 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.481018    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0383adb-3496-4d46-9c66-4c70b7e34d54-cert\") pod \"kserve-controller-manager-d6f4b65b8-lpx5x\" (UID: \"e0383adb-3496-4d46-9c66-4c70b7e34d54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.481171 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.481018    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e58f5b32-f225-4087-9ad8-c988d68cf33b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8hbll\" (UID: \"e58f5b32-f225-4087-9ad8-c988d68cf33b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:13.491498 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.491441    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thlwn\" (UniqueName: \"kubernetes.io/projected/e0383adb-3496-4d46-9c66-4c70b7e34d54-kube-api-access-thlwn\") pod \"kserve-controller-manager-d6f4b65b8-lpx5x\" (UID: \"e0383adb-3496-4d46-9c66-4c70b7e34d54\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.491633 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.491494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2qj\" (UniqueName: \"kubernetes.io/projected/e58f5b32-f225-4087-9ad8-c988d68cf33b-kube-api-access-gd2qj\") pod \"llmisvc-controller-manager-777c6bd7d5-8hbll\" (UID: \"e58f5b32-f225-4087-9ad8-c988d68cf33b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:13.646576 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.646484    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:13.654939 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:13.654909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:14.117377 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.117343    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:49:14.117488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.117412    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:49:14.117488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.117441    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:49:14.185795 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.184990    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"]
Jul 15 16:49:14.187373 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:49:14.187334    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode58f5b32_f225_4087_9ad8_c988d68cf33b.slice/crio-6635d761e013d59467dfc84b42a30609da275762157141b8ad6c0d110a0cb57c WatchSource:0}: Error finding container 6635d761e013d59467dfc84b42a30609da275762157141b8ad6c0d110a0cb57c: Status 404 returned error can't find the container with id 6635d761e013d59467dfc84b42a30609da275762157141b8ad6c0d110a0cb57c
Jul 15 16:49:14.214574 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.214535    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"]
Jul 15 16:49:14.219436 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:49:14.219408    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0383adb_3496_4d46_9c66_4c70b7e34d54.slice/crio-18608293f8bb619c27b3213925f6e85b0ccdf7e3498ba27dca1c22df1c9cbcb0 WatchSource:0}: Error finding container 18608293f8bb619c27b3213925f6e85b0ccdf7e3498ba27dca1c22df1c9cbcb0: Status 404 returned error can't find the container with id 18608293f8bb619c27b3213925f6e85b0ccdf7e3498ba27dca1c22df1c9cbcb0
Jul 15 16:49:14.503102 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.502998    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk" event={"ID":"0d65a846-e695-46bf-8e23-a21c04951b64","Type":"ContainerStarted","Data":"94ef17eefc6fc82515f538dcf95f0a1fac7867e12534b3cdfbcc61328dfb41e7"}
Jul 15 16:49:14.504327 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.504301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll" event={"ID":"e58f5b32-f225-4087-9ad8-c988d68cf33b","Type":"ContainerStarted","Data":"6635d761e013d59467dfc84b42a30609da275762157141b8ad6c0d110a0cb57c"}
Jul 15 16:49:14.505436 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.505415    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x" event={"ID":"e0383adb-3496-4d46-9c66-4c70b7e34d54","Type":"ContainerStarted","Data":"18608293f8bb619c27b3213925f6e85b0ccdf7e3498ba27dca1c22df1c9cbcb0"}
Jul 15 16:49:14.536143 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:14.536077    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk" podStartSLOduration=1.893852398 podStartE2EDuration="4.536055984s" totalImagesPullingTime="2.642203586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:14.535024991 +0000 UTC m=+550.629963238" watchObservedRunningTime="2026-07-15 16:49:14.536055984 +0000 UTC m=+550.630994230"
Jul 15 16:49:15.324777 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:15.324739    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:15.329790 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:15.329765    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:15.509396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:15.509359    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:15.510244 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:15.510226    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vmvbk"
Jul 15 16:49:17.455946 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.455912    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"]
Jul 15 16:49:17.456452 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.456171    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" podUID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" containerName="discovery" containerID="cri-o://76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d" gracePeriod=30
Jul 15 16:49:17.489561 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.489535    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hvc5h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.21:8080/ready\": dial tcp 10.132.0.21:8080: connect: connection refused" start-of-body=
Jul 15 16:49:17.489660 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.489594    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" podUID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.21:8080/ready\": dial tcp 10.132.0.21:8080: connect: connection refused"
Jul 15 16:49:17.521731 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.521690    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x" event={"ID":"e0383adb-3496-4d46-9c66-4c70b7e34d54","Type":"ContainerStarted","Data":"9a86b80eb9b34f3ebc581d2081b62770c5b82927a769f397a866fd49f672f773"}
Jul 15 16:49:17.521912 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.521773    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:17.537767 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.537709    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x" podStartSLOduration=2.03861849 podStartE2EDuration="4.537693285s" totalImagesPullingTime="2.499074795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:17.537183979 +0000 UTC m=+553.632122226" watchObservedRunningTime="2026-07-15 16:49:17.537693285 +0000 UTC m=+553.632631530"
Jul 15 16:49:17.722256 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.722231    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:17.816112 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816077    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2sjt\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-kube-api-access-z2sjt\") pod \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") "
Jul 15 16:49:17.816329 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816127    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-token\") pod \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") "
Jul 15 16:49:17.816329 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816176    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-kubeconfig\") pod \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") "
Jul 15 16:49:17.816329 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-dns-cert\") pod \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") "
Jul 15 16:49:17.816329 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816225    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a68db586-c4fb-42dc-ad96-d4469f1f4e14-local-certs\") pod \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") "
Jul 15 16:49:17.816329 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816290    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-ca-configmap\") pod \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") "
Jul 15 16:49:17.816644 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816345    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-cacerts\") pod \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\" (UID: \"a68db586-c4fb-42dc-ad96-d4469f1f4e14\") "
Jul 15 16:49:17.816782 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.816749    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a68db586-c4fb-42dc-ad96-d4469f1f4e14" (UID: "a68db586-c4fb-42dc-ad96-d4469f1f4e14"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:49:17.819379 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.819341    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a68db586-c4fb-42dc-ad96-d4469f1f4e14" (UID: "a68db586-c4fb-42dc-ad96-d4469f1f4e14"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:49:17.819379 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.819361    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-kube-api-access-z2sjt" (OuterVolumeSpecName: "kube-api-access-z2sjt") pod "a68db586-c4fb-42dc-ad96-d4469f1f4e14" (UID: "a68db586-c4fb-42dc-ad96-d4469f1f4e14"). InnerVolumeSpecName "kube-api-access-z2sjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:49:17.819553 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.819408    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a68db586-c4fb-42dc-ad96-d4469f1f4e14" (UID: "a68db586-c4fb-42dc-ad96-d4469f1f4e14"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:49:17.819553 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.819445    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-token" (OuterVolumeSpecName: "istio-token") pod "a68db586-c4fb-42dc-ad96-d4469f1f4e14" (UID: "a68db586-c4fb-42dc-ad96-d4469f1f4e14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:49:17.819670 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.819605    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a68db586-c4fb-42dc-ad96-d4469f1f4e14-local-certs" (OuterVolumeSpecName: "local-certs") pod "a68db586-c4fb-42dc-ad96-d4469f1f4e14" (UID: "a68db586-c4fb-42dc-ad96-d4469f1f4e14"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:49:17.819670 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.819638    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-cacerts" (OuterVolumeSpecName: "cacerts") pod "a68db586-c4fb-42dc-ad96-d4469f1f4e14" (UID: "a68db586-c4fb-42dc-ad96-d4469f1f4e14"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:49:17.917288 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.917249    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-ca-configmap\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:49:17.917288 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.917278    2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-cacerts\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:49:17.917288 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.917293    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2sjt\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-kube-api-access-z2sjt\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:49:17.917583 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.917306    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:49:17.917583 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.917320    2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-kubeconfig\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:49:17.917583 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.917334    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a68db586-c4fb-42dc-ad96-d4469f1f4e14-istio-csr-dns-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:49:17.917583 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:17.917348    2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a68db586-c4fb-42dc-ad96-d4469f1f4e14-local-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:49:18.526449 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.526420    2567 generic.go:356] "Generic (PLEG): container finished" podID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" containerID="76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d" exitCode=0
Jul 15 16:49:18.526770 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.526461    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"
Jul 15 16:49:18.526770 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.526505    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" event={"ID":"a68db586-c4fb-42dc-ad96-d4469f1f4e14","Type":"ContainerDied","Data":"76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d"}
Jul 15 16:49:18.526770 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.526553    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h" event={"ID":"a68db586-c4fb-42dc-ad96-d4469f1f4e14","Type":"ContainerDied","Data":"76532fb6df45746d058fddde391fbd4d1cc6a2262a13d745c21cd316dd21986a"}
Jul 15 16:49:18.526770 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.526578    2567 scope.go:117] "RemoveContainer" containerID="76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d"
Jul 15 16:49:18.534946 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.534927    2567 scope.go:117] "RemoveContainer" containerID="76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d"
Jul 15 16:49:18.535261 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:49:18.535232    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d\": container with ID starting with 76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d not found: ID does not exist" containerID="76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d"
Jul 15 16:49:18.535359 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.535262    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d"} err="failed to get container status \"76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d\": rpc error: code = NotFound desc = could not find container \"76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d\": container with ID starting with 76626836aa5ab5f50aaa238ea434cade7fafb9b5c22a250510fb803aedf58c7d not found: ID does not exist"
Jul 15 16:49:18.548439 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.548413    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"]
Jul 15 16:49:18.558034 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:18.558007    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hvc5h"]
Jul 15 16:49:20.515336 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:20.513077    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" path="/var/lib/kubelet/pods/a68db586-c4fb-42dc-ad96-d4469f1f4e14/volumes"
Jul 15 16:49:20.537630 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:20.537595    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll" event={"ID":"e58f5b32-f225-4087-9ad8-c988d68cf33b","Type":"ContainerStarted","Data":"8f347053f7e79185d9b1a0b47945601ccedacdad9d69104905a760ed0a7eb67c"}
Jul 15 16:49:20.537795 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:20.537694    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:49:20.555626 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:20.555577    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll" podStartSLOduration=1.7702098689999999 podStartE2EDuration="7.555555303s" totalImagesPullingTime="5.785345434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:20.554764381 +0000 UTC m=+556.649702639" watchObservedRunningTime="2026-07-15 16:49:20.555555303 +0000 UTC m=+556.650493549"
Jul 15 16:49:21.490551 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:21.490519    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8rfw9"
Jul 15 16:49:21.493655 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:21.493636    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vn8m9"
Jul 15 16:49:48.531726 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:48.531694    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lpx5x"
Jul 15 16:49:51.544369 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:49:51.544338    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8hbll"
Jul 15 16:50:04.245276 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.245211    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj9k"]
Jul 15 16:50:04.245777 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.245638    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" containerName="discovery"
Jul 15 16:50:04.245777 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.245656    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" containerName="discovery"
Jul 15 16:50:04.245777 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.245723    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a68db586-c4fb-42dc-ad96-d4469f1f4e14" containerName="discovery"
Jul 15 16:50:04.248507 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.248490    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k"
Jul 15 16:50:04.251628 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.251599    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w299t\""
Jul 15 16:50:04.252130 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.252108    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 16:50:04.252317 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.252300    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 16:50:04.272220 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.272191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj9k"]
Jul 15 16:50:04.295258 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.295226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcb92\" (UniqueName: \"kubernetes.io/projected/20e7389a-b51c-4fa7-9681-7b6435866b22-kube-api-access-zcb92\") pod \"kuadrant-operator-catalog-qhj9k\" (UID: \"20e7389a-b51c-4fa7-9681-7b6435866b22\") " pod="kuadrant-system/kuadrant-operator-catalog-qhj9k"
Jul 15 16:50:04.369222 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.369202    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:50:04.370045 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.369996    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:50:04.395592 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.395554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcb92\" (UniqueName: \"kubernetes.io/projected/20e7389a-b51c-4fa7-9681-7b6435866b22-kube-api-access-zcb92\") pod \"kuadrant-operator-catalog-qhj9k\" (UID: \"20e7389a-b51c-4fa7-9681-7b6435866b22\") " pod="kuadrant-system/kuadrant-operator-catalog-qhj9k"
Jul 15 16:50:04.418268 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.418240    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 16:50:04.428918 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.428895    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 16:50:04.439263 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.439227    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcb92\" (UniqueName: \"kubernetes.io/projected/20e7389a-b51c-4fa7-9681-7b6435866b22-kube-api-access-zcb92\") pod \"kuadrant-operator-catalog-qhj9k\" (UID: \"20e7389a-b51c-4fa7-9681-7b6435866b22\") " pod="kuadrant-system/kuadrant-operator-catalog-qhj9k"
Jul 15 16:50:04.559407 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.559304    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w299t\""
Jul 15 16:50:04.567410 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.567394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k"
Jul 15 16:50:04.615480 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.615072    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj9k"]
Jul 15 16:50:04.693975 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.693948    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj9k"]
Jul 15 16:50:04.696698 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:04.696673    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e7389a_b51c_4fa7_9681_7b6435866b22.slice/crio-a6a7078a576e83d5c5466090e55ad086213378ee983208b54b68c03f06ef164a WatchSource:0}: Error finding container a6a7078a576e83d5c5466090e55ad086213378ee983208b54b68c03f06ef164a: Status 404 returned error can't find the container with id a6a7078a576e83d5c5466090e55ad086213378ee983208b54b68c03f06ef164a
Jul 15 16:50:04.722271 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.722234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k" event={"ID":"20e7389a-b51c-4fa7-9681-7b6435866b22","Type":"ContainerStarted","Data":"a6a7078a576e83d5c5466090e55ad086213378ee983208b54b68c03f06ef164a"}
Jul 15 16:50:04.824683 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.824598    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2fc82"]
Jul 15 16:50:04.828759 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.828737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:04.835990 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.835964    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2fc82"]
Jul 15 16:50:04.899913 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:04.899879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlk5c\" (UniqueName: \"kubernetes.io/projected/dd7e8f74-e000-41c3-9873-d8eb06dd432d-kube-api-access-dlk5c\") pod \"kuadrant-operator-catalog-2fc82\" (UID: \"dd7e8f74-e000-41c3-9873-d8eb06dd432d\") " pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:05.000438 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:05.000401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk5c\" (UniqueName: \"kubernetes.io/projected/dd7e8f74-e000-41c3-9873-d8eb06dd432d-kube-api-access-dlk5c\") pod \"kuadrant-operator-catalog-2fc82\" (UID: \"dd7e8f74-e000-41c3-9873-d8eb06dd432d\") " pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:05.009191 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:05.009165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlk5c\" (UniqueName: \"kubernetes.io/projected/dd7e8f74-e000-41c3-9873-d8eb06dd432d-kube-api-access-dlk5c\") pod \"kuadrant-operator-catalog-2fc82\" (UID: \"dd7e8f74-e000-41c3-9873-d8eb06dd432d\") " pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:05.138299 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:05.138215    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:05.265310 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:05.265284    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2fc82"]
Jul 15 16:50:05.267532 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:05.267506    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7e8f74_e000_41c3_9873_d8eb06dd432d.slice/crio-b5ea8f39f8e8ec8b304667eb7edf2ac9574a264a45de6b2ff455cbe0d9348695 WatchSource:0}: Error finding container b5ea8f39f8e8ec8b304667eb7edf2ac9574a264a45de6b2ff455cbe0d9348695: Status 404 returned error can't find the container with id b5ea8f39f8e8ec8b304667eb7edf2ac9574a264a45de6b2ff455cbe0d9348695
Jul 15 16:50:05.727916 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:05.727883    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2fc82" event={"ID":"dd7e8f74-e000-41c3-9873-d8eb06dd432d","Type":"ContainerStarted","Data":"b5ea8f39f8e8ec8b304667eb7edf2ac9574a264a45de6b2ff455cbe0d9348695"}
Jul 15 16:50:07.742121 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:07.742083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k" event={"ID":"20e7389a-b51c-4fa7-9681-7b6435866b22","Type":"ContainerStarted","Data":"778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3"}
Jul 15 16:50:07.742587 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:07.742172    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k" podUID="20e7389a-b51c-4fa7-9681-7b6435866b22" containerName="registry-server" containerID="cri-o://778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3" gracePeriod=2
Jul 15 16:50:07.743651 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:07.743630    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2fc82" event={"ID":"dd7e8f74-e000-41c3-9873-d8eb06dd432d","Type":"ContainerStarted","Data":"fd47df6ce66df70cac13523f1fef660c578e2a54339fdd46cee6e60240978613"}
Jul 15 16:50:07.758048 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:07.758005    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k" podStartSLOduration=1.212532072 podStartE2EDuration="3.757990253s" totalImagesPullingTime="2.545458181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:07.756824573 +0000 UTC m=+603.851762819" watchObservedRunningTime="2026-07-15 16:50:07.757990253 +0000 UTC m=+603.852928498"
Jul 15 16:50:07.773246 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:07.773200    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2fc82" podStartSLOduration=1.7950848700000002 podStartE2EDuration="3.773182995s" totalImagesPullingTime="1.978098125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:07.772860872 +0000 UTC m=+603.867799117" watchObservedRunningTime="2026-07-15 16:50:07.773182995 +0000 UTC m=+603.868121241"
Jul 15 16:50:07.980012 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:07.979985    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k"
Jul 15 16:50:08.022592 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.022570    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcb92\" (UniqueName: \"kubernetes.io/projected/20e7389a-b51c-4fa7-9681-7b6435866b22-kube-api-access-zcb92\") pod \"20e7389a-b51c-4fa7-9681-7b6435866b22\" (UID: \"20e7389a-b51c-4fa7-9681-7b6435866b22\") "
Jul 15 16:50:08.024640 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.024616    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e7389a-b51c-4fa7-9681-7b6435866b22-kube-api-access-zcb92" (OuterVolumeSpecName: "kube-api-access-zcb92") pod "20e7389a-b51c-4fa7-9681-7b6435866b22" (UID: "20e7389a-b51c-4fa7-9681-7b6435866b22"). InnerVolumeSpecName "kube-api-access-zcb92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:50:08.123775 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.123742    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcb92\" (UniqueName: \"kubernetes.io/projected/20e7389a-b51c-4fa7-9681-7b6435866b22-kube-api-access-zcb92\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:08.748483 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.748451    2567 generic.go:356] "Generic (PLEG): container finished" podID="20e7389a-b51c-4fa7-9681-7b6435866b22" containerID="778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3" exitCode=0
Jul 15 16:50:08.748905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.748494    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k"
Jul 15 16:50:08.748905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.748536    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k" event={"ID":"20e7389a-b51c-4fa7-9681-7b6435866b22","Type":"ContainerDied","Data":"778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3"}
Jul 15 16:50:08.748905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.748588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qhj9k" event={"ID":"20e7389a-b51c-4fa7-9681-7b6435866b22","Type":"ContainerDied","Data":"a6a7078a576e83d5c5466090e55ad086213378ee983208b54b68c03f06ef164a"}
Jul 15 16:50:08.748905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.748613    2567 scope.go:117] "RemoveContainer" containerID="778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3"
Jul 15 16:50:08.759643 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.759625    2567 scope.go:117] "RemoveContainer" containerID="778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3"
Jul 15 16:50:08.759920 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:50:08.759899    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3\": container with ID starting with 778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3 not found: ID does not exist" containerID="778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3"
Jul 15 16:50:08.759966 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.759930    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3"} err="failed to get container status \"778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3\": rpc error: code = NotFound desc = could not find container \"778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3\": container with ID starting with 778b997e26c31b369b3ada078f730e167a1f2de24217f2ca091a138c078b35b3 not found: ID does not exist"
Jul 15 16:50:08.763086 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.763065    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj9k"]
Jul 15 16:50:08.766528 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:08.766508    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qhj9k"]
Jul 15 16:50:10.511883 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:10.511846    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e7389a-b51c-4fa7-9681-7b6435866b22" path="/var/lib/kubelet/pods/20e7389a-b51c-4fa7-9681-7b6435866b22/volumes"
Jul 15 16:50:15.138414 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:15.138354    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:15.138858 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:15.138440    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:15.160619 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:15.160592    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:15.799561 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:15.799534    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2fc82"
Jul 15 16:50:19.628100 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.628068    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"]
Jul 15 16:50:19.628478 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.628386    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e7389a-b51c-4fa7-9681-7b6435866b22" containerName="registry-server"
Jul 15 16:50:19.628478 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.628398    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e7389a-b51c-4fa7-9681-7b6435866b22" containerName="registry-server"
Jul 15 16:50:19.628478 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.628459    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e7389a-b51c-4fa7-9681-7b6435866b22" containerName="registry-server"
Jul 15 16:50:19.632817 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.632791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.635287 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.635259    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qdk7w\""
Jul 15 16:50:19.639702 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.639669    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"]
Jul 15 16:50:19.702314 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.702280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.702482 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.702333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.702482 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.702355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlbk5\" (UniqueName: \"kubernetes.io/projected/16810751-82c8-4124-8fad-978437de5355-kube-api-access-dlbk5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.803404 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.803373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.803561 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.803409    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlbk5\" (UniqueName: \"kubernetes.io/projected/16810751-82c8-4124-8fad-978437de5355-kube-api-access-dlbk5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.803561 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.803461    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.803842 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.803827    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.803893 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.803875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.811426 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.811400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlbk5\" (UniqueName: \"kubernetes.io/projected/16810751-82c8-4124-8fad-978437de5355-kube-api-access-dlbk5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:19.943612 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:19.943528    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:20.070635 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.070610    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"]
Jul 15 16:50:20.072750 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:20.072725    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16810751_82c8_4124_8fad_978437de5355.slice/crio-a5758e76a17fb4d1b3ae1465cddb8b3f2899e288a154fbc385f586afd09d8426 WatchSource:0}: Error finding container a5758e76a17fb4d1b3ae1465cddb8b3f2899e288a154fbc385f586afd09d8426: Status 404 returned error can't find the container with id a5758e76a17fb4d1b3ae1465cddb8b3f2899e288a154fbc385f586afd09d8426
Jul 15 16:50:20.229270 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.229184    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"]
Jul 15 16:50:20.232406 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.232392    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.240763 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.240741    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"]
Jul 15 16:50:20.308240 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.308207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.308383 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.308255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxv48\" (UniqueName: \"kubernetes.io/projected/030c32be-f1df-4d0e-ac61-0672cccb93fc-kube-api-access-zxv48\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.308383 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.308322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.408655 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.408616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxv48\" (UniqueName: \"kubernetes.io/projected/030c32be-f1df-4d0e-ac61-0672cccb93fc-kube-api-access-zxv48\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.408759 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.408673    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.408759 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.408706    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.409023 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.409009    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.409105 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.409089    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.417289 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.417261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxv48\" (UniqueName: \"kubernetes.io/projected/030c32be-f1df-4d0e-ac61-0672cccb93fc-kube-api-access-zxv48\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.541946 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.541905    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:20.669991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.669966    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"]
Jul 15 16:50:20.672201 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:20.672179    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030c32be_f1df_4d0e_ac61_0672cccb93fc.slice/crio-28b9bd2c1482340f4635dc7b0efc9c946a69dc59d9b3dd83979a388ce5e1a4d9 WatchSource:0}: Error finding container 28b9bd2c1482340f4635dc7b0efc9c946a69dc59d9b3dd83979a388ce5e1a4d9: Status 404 returned error can't find the container with id 28b9bd2c1482340f4635dc7b0efc9c946a69dc59d9b3dd83979a388ce5e1a4d9
Jul 15 16:50:20.799194 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.799103    2567 generic.go:356] "Generic (PLEG): container finished" podID="16810751-82c8-4124-8fad-978437de5355" containerID="f5512c71749cf3849294b2870991985ca110056290cf4d08fe319a5812daea59" exitCode=0
Jul 15 16:50:20.799344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.799194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r" event={"ID":"16810751-82c8-4124-8fad-978437de5355","Type":"ContainerDied","Data":"f5512c71749cf3849294b2870991985ca110056290cf4d08fe319a5812daea59"}
Jul 15 16:50:20.799344 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.799248    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r" event={"ID":"16810751-82c8-4124-8fad-978437de5355","Type":"ContainerStarted","Data":"a5758e76a17fb4d1b3ae1465cddb8b3f2899e288a154fbc385f586afd09d8426"}
Jul 15 16:50:20.800804 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.800776    2567 generic.go:356] "Generic (PLEG): container finished" podID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerID="2c88cdc07e335f99c5947fc5dfb312a08707ef4c1fb870b3e47924ce3439c23b" exitCode=0
Jul 15 16:50:20.800939 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.800823    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs" event={"ID":"030c32be-f1df-4d0e-ac61-0672cccb93fc","Type":"ContainerDied","Data":"2c88cdc07e335f99c5947fc5dfb312a08707ef4c1fb870b3e47924ce3439c23b"}
Jul 15 16:50:20.800939 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.800857    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs" event={"ID":"030c32be-f1df-4d0e-ac61-0672cccb93fc","Type":"ContainerStarted","Data":"28b9bd2c1482340f4635dc7b0efc9c946a69dc59d9b3dd83979a388ce5e1a4d9"}
Jul 15 16:50:20.829553 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.829527    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"]
Jul 15 16:50:20.832991 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.832971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:20.842214 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.842192    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"]
Jul 15 16:50:20.912116 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.912082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:20.912289 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.912184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:20.912289 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:20.912229    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfg4w\" (UniqueName: \"kubernetes.io/projected/0e32799b-129a-45d3-94e2-83da83fa3318-kube-api-access-wfg4w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.012992 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.012948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.013193 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.013022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.013193 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.013053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfg4w\" (UniqueName: \"kubernetes.io/projected/0e32799b-129a-45d3-94e2-83da83fa3318-kube-api-access-wfg4w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.013378 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.013359    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.013415 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.013394    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.021012 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.020988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfg4w\" (UniqueName: \"kubernetes.io/projected/0e32799b-129a-45d3-94e2-83da83fa3318-kube-api-access-wfg4w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.144367 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.144274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:21.230738 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.230706    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"]
Jul 15 16:50:21.235637 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.235608    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.241956 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.241903    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"]
Jul 15 16:50:21.273683 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.273661    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"]
Jul 15 16:50:21.275893 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:21.275872    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e32799b_129a_45d3_94e2_83da83fa3318.slice/crio-997bc1ebfd50e6f7e15dee10cc39fbb9da937c4f9a4364862fa9f5fde2842e5f WatchSource:0}: Error finding container 997bc1ebfd50e6f7e15dee10cc39fbb9da937c4f9a4364862fa9f5fde2842e5f: Status 404 returned error can't find the container with id 997bc1ebfd50e6f7e15dee10cc39fbb9da937c4f9a4364862fa9f5fde2842e5f
Jul 15 16:50:21.314763 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.314735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.314883 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.314820    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.314883 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.314853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwt92\" (UniqueName: \"kubernetes.io/projected/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-kube-api-access-qwt92\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.415671 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.415594    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.415671 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.415634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwt92\" (UniqueName: \"kubernetes.io/projected/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-kube-api-access-qwt92\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.415845 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.415680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.416049 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.416034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.416085 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.416038    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.427515 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.425697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwt92\" (UniqueName: \"kubernetes.io/projected/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-kube-api-access-qwt92\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.547783 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.547752    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:21.713796 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.713764    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"]
Jul 15 16:50:21.764743 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:21.764712    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9635722_bfcd_4b7e_aefa_c95879a2e9f7.slice/crio-1c9bfc1fd4daa133815dac8dd07aee468e4e39271006633cafcee2394b689a86 WatchSource:0}: Error finding container 1c9bfc1fd4daa133815dac8dd07aee468e4e39271006633cafcee2394b689a86: Status 404 returned error can't find the container with id 1c9bfc1fd4daa133815dac8dd07aee468e4e39271006633cafcee2394b689a86
Jul 15 16:50:21.807067 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.807033    2567 generic.go:356] "Generic (PLEG): container finished" podID="0e32799b-129a-45d3-94e2-83da83fa3318" containerID="cb4487f99386179aa6c60c28d32bc2f173a73f7d2713edd1b7db69f8e0cd472a" exitCode=0
Jul 15 16:50:21.807253 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.807146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh" event={"ID":"0e32799b-129a-45d3-94e2-83da83fa3318","Type":"ContainerDied","Data":"cb4487f99386179aa6c60c28d32bc2f173a73f7d2713edd1b7db69f8e0cd472a"}
Jul 15 16:50:21.807253 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.807205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh" event={"ID":"0e32799b-129a-45d3-94e2-83da83fa3318","Type":"ContainerStarted","Data":"997bc1ebfd50e6f7e15dee10cc39fbb9da937c4f9a4364862fa9f5fde2842e5f"}
Jul 15 16:50:21.808957 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.808935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs" event={"ID":"e9635722-bfcd-4b7e-aefa-c95879a2e9f7","Type":"ContainerStarted","Data":"1c9bfc1fd4daa133815dac8dd07aee468e4e39271006633cafcee2394b689a86"}
Jul 15 16:50:21.810938 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.810917    2567 generic.go:356] "Generic (PLEG): container finished" podID="16810751-82c8-4124-8fad-978437de5355" containerID="fc634e3d3e79293b46b1df1d5f29ecbec2a3dcb76782ae81ea0315e6ea242cd7" exitCode=0
Jul 15 16:50:21.811047 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:21.810949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r" event={"ID":"16810751-82c8-4124-8fad-978437de5355","Type":"ContainerDied","Data":"fc634e3d3e79293b46b1df1d5f29ecbec2a3dcb76782ae81ea0315e6ea242cd7"}
Jul 15 16:50:22.818251 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:22.818221    2567 generic.go:356] "Generic (PLEG): container finished" podID="16810751-82c8-4124-8fad-978437de5355" containerID="2f7b00c12eecfb1ab95af99a9aed92be11460a6fd96e8fcc36885766bb2f5c37" exitCode=0
Jul 15 16:50:22.818610 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:22.818297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r" event={"ID":"16810751-82c8-4124-8fad-978437de5355","Type":"ContainerDied","Data":"2f7b00c12eecfb1ab95af99a9aed92be11460a6fd96e8fcc36885766bb2f5c37"}
Jul 15 16:50:22.820046 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:22.820027    2567 generic.go:356] "Generic (PLEG): container finished" podID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerID="6f75032ae1630da767cb283ae16a9104d286e2222d5ac2fe05aca4bb194a2bd2" exitCode=0
Jul 15 16:50:22.820202 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:22.820114    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs" event={"ID":"030c32be-f1df-4d0e-ac61-0672cccb93fc","Type":"ContainerDied","Data":"6f75032ae1630da767cb283ae16a9104d286e2222d5ac2fe05aca4bb194a2bd2"}
Jul 15 16:50:22.821593 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:22.821576    2567 generic.go:356] "Generic (PLEG): container finished" podID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerID="f2f0634859f83aa280acf0a4efe7d76e4fd054c65925c44fb69b7a4260fb57fc" exitCode=0
Jul 15 16:50:22.821641 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:22.821608    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs" event={"ID":"e9635722-bfcd-4b7e-aefa-c95879a2e9f7","Type":"ContainerDied","Data":"f2f0634859f83aa280acf0a4efe7d76e4fd054c65925c44fb69b7a4260fb57fc"}
Jul 15 16:50:23.833419 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:23.833387    2567 generic.go:356] "Generic (PLEG): container finished" podID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerID="9d4639a58bed8df30e6b84f750637865110023113e7fa39f8ad142ebead44107" exitCode=0
Jul 15 16:50:23.833889 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:23.833511    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs" event={"ID":"030c32be-f1df-4d0e-ac61-0672cccb93fc","Type":"ContainerDied","Data":"9d4639a58bed8df30e6b84f750637865110023113e7fa39f8ad142ebead44107"}
Jul 15 16:50:23.835104 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:23.835078    2567 generic.go:356] "Generic (PLEG): container finished" podID="0e32799b-129a-45d3-94e2-83da83fa3318" containerID="c6ee1173ba9aabf054c78482e78c156b05e9ce2634c20633cf907615d9eccf4a" exitCode=0
Jul 15 16:50:23.835231 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:23.835176    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh" event={"ID":"0e32799b-129a-45d3-94e2-83da83fa3318","Type":"ContainerDied","Data":"c6ee1173ba9aabf054c78482e78c156b05e9ce2634c20633cf907615d9eccf4a"}
Jul 15 16:50:23.965832 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:23.965806    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:24.033972 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.033945    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlbk5\" (UniqueName: \"kubernetes.io/projected/16810751-82c8-4124-8fad-978437de5355-kube-api-access-dlbk5\") pod \"16810751-82c8-4124-8fad-978437de5355\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") "
Jul 15 16:50:24.034110 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.033984    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-bundle\") pod \"16810751-82c8-4124-8fad-978437de5355\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") "
Jul 15 16:50:24.034110 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.034011    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-util\") pod \"16810751-82c8-4124-8fad-978437de5355\" (UID: \"16810751-82c8-4124-8fad-978437de5355\") "
Jul 15 16:50:24.034522 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.034497    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-bundle" (OuterVolumeSpecName: "bundle") pod "16810751-82c8-4124-8fad-978437de5355" (UID: "16810751-82c8-4124-8fad-978437de5355"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:24.035964 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.035944    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16810751-82c8-4124-8fad-978437de5355-kube-api-access-dlbk5" (OuterVolumeSpecName: "kube-api-access-dlbk5") pod "16810751-82c8-4124-8fad-978437de5355" (UID: "16810751-82c8-4124-8fad-978437de5355"). InnerVolumeSpecName "kube-api-access-dlbk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:50:24.039477 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.039455    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-util" (OuterVolumeSpecName: "util") pod "16810751-82c8-4124-8fad-978437de5355" (UID: "16810751-82c8-4124-8fad-978437de5355"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:24.134571 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.134474    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-bundle\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:24.134571 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.134516    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16810751-82c8-4124-8fad-978437de5355-util\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:24.134571 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.134528    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlbk5\" (UniqueName: \"kubernetes.io/projected/16810751-82c8-4124-8fad-978437de5355-kube-api-access-dlbk5\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:24.841399 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.841360    2567 generic.go:356] "Generic (PLEG): container finished" podID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerID="05e433741d012fec802a8b5fef7c8a2f3c3afd47335ecd2457af4d64974307a0" exitCode=0
Jul 15 16:50:24.841830 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.841451    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs" event={"ID":"e9635722-bfcd-4b7e-aefa-c95879a2e9f7","Type":"ContainerDied","Data":"05e433741d012fec802a8b5fef7c8a2f3c3afd47335ecd2457af4d64974307a0"}
Jul 15 16:50:24.843334 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.843310    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r"
Jul 15 16:50:24.843428 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.843344    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r" event={"ID":"16810751-82c8-4124-8fad-978437de5355","Type":"ContainerDied","Data":"a5758e76a17fb4d1b3ae1465cddb8b3f2899e288a154fbc385f586afd09d8426"}
Jul 15 16:50:24.843428 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.843382    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5758e76a17fb4d1b3ae1465cddb8b3f2899e288a154fbc385f586afd09d8426"
Jul 15 16:50:24.845542 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.845518    2567 generic.go:356] "Generic (PLEG): container finished" podID="0e32799b-129a-45d3-94e2-83da83fa3318" containerID="3b22c7b066aa686fb803f704d456589a929aecb0b7070588cacdb7b6e2e5f0cf" exitCode=0
Jul 15 16:50:24.845642 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.845614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh" event={"ID":"0e32799b-129a-45d3-94e2-83da83fa3318","Type":"ContainerDied","Data":"3b22c7b066aa686fb803f704d456589a929aecb0b7070588cacdb7b6e2e5f0cf"}
Jul 15 16:50:24.972252 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:24.972221    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:25.041902 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.041871    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxv48\" (UniqueName: \"kubernetes.io/projected/030c32be-f1df-4d0e-ac61-0672cccb93fc-kube-api-access-zxv48\") pod \"030c32be-f1df-4d0e-ac61-0672cccb93fc\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") "
Jul 15 16:50:25.042039 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.041916    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-bundle\") pod \"030c32be-f1df-4d0e-ac61-0672cccb93fc\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") "
Jul 15 16:50:25.042039 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.041958    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-util\") pod \"030c32be-f1df-4d0e-ac61-0672cccb93fc\" (UID: \"030c32be-f1df-4d0e-ac61-0672cccb93fc\") "
Jul 15 16:50:25.042434 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.042410    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-bundle" (OuterVolumeSpecName: "bundle") pod "030c32be-f1df-4d0e-ac61-0672cccb93fc" (UID: "030c32be-f1df-4d0e-ac61-0672cccb93fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:25.044004 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.043981    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/030c32be-f1df-4d0e-ac61-0672cccb93fc-kube-api-access-zxv48" (OuterVolumeSpecName: "kube-api-access-zxv48") pod "030c32be-f1df-4d0e-ac61-0672cccb93fc" (UID: "030c32be-f1df-4d0e-ac61-0672cccb93fc"). InnerVolumeSpecName "kube-api-access-zxv48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:50:25.047624 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.047600    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-util" (OuterVolumeSpecName: "util") pod "030c32be-f1df-4d0e-ac61-0672cccb93fc" (UID: "030c32be-f1df-4d0e-ac61-0672cccb93fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:25.142526 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.142455    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-util\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:25.142526 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.142480    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxv48\" (UniqueName: \"kubernetes.io/projected/030c32be-f1df-4d0e-ac61-0672cccb93fc-kube-api-access-zxv48\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:25.142526 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.142490    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/030c32be-f1df-4d0e-ac61-0672cccb93fc-bundle\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:25.851832 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.851798    2567 generic.go:356] "Generic (PLEG): container finished" podID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerID="0d667e80a778be1e0b343ee915c5ebd5632fbfb1733ff8dfcb589c590cb1c178" exitCode=0
Jul 15 16:50:25.852281 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.851879    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs" event={"ID":"e9635722-bfcd-4b7e-aefa-c95879a2e9f7","Type":"ContainerDied","Data":"0d667e80a778be1e0b343ee915c5ebd5632fbfb1733ff8dfcb589c590cb1c178"}
Jul 15 16:50:25.853672 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.853644    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs" event={"ID":"030c32be-f1df-4d0e-ac61-0672cccb93fc","Type":"ContainerDied","Data":"28b9bd2c1482340f4635dc7b0efc9c946a69dc59d9b3dd83979a388ce5e1a4d9"}
Jul 15 16:50:25.853788 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.853682    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs"
Jul 15 16:50:25.853788 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.853688    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28b9bd2c1482340f4635dc7b0efc9c946a69dc59d9b3dd83979a388ce5e1a4d9"
Jul 15 16:50:25.989717 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:25.989690    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:26.051832 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.051799    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-bundle\") pod \"0e32799b-129a-45d3-94e2-83da83fa3318\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") "
Jul 15 16:50:26.051995 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.051846    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-util\") pod \"0e32799b-129a-45d3-94e2-83da83fa3318\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") "
Jul 15 16:50:26.051995 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.051878    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfg4w\" (UniqueName: \"kubernetes.io/projected/0e32799b-129a-45d3-94e2-83da83fa3318-kube-api-access-wfg4w\") pod \"0e32799b-129a-45d3-94e2-83da83fa3318\" (UID: \"0e32799b-129a-45d3-94e2-83da83fa3318\") "
Jul 15 16:50:26.052501 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.052472    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-bundle" (OuterVolumeSpecName: "bundle") pod "0e32799b-129a-45d3-94e2-83da83fa3318" (UID: "0e32799b-129a-45d3-94e2-83da83fa3318"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:26.054003 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.053977    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e32799b-129a-45d3-94e2-83da83fa3318-kube-api-access-wfg4w" (OuterVolumeSpecName: "kube-api-access-wfg4w") pod "0e32799b-129a-45d3-94e2-83da83fa3318" (UID: "0e32799b-129a-45d3-94e2-83da83fa3318"). InnerVolumeSpecName "kube-api-access-wfg4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:50:26.057254 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.057235    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-util" (OuterVolumeSpecName: "util") pod "0e32799b-129a-45d3-94e2-83da83fa3318" (UID: "0e32799b-129a-45d3-94e2-83da83fa3318"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:26.152898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.152816    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-bundle\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:26.152898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.152846    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e32799b-129a-45d3-94e2-83da83fa3318-util\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:26.152898 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.152855    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfg4w\" (UniqueName: \"kubernetes.io/projected/0e32799b-129a-45d3-94e2-83da83fa3318-kube-api-access-wfg4w\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:26.864901 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.864818    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh"
Jul 15 16:50:26.864901 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.864652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh" event={"ID":"0e32799b-129a-45d3-94e2-83da83fa3318","Type":"ContainerDied","Data":"997bc1ebfd50e6f7e15dee10cc39fbb9da937c4f9a4364862fa9f5fde2842e5f"}
Jul 15 16:50:26.865316 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.865066    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="997bc1ebfd50e6f7e15dee10cc39fbb9da937c4f9a4364862fa9f5fde2842e5f"
Jul 15 16:50:26.996737 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:26.996713    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:27.059049 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.059014    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-bundle\") pod \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") "
Jul 15 16:50:27.059049 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.059053    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-util\") pod \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") "
Jul 15 16:50:27.059275 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.059090    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwt92\" (UniqueName: \"kubernetes.io/projected/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-kube-api-access-qwt92\") pod \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\" (UID: \"e9635722-bfcd-4b7e-aefa-c95879a2e9f7\") "
Jul 15 16:50:27.059590 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.059552    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-bundle" (OuterVolumeSpecName: "bundle") pod "e9635722-bfcd-4b7e-aefa-c95879a2e9f7" (UID: "e9635722-bfcd-4b7e-aefa-c95879a2e9f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:27.061209 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.061186    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-kube-api-access-qwt92" (OuterVolumeSpecName: "kube-api-access-qwt92") pod "e9635722-bfcd-4b7e-aefa-c95879a2e9f7" (UID: "e9635722-bfcd-4b7e-aefa-c95879a2e9f7"). InnerVolumeSpecName "kube-api-access-qwt92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:50:27.067012 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.066973    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-util" (OuterVolumeSpecName: "util") pod "e9635722-bfcd-4b7e-aefa-c95879a2e9f7" (UID: "e9635722-bfcd-4b7e-aefa-c95879a2e9f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:50:27.160314 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.160228    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-bundle\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:27.160314 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.160261    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-util\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:27.160314 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.160271    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwt92\" (UniqueName: \"kubernetes.io/projected/e9635722-bfcd-4b7e-aefa-c95879a2e9f7-kube-api-access-qwt92\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:50:27.870633 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.870603    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs"
Jul 15 16:50:27.870633 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.870623    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs" event={"ID":"e9635722-bfcd-4b7e-aefa-c95879a2e9f7","Type":"ContainerDied","Data":"1c9bfc1fd4daa133815dac8dd07aee468e4e39271006633cafcee2394b689a86"}
Jul 15 16:50:27.871086 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:27.870672    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c9bfc1fd4daa133815dac8dd07aee468e4e39271006633cafcee2394b689a86"
Jul 15 16:50:36.578071 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578040    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"]
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578346    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e32799b-129a-45d3-94e2-83da83fa3318" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578357    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e32799b-129a-45d3-94e2-83da83fa3318" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578366    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578371    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578381    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16810751-82c8-4124-8fad-978437de5355" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578386    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="16810751-82c8-4124-8fad-978437de5355" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578393    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerName="pull"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578397    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerName="pull"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578404    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e32799b-129a-45d3-94e2-83da83fa3318" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578409    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e32799b-129a-45d3-94e2-83da83fa3318" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578416    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e32799b-129a-45d3-94e2-83da83fa3318" containerName="pull"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578420    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e32799b-129a-45d3-94e2-83da83fa3318" containerName="pull"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578426    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578431    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578443    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16810751-82c8-4124-8fad-978437de5355" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578447    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="16810751-82c8-4124-8fad-978437de5355" containerName="extract"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578456    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16810751-82c8-4124-8fad-978437de5355" containerName="pull"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578461    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="16810751-82c8-4124-8fad-978437de5355" containerName="pull"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578469    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578478    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578484    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578489    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerName="util"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578494    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerName="pull"
Jul 15 16:50:36.578533 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578499    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerName="pull"
Jul 15 16:50:36.579244 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578555    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e32799b-129a-45d3-94e2-83da83fa3318" containerName="extract"
Jul 15 16:50:36.579244 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578562    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9635722-bfcd-4b7e-aefa-c95879a2e9f7" containerName="extract"
Jul 15 16:50:36.579244 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578570    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="030c32be-f1df-4d0e-ac61-0672cccb93fc" containerName="extract"
Jul 15 16:50:36.579244 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.578576    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="16810751-82c8-4124-8fad-978437de5355" containerName="extract"
Jul 15 16:50:36.584364 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.584347    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"
Jul 15 16:50:36.586727 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.586706    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6l7kx\""
Jul 15 16:50:36.594490 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.594468    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"]
Jul 15 16:50:36.626526 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.626492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz58q\" (UniqueName: \"kubernetes.io/projected/0ff688ae-27e4-480e-ad08-ad2be4f38f67-kube-api-access-hz58q\") pod \"authorino-operator-75cc8d5cb7-kxdk7\" (UID: \"0ff688ae-27e4-480e-ad08-ad2be4f38f67\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"
Jul 15 16:50:36.726895 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.726860    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz58q\" (UniqueName: \"kubernetes.io/projected/0ff688ae-27e4-480e-ad08-ad2be4f38f67-kube-api-access-hz58q\") pod \"authorino-operator-75cc8d5cb7-kxdk7\" (UID: \"0ff688ae-27e4-480e-ad08-ad2be4f38f67\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"
Jul 15 16:50:36.734764 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.734740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz58q\" (UniqueName: \"kubernetes.io/projected/0ff688ae-27e4-480e-ad08-ad2be4f38f67-kube-api-access-hz58q\") pod \"authorino-operator-75cc8d5cb7-kxdk7\" (UID: \"0ff688ae-27e4-480e-ad08-ad2be4f38f67\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"
Jul 15 16:50:36.894803 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:36.894716    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"
Jul 15 16:50:37.026227 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:37.026206    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"]
Jul 15 16:50:37.028402 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:37.028376    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff688ae_27e4_480e_ad08_ad2be4f38f67.slice/crio-16b167a5e5ff3e44325311a39f1de81face7a1af2b20bc1db6cf3a05f021fa7d WatchSource:0}: Error finding container 16b167a5e5ff3e44325311a39f1de81face7a1af2b20bc1db6cf3a05f021fa7d: Status 404 returned error can't find the container with id 16b167a5e5ff3e44325311a39f1de81face7a1af2b20bc1db6cf3a05f021fa7d
Jul 15 16:50:37.918232 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:37.918190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7" event={"ID":"0ff688ae-27e4-480e-ad08-ad2be4f38f67","Type":"ContainerStarted","Data":"16b167a5e5ff3e44325311a39f1de81face7a1af2b20bc1db6cf3a05f021fa7d"}
Jul 15 16:50:39.740329 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.740298    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"]
Jul 15 16:50:39.743735 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.743712    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:50:39.746106 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.746086    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-94qm5\""
Jul 15 16:50:39.753122 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.753101    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"]
Jul 15 16:50:39.855808 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.855774    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6f9s\" (UniqueName: \"kubernetes.io/projected/b09dc6c8-71d8-41d1-8e52-240c5809b53a-kube-api-access-x6f9s\") pod \"limitador-operator-controller-manager-859d7b78bd-snvsh\" (UID: \"b09dc6c8-71d8-41d1-8e52-240c5809b53a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:50:39.928792 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.928752    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7" event={"ID":"0ff688ae-27e4-480e-ad08-ad2be4f38f67","Type":"ContainerStarted","Data":"349ef1b97ba24559232383f40ad07e4d8e51dbcae0c68bd291ae0332198fe7d4"}
Jul 15 16:50:39.928963 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.928897    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"
Jul 15 16:50:39.956462 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.956425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6f9s\" (UniqueName: \"kubernetes.io/projected/b09dc6c8-71d8-41d1-8e52-240c5809b53a-kube-api-access-x6f9s\") pod \"limitador-operator-controller-manager-859d7b78bd-snvsh\" (UID: \"b09dc6c8-71d8-41d1-8e52-240c5809b53a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:50:39.957757 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.957716    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7" podStartSLOduration=1.797087798 podStartE2EDuration="3.957701515s" totalImagesPullingTime="2.160613717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:39.956705663 +0000 UTC m=+636.051643908" watchObservedRunningTime="2026-07-15 16:50:39.957701515 +0000 UTC m=+636.052639760"
Jul 15 16:50:39.968185 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:39.968148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6f9s\" (UniqueName: \"kubernetes.io/projected/b09dc6c8-71d8-41d1-8e52-240c5809b53a-kube-api-access-x6f9s\") pod \"limitador-operator-controller-manager-859d7b78bd-snvsh\" (UID: \"b09dc6c8-71d8-41d1-8e52-240c5809b53a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:50:40.053863 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:40.053831    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:50:40.196070 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:40.195872    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"]
Jul 15 16:50:40.198592 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:40.198568    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09dc6c8_71d8_41d1_8e52_240c5809b53a.slice/crio-3c1b62b581e512fd9cbc535d55dc04fe7b6484bc7bdd33b233be6a8aae45a155 WatchSource:0}: Error finding container 3c1b62b581e512fd9cbc535d55dc04fe7b6484bc7bdd33b233be6a8aae45a155: Status 404 returned error can't find the container with id 3c1b62b581e512fd9cbc535d55dc04fe7b6484bc7bdd33b233be6a8aae45a155
Jul 15 16:50:40.935057 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:40.935026    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh" event={"ID":"b09dc6c8-71d8-41d1-8e52-240c5809b53a","Type":"ContainerStarted","Data":"3c1b62b581e512fd9cbc535d55dc04fe7b6484bc7bdd33b233be6a8aae45a155"}
Jul 15 16:50:42.949421 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:42.949377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh" event={"ID":"b09dc6c8-71d8-41d1-8e52-240c5809b53a","Type":"ContainerStarted","Data":"0be883a1752562a3773e6e2ae63c9905a52489f8d3506544fd835a0f1105d291"}
Jul 15 16:50:42.949856 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:42.949500    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:50:42.966471 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:42.966424    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh" podStartSLOduration=2.163159491 podStartE2EDuration="3.966409347s" totalImagesPullingTime="1.803249856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:42.965657897 +0000 UTC m=+639.060596134" watchObservedRunningTime="2026-07-15 16:50:42.966409347 +0000 UTC m=+639.061347591"
Jul 15 16:50:44.597315 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.597277    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"]
Jul 15 16:50:44.600674 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.600651    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:44.603447 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.603425    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qmq6r\""
Jul 15 16:50:44.615357 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.615333    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"]
Jul 15 16:50:44.696378 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.696349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl9lh\" (UniqueName: \"kubernetes.io/projected/31652a81-08f7-4716-9d3f-4231820f7d3b-kube-api-access-xl9lh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:44.696551 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.696408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31652a81-08f7-4716-9d3f-4231820f7d3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:44.797118 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.797084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31652a81-08f7-4716-9d3f-4231820f7d3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:44.797293 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.797150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl9lh\" (UniqueName: \"kubernetes.io/projected/31652a81-08f7-4716-9d3f-4231820f7d3b-kube-api-access-xl9lh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:44.797511 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.797476    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31652a81-08f7-4716-9d3f-4231820f7d3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:44.805946 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.805920    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl9lh\" (UniqueName: \"kubernetes.io/projected/31652a81-08f7-4716-9d3f-4231820f7d3b-kube-api-access-xl9lh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:44.910089 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:44.910005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:45.040944 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:45.040912    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"]
Jul 15 16:50:45.044423 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:50:45.044393    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31652a81_08f7_4716_9d3f_4231820f7d3b.slice/crio-6bcd788879af2287cfef6c1147a61a01cfb6847ceed06981171bc12785a7a022 WatchSource:0}: Error finding container 6bcd788879af2287cfef6c1147a61a01cfb6847ceed06981171bc12785a7a022: Status 404 returned error can't find the container with id 6bcd788879af2287cfef6c1147a61a01cfb6847ceed06981171bc12785a7a022
Jul 15 16:50:45.966378 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:45.966346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k" event={"ID":"31652a81-08f7-4716-9d3f-4231820f7d3b","Type":"ContainerStarted","Data":"6bcd788879af2287cfef6c1147a61a01cfb6847ceed06981171bc12785a7a022"}
Jul 15 16:50:50.938098 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:50.938068    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kxdk7"
Jul 15 16:50:51.998886 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:51.998847    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k" event={"ID":"31652a81-08f7-4716-9d3f-4231820f7d3b","Type":"ContainerStarted","Data":"510198f2c7b35da8b757f6a608fdfcfe3d7c3f03c63f46fcd32e8f0fec09d9fc"}
Jul 15 16:50:51.999298 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:51.998988    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:50:52.018436 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:52.018391    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k" podStartSLOduration=1.983980345 podStartE2EDuration="8.01837319s" totalImagesPullingTime="6.034392845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:50:52.016748607 +0000 UTC m=+648.111686843" watchObservedRunningTime="2026-07-15 16:50:52.01837319 +0000 UTC m=+648.113311435"
Jul 15 16:50:53.956924 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:50:53.956895    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:03.006198 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:03.006139    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:04.804967 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.804929    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"]
Jul 15 16:51:04.805437 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.805109    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" containerName="manager" containerID="cri-o://510198f2c7b35da8b757f6a608fdfcfe3d7c3f03c63f46fcd32e8f0fec09d9fc" gracePeriod=2
Jul 15 16:51:04.811905 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.811865    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"]
Jul 15 16:51:04.828595 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.828553    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"]
Jul 15 16:51:04.828867 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.828792    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" containerName="manager" containerID="cri-o://0be883a1752562a3773e6e2ae63c9905a52489f8d3506544fd835a0f1105d291" gracePeriod=2
Jul 15 16:51:04.831294 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.831270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"]
Jul 15 16:51:04.831705 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.831686    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" containerName="manager"
Jul 15 16:51:04.831705 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.831707    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" containerName="manager"
Jul 15 16:51:04.831938 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.831821    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" containerName="manager"
Jul 15 16:51:04.834919 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.834859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:04.835405 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:04.835379    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:04.836636 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.836609    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"]
Jul 15 16:51:04.837304 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:04.837273    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-snvsh\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:04.838986 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:04.838953    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:04.842872 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.842773    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"]
Jul 15 16:51:04.857203 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.857176    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"]
Jul 15 16:51:04.857484 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.857470    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" containerName="manager"
Jul 15 16:51:04.857560 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.857485    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" containerName="manager"
Jul 15 16:51:04.857560 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.857539    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" containerName="manager"
Jul 15 16:51:04.860479 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.860453    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"
Jul 15 16:51:04.862552 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:04.862523    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-snvsh\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:04.864525 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:04.864500    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:04.871824 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.871782    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"]
Jul 15 16:51:04.967165 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.967119    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxpv\" (UniqueName: \"kubernetes.io/projected/181509e1-d6f0-4f61-a5ed-b40ebf52b222-kube-api-access-zfxpv\") pod \"limitador-operator-controller-manager-859d7b78bd-t4wtl\" (UID: \"181509e1-d6f0-4f61-a5ed-b40ebf52b222\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"
Jul 15 16:51:04.967312 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.967230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfbt9\" (UniqueName: \"kubernetes.io/projected/4767e37b-a9ae-4b5d-8875-34001729d462-kube-api-access-hfbt9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-svl2h\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:04.967312 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:04.967288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4767e37b-a9ae-4b5d-8875-34001729d462-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-svl2h\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:05.062907 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.062880    2567 generic.go:356] "Generic (PLEG): container finished" podID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" containerID="0be883a1752562a3773e6e2ae63c9905a52489f8d3506544fd835a0f1105d291" exitCode=0
Jul 15 16:51:05.064250 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.064224    2567 generic.go:356] "Generic (PLEG): container finished" podID="31652a81-08f7-4716-9d3f-4231820f7d3b" containerID="510198f2c7b35da8b757f6a608fdfcfe3d7c3f03c63f46fcd32e8f0fec09d9fc" exitCode=0
Jul 15 16:51:05.064338 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.064298    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bcd788879af2287cfef6c1147a61a01cfb6847ceed06981171bc12785a7a022"
Jul 15 16:51:05.068634 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.068612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfbt9\" (UniqueName: \"kubernetes.io/projected/4767e37b-a9ae-4b5d-8875-34001729d462-kube-api-access-hfbt9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-svl2h\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:05.068738 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.068662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4767e37b-a9ae-4b5d-8875-34001729d462-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-svl2h\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:05.068738 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.068709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxpv\" (UniqueName: \"kubernetes.io/projected/181509e1-d6f0-4f61-a5ed-b40ebf52b222-kube-api-access-zfxpv\") pod \"limitador-operator-controller-manager-859d7b78bd-t4wtl\" (UID: \"181509e1-d6f0-4f61-a5ed-b40ebf52b222\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"
Jul 15 16:51:05.069069 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.069049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4767e37b-a9ae-4b5d-8875-34001729d462-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-svl2h\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:05.076571 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.076544    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:05.077691 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.077670    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxpv\" (UniqueName: \"kubernetes.io/projected/181509e1-d6f0-4f61-a5ed-b40ebf52b222-kube-api-access-zfxpv\") pod \"limitador-operator-controller-manager-859d7b78bd-t4wtl\" (UID: \"181509e1-d6f0-4f61-a5ed-b40ebf52b222\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"
Jul 15 16:51:05.077774 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.077700    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfbt9\" (UniqueName: \"kubernetes.io/projected/4767e37b-a9ae-4b5d-8875-34001729d462-kube-api-access-hfbt9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-svl2h\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:05.078872 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:05.078847    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-snvsh\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:05.079599 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.079580    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:05.080922 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:05.080901    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:05.082778 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:05.082757    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-snvsh\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:05.084583 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:05.084563    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:05.169936 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.169906    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31652a81-08f7-4716-9d3f-4231820f7d3b-extensions-socket-volume\") pod \"31652a81-08f7-4716-9d3f-4231820f7d3b\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") "
Jul 15 16:51:05.170104 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.169997    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6f9s\" (UniqueName: \"kubernetes.io/projected/b09dc6c8-71d8-41d1-8e52-240c5809b53a-kube-api-access-x6f9s\") pod \"b09dc6c8-71d8-41d1-8e52-240c5809b53a\" (UID: \"b09dc6c8-71d8-41d1-8e52-240c5809b53a\") "
Jul 15 16:51:05.170104 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.170043    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl9lh\" (UniqueName: \"kubernetes.io/projected/31652a81-08f7-4716-9d3f-4231820f7d3b-kube-api-access-xl9lh\") pod \"31652a81-08f7-4716-9d3f-4231820f7d3b\" (UID: \"31652a81-08f7-4716-9d3f-4231820f7d3b\") "
Jul 15 16:51:05.170373 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.170345    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31652a81-08f7-4716-9d3f-4231820f7d3b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31652a81-08f7-4716-9d3f-4231820f7d3b" (UID: "31652a81-08f7-4716-9d3f-4231820f7d3b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:05.171968 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.171946    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b09dc6c8-71d8-41d1-8e52-240c5809b53a-kube-api-access-x6f9s" (OuterVolumeSpecName: "kube-api-access-x6f9s") pod "b09dc6c8-71d8-41d1-8e52-240c5809b53a" (UID: "b09dc6c8-71d8-41d1-8e52-240c5809b53a"). InnerVolumeSpecName "kube-api-access-x6f9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:51:05.172038 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.171969    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31652a81-08f7-4716-9d3f-4231820f7d3b-kube-api-access-xl9lh" (OuterVolumeSpecName: "kube-api-access-xl9lh") pod "31652a81-08f7-4716-9d3f-4231820f7d3b" (UID: "31652a81-08f7-4716-9d3f-4231820f7d3b"). InnerVolumeSpecName "kube-api-access-xl9lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:51:05.254488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.254450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:05.259488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.259452    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"
Jul 15 16:51:05.270606 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.270582    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6f9s\" (UniqueName: \"kubernetes.io/projected/b09dc6c8-71d8-41d1-8e52-240c5809b53a-kube-api-access-x6f9s\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:51:05.270684 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.270615    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl9lh\" (UniqueName: \"kubernetes.io/projected/31652a81-08f7-4716-9d3f-4231820f7d3b-kube-api-access-xl9lh\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:51:05.270684 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.270631    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31652a81-08f7-4716-9d3f-4231820f7d3b-extensions-socket-volume\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:51:05.401365 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.401333    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"]
Jul 15 16:51:05.404754 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:51:05.404728    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4767e37b_a9ae_4b5d_8875_34001729d462.slice/crio-fb9bcca0215adb314ef869ee02f2474bf5eb3bd38d2c5c8a305e90e9b896caa7 WatchSource:0}: Error finding container fb9bcca0215adb314ef869ee02f2474bf5eb3bd38d2c5c8a305e90e9b896caa7: Status 404 returned error can't find the container with id fb9bcca0215adb314ef869ee02f2474bf5eb3bd38d2c5c8a305e90e9b896caa7
Jul 15 16:51:05.422353 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:05.422333    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"]
Jul 15 16:51:05.425011 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:51:05.424986    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181509e1_d6f0_4f61_a5ed_b40ebf52b222.slice/crio-ba935f39b56bfd2c5dfe44722e8641a4914b5130dc176c9be9f9b99b198e6b90 WatchSource:0}: Error finding container ba935f39b56bfd2c5dfe44722e8641a4914b5130dc176c9be9f9b99b198e6b90: Status 404 returned error can't find the container with id ba935f39b56bfd2c5dfe44722e8641a4914b5130dc176c9be9f9b99b198e6b90
Jul 15 16:51:06.070879 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.070839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl" event={"ID":"181509e1-d6f0-4f61-a5ed-b40ebf52b222","Type":"ContainerStarted","Data":"087b8e545a0c343a768a54756abb1f5e3258bc70e2f9df01e46eeec6d4c12cf7"}
Jul 15 16:51:06.071296 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.070902    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl" event={"ID":"181509e1-d6f0-4f61-a5ed-b40ebf52b222","Type":"ContainerStarted","Data":"ba935f39b56bfd2c5dfe44722e8641a4914b5130dc176c9be9f9b99b198e6b90"}
Jul 15 16:51:06.071296 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.070929    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"
Jul 15 16:51:06.072534 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.072511    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h" event={"ID":"4767e37b-a9ae-4b5d-8875-34001729d462","Type":"ContainerStarted","Data":"3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809"}
Jul 15 16:51:06.072633 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.072556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h" event={"ID":"4767e37b-a9ae-4b5d-8875-34001729d462","Type":"ContainerStarted","Data":"fb9bcca0215adb314ef869ee02f2474bf5eb3bd38d2c5c8a305e90e9b896caa7"}
Jul 15 16:51:06.072633 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.072585    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:06.073116 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:06.073088    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-snvsh\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:06.073740 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.073725    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:06.073819 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.073761    2567 scope.go:117] "RemoveContainer" containerID="0be883a1752562a3773e6e2ae63c9905a52489f8d3506544fd835a0f1105d291"
Jul 15 16:51:06.073913 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.073877    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:06.074896 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:06.074862    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:06.091956 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:06.091924    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-snvsh\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-snvsh"
Jul 15 16:51:06.092286 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.092240    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl" podStartSLOduration=2.092225508 podStartE2EDuration="2.092225508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:06.090024441 +0000 UTC m=+662.184962688" watchObservedRunningTime="2026-07-15 16:51:06.092225508 +0000 UTC m=+662.187163820"
Jul 15 16:51:06.093560 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:06.093537    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r4m6k\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r4m6k"
Jul 15 16:51:06.114224 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.114169    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h" podStartSLOduration=2.1141389 podStartE2EDuration="2.1141389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:06.112330396 +0000 UTC m=+662.207268640" watchObservedRunningTime="2026-07-15 16:51:06.1141389 +0000 UTC m=+662.209077145"
Jul 15 16:51:06.512940 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.512860    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31652a81-08f7-4716-9d3f-4231820f7d3b" path="/var/lib/kubelet/pods/31652a81-08f7-4716-9d3f-4231820f7d3b/volumes"
Jul 15 16:51:06.513204 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:06.513189    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b09dc6c8-71d8-41d1-8e52-240c5809b53a" path="/var/lib/kubelet/pods/b09dc6c8-71d8-41d1-8e52-240c5809b53a/volumes"
Jul 15 16:51:17.082904 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:17.082874    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t4wtl"
Jul 15 16:51:17.083446 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:17.083027    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:33.647748 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:33.647703    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"]
Jul 15 16:51:33.648348 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:33.647920    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h" podUID="4767e37b-a9ae-4b5d-8875-34001729d462" containerName="manager" containerID="cri-o://3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809" gracePeriod=10
Jul 15 16:51:33.896216 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:33.896187    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:34.000045 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:33.999954    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4767e37b-a9ae-4b5d-8875-34001729d462-extensions-socket-volume\") pod \"4767e37b-a9ae-4b5d-8875-34001729d462\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") "
Jul 15 16:51:34.000045 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:33.999997    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfbt9\" (UniqueName: \"kubernetes.io/projected/4767e37b-a9ae-4b5d-8875-34001729d462-kube-api-access-hfbt9\") pod \"4767e37b-a9ae-4b5d-8875-34001729d462\" (UID: \"4767e37b-a9ae-4b5d-8875-34001729d462\") "
Jul 15 16:51:34.000417 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.000389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4767e37b-a9ae-4b5d-8875-34001729d462-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4767e37b-a9ae-4b5d-8875-34001729d462" (UID: "4767e37b-a9ae-4b5d-8875-34001729d462"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:34.002126 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.002103    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4767e37b-a9ae-4b5d-8875-34001729d462-kube-api-access-hfbt9" (OuterVolumeSpecName: "kube-api-access-hfbt9") pod "4767e37b-a9ae-4b5d-8875-34001729d462" (UID: "4767e37b-a9ae-4b5d-8875-34001729d462"). InnerVolumeSpecName "kube-api-access-hfbt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:51:34.100734 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.100693    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4767e37b-a9ae-4b5d-8875-34001729d462-extensions-socket-volume\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:51:34.100734 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.100728    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfbt9\" (UniqueName: \"kubernetes.io/projected/4767e37b-a9ae-4b5d-8875-34001729d462-kube-api-access-hfbt9\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 16:51:34.218080 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.218040    2567 generic.go:356] "Generic (PLEG): container finished" podID="4767e37b-a9ae-4b5d-8875-34001729d462" containerID="3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809" exitCode=0
Jul 15 16:51:34.218249 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.218088    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"
Jul 15 16:51:34.218249 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.218125    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h" event={"ID":"4767e37b-a9ae-4b5d-8875-34001729d462","Type":"ContainerDied","Data":"3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809"}
Jul 15 16:51:34.218249 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.218226    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h" event={"ID":"4767e37b-a9ae-4b5d-8875-34001729d462","Type":"ContainerDied","Data":"fb9bcca0215adb314ef869ee02f2474bf5eb3bd38d2c5c8a305e90e9b896caa7"}
Jul 15 16:51:34.218388 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.218250    2567 scope.go:117] "RemoveContainer" containerID="3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809"
Jul 15 16:51:34.227621 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.227602    2567 scope.go:117] "RemoveContainer" containerID="3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809"
Jul 15 16:51:34.227916 ip-10-0-128-117 kubenswrapper[2567]: E0715 16:51:34.227896    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809\": container with ID starting with 3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809 not found: ID does not exist" containerID="3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809"
Jul 15 16:51:34.227962 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.227925    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809"} err="failed to get container status \"3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809\": rpc error: code = NotFound desc = could not find container \"3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809\": container with ID starting with 3ff87f6a3921d960159099a61dd15ea44d4b8d235b3bdc8a6eef1634f00ed809 not found: ID does not exist"
Jul 15 16:51:34.239794 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.239763    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"]
Jul 15 16:51:34.245656 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.245628    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-svl2h"]
Jul 15 16:51:34.513221 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:34.513190    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4767e37b-a9ae-4b5d-8875-34001729d462" path="/var/lib/kubelet/pods/4767e37b-a9ae-4b5d-8875-34001729d462/volumes"
Jul 15 16:51:49.964964 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:49.964930    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"]
Jul 15 16:51:49.965371 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:49.965275    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4767e37b-a9ae-4b5d-8875-34001729d462" containerName="manager"
Jul 15 16:51:49.965371 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:49.965289    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4767e37b-a9ae-4b5d-8875-34001729d462" containerName="manager"
Jul 15 16:51:49.965371 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:49.965356    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4767e37b-a9ae-4b5d-8875-34001729d462" containerName="manager"
Jul 15 16:51:49.969085 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:49.969068    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:49.971477 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:49.971461    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jg5pr\""
Jul 15 16:51:49.980628 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:49.980598    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"]
Jul 15 16:51:50.026741 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026704    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9js\" (UniqueName: \"kubernetes.io/projected/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-kube-api-access-fv9js\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.026741 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.026943 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.026943 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.026943 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026895    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.026943 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026934    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.027068 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.027068 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026968    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.027068 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.026994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.127639 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.127829 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9js\" (UniqueName: \"kubernetes.io/projected/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-kube-api-access-fv9js\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.127829 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127677    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.127829 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.127829 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.127829 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127766    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128092 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128092 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128092 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.127972    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128283 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.128116    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128385 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.128357    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128456 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.128380    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128456 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.128402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.128560 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.128489    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.130215 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.130195    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.130323 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.130308    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.135308 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.135286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.135444 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.135422    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9js\" (UniqueName: \"kubernetes.io/projected/e4c45937-07d3-4048-9ff0-5adfd1c0b5e7-kube-api-access-fv9js\") pod \"maas-default-gateway-openshift-default-56654dcf7-mzhbs\" (UID: \"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.280114 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.280078    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:50.415190 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.415139    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"]
Jul 15 16:51:50.417973 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:51:50.417948    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c45937_07d3_4048_9ff0_5adfd1c0b5e7.slice/crio-632497baa4c82e828683a0e71449bd4b1a9f632972fdaacaee863325c8643850 WatchSource:0}: Error finding container 632497baa4c82e828683a0e71449bd4b1a9f632972fdaacaee863325c8643850: Status 404 returned error can't find the container with id 632497baa4c82e828683a0e71449bd4b1a9f632972fdaacaee863325c8643850
Jul 15 16:51:50.420009 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.419974    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:51:50.420101 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.420055    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:51:50.420101 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:50.420088    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:51:51.309014 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:51.308973    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" event={"ID":"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7","Type":"ContainerStarted","Data":"9f8e689e499d7208a687a257104ecfb0e9bb8277409ef328e3766a23a28ac781"}
Jul 15 16:51:51.309396 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:51.309068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" event={"ID":"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7","Type":"ContainerStarted","Data":"632497baa4c82e828683a0e71449bd4b1a9f632972fdaacaee863325c8643850"}
Jul 15 16:51:51.330742 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:51.330692    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" podStartSLOduration=2.330673175 podStartE2EDuration="2.330673175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:51.328039915 +0000 UTC m=+707.422978173" watchObservedRunningTime="2026-07-15 16:51:51.330673175 +0000 UTC m=+707.425611420"
Jul 15 16:51:52.280443 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.280407    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:52.285094 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.285069    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:52.313831 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.313801    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:52.314709 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.314692    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:51:52.783996 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.783961    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:51:52.787503 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.787480    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:52.789904 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.789882    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 16:51:52.790006 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.789924    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qdk7w\""
Jul 15 16:51:52.794648 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.794622    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:51:52.820137 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.820092    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:51:52.852668 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.852633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/760bea16-9f05-40af-98ce-3d321620b56d-config-file\") pod \"limitador-limitador-54d6d988d5-4qqc5\" (UID: \"760bea16-9f05-40af-98ce-3d321620b56d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:52.852806 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.852691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7lg2\" (UniqueName: \"kubernetes.io/projected/760bea16-9f05-40af-98ce-3d321620b56d-kube-api-access-n7lg2\") pod \"limitador-limitador-54d6d988d5-4qqc5\" (UID: \"760bea16-9f05-40af-98ce-3d321620b56d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:52.953357 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.953323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7lg2\" (UniqueName: \"kubernetes.io/projected/760bea16-9f05-40af-98ce-3d321620b56d-kube-api-access-n7lg2\") pod \"limitador-limitador-54d6d988d5-4qqc5\" (UID: \"760bea16-9f05-40af-98ce-3d321620b56d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:52.953541 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.953399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/760bea16-9f05-40af-98ce-3d321620b56d-config-file\") pod \"limitador-limitador-54d6d988d5-4qqc5\" (UID: \"760bea16-9f05-40af-98ce-3d321620b56d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:52.954003 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.953985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/760bea16-9f05-40af-98ce-3d321620b56d-config-file\") pod \"limitador-limitador-54d6d988d5-4qqc5\" (UID: \"760bea16-9f05-40af-98ce-3d321620b56d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:52.961269 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:52.961240    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7lg2\" (UniqueName: \"kubernetes.io/projected/760bea16-9f05-40af-98ce-3d321620b56d-kube-api-access-n7lg2\") pod \"limitador-limitador-54d6d988d5-4qqc5\" (UID: \"760bea16-9f05-40af-98ce-3d321620b56d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:53.099315 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:53.099226    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:53.225638 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:53.225604    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:51:53.228060 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:51:53.228019    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760bea16_9f05_40af_98ce_3d321620b56d.slice/crio-7fe5dd4c9c3a7273583724e5a0b99eda3d479973a7c7dba8ab8983f0da022b0a WatchSource:0}: Error finding container 7fe5dd4c9c3a7273583724e5a0b99eda3d479973a7c7dba8ab8983f0da022b0a: Status 404 returned error can't find the container with id 7fe5dd4c9c3a7273583724e5a0b99eda3d479973a7c7dba8ab8983f0da022b0a
Jul 15 16:51:53.320062 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:53.320021    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5" event={"ID":"760bea16-9f05-40af-98ce-3d321620b56d","Type":"ContainerStarted","Data":"7fe5dd4c9c3a7273583724e5a0b99eda3d479973a7c7dba8ab8983f0da022b0a"}
Jul 15 16:51:57.342534 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:57.342490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5" event={"ID":"760bea16-9f05-40af-98ce-3d321620b56d","Type":"ContainerStarted","Data":"f5a9206e60724badd095fcc8020348acf0fd7278107bade678b59c5f7e250fa4"}
Jul 15 16:51:57.342996 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:57.342550    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:51:57.363747 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:51:57.363693    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5" podStartSLOduration=2.139392447 podStartE2EDuration="5.36367846s" totalImagesPullingTime="3.224286013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:57.362730959 +0000 UTC m=+713.457669226" watchObservedRunningTime="2026-07-15 16:51:57.36367846 +0000 UTC m=+713.458616705"
Jul 15 16:52:08.348428 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:52:08.348392    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"
Jul 15 16:53:09.521275 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:09.521237    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:53:17.742301 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:17.742268    2567 generic.go:356] "Generic (PLEG): container finished" podID="e4c45937-07d3-4048-9ff0-5adfd1c0b5e7" containerID="9f8e689e499d7208a687a257104ecfb0e9bb8277409ef328e3766a23a28ac781" exitCode=0
Jul 15 16:53:17.742712 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:17.742348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" event={"ID":"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7","Type":"ContainerDied","Data":"9f8e689e499d7208a687a257104ecfb0e9bb8277409ef328e3766a23a28ac781"}
Jul 15 16:53:17.742752 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:17.742713    2567 scope.go:117] "RemoveContainer" containerID="9f8e689e499d7208a687a257104ecfb0e9bb8277409ef328e3766a23a28ac781"
Jul 15 16:53:17.743773 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:17.743747    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:53:17.743862 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:17.743813    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:53:17.743862 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:17.743844    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 16:53:18.749472 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:18.749441    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" event={"ID":"e4c45937-07d3-4048-9ff0-5adfd1c0b5e7","Type":"ContainerStarted","Data":"53db9c99aa4a9ea61ce9566bb3182a17af51c53bdac4dafac4eb4c987c01dd21"}
Jul 15 16:53:19.282296 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:19.282254    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:53:19.282518 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:19.282396    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mzhbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:53:19.282518 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:19.282441    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" podUID="e4c45937-07d3-4048-9ff0-5adfd1c0b5e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 15 16:53:20.280948 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:20.280907    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mzhbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:53:20.281559 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:20.281530    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" podUID="e4c45937-07d3-4048-9ff0-5adfd1c0b5e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 15 16:53:21.280845 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:21.280807    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mzhbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:53:21.281174 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:21.281121    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" podUID="e4c45937-07d3-4048-9ff0-5adfd1c0b5e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 15 16:53:22.281096 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:22.281061    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mzhbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Jul 15 16:53:22.281413 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:22.281380    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs" podUID="e4c45937-07d3-4048-9ff0-5adfd1c0b5e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Jul 15 16:53:22.314166 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:22.314118    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:53:23.285222 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:23.285191    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:53:23.286072 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:23.286056    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mzhbs"
Jul 15 16:53:33.092918 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:33.092837    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:53:44.162079 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:44.162040    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:53:55.255770 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:55.255732    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:53:58.725199 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.725144    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"]
Jul 15 16:53:58.727772 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.727750    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.730110 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.730086    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hh5sk\""
Jul 15 16:53:58.730244 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.730179    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 16:53:58.731001 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.730978    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 16:53:58.731089 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.731012    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 16:53:58.741767 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.741743    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"]
Jul 15 16:53:58.840795 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.840748    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.840976 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.840808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.840976 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.840832    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cnfl\" (UniqueName: \"kubernetes.io/projected/382ec040-7444-442e-afbb-9a70e859dc24-kube-api-access-8cnfl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.840976 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.840881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/382ec040-7444-442e-afbb-9a70e859dc24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.840976 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.840936    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.841113 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.840991    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.942461 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.942408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.942461 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.942473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.942732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.942517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.942732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.942537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnfl\" (UniqueName: \"kubernetes.io/projected/382ec040-7444-442e-afbb-9a70e859dc24-kube-api-access-8cnfl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.942732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.942634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/382ec040-7444-442e-afbb-9a70e859dc24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.942732 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.942688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.942940 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.942876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.943079 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.943054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.943234 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.943082    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.944970 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.944948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/382ec040-7444-442e-afbb-9a70e859dc24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.945271 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.945254    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/382ec040-7444-442e-afbb-9a70e859dc24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:58.953198 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:58.953173    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cnfl\" (UniqueName: \"kubernetes.io/projected/382ec040-7444-442e-afbb-9a70e859dc24-kube-api-access-8cnfl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx\" (UID: \"382ec040-7444-442e-afbb-9a70e859dc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:59.038082 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:59.038049    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:53:59.170550 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:59.170510    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"]
Jul 15 16:53:59.171450 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:53:59.171417    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382ec040_7444_442e_afbb_9a70e859dc24.slice/crio-830102e639a8518c65133d4ac0d973802d3d9cd61d5dc8b935975dc33d00d507 WatchSource:0}: Error finding container 830102e639a8518c65133d4ac0d973802d3d9cd61d5dc8b935975dc33d00d507: Status 404 returned error can't find the container with id 830102e639a8518c65133d4ac0d973802d3d9cd61d5dc8b935975dc33d00d507
Jul 15 16:53:59.172801 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:59.172782    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:53:59.955557 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:53:59.955521    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx" event={"ID":"382ec040-7444-442e-afbb-9a70e859dc24","Type":"ContainerStarted","Data":"830102e639a8518c65133d4ac0d973802d3d9cd61d5dc8b935975dc33d00d507"}
Jul 15 16:54:00.957648 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:00.957618    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:54:00.961604 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:00.961576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx" event={"ID":"382ec040-7444-442e-afbb-9a70e859dc24","Type":"ContainerStarted","Data":"5549c4aab0dfd13791d0ff0a5b3999d87343146aa44cfd7f676bafedb6e2ac8d"}
Jul 15 16:54:00.981275 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:00.981223    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx" podStartSLOduration=1.980378069 podStartE2EDuration="2.981206691s" totalImagesPullingTime="1.000828622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:54:00.979094947 +0000 UTC m=+837.074033192" watchObservedRunningTime="2026-07-15 16:54:00.981206691 +0000 UTC m=+837.076144937"
Jul 15 16:54:06.458080 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:06.458043    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:54:09.039141 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:09.039091    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:54:09.039564 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:09.039190    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:54:09.051789 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:09.051762    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:54:10.016557 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:10.016519    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx"
Jul 15 16:54:13.839250 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.839209    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"]
Jul 15 16:54:13.842869 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.842845    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.845327 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.845304    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 16:54:13.851059 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.851040    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"]
Jul 15 16:54:13.871418 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.871394    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.871529 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.871431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5gqf\" (UniqueName: \"kubernetes.io/projected/1105e369-502e-4360-94b6-82419f6f42ce-kube-api-access-b5gqf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.871576 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.871562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.871618 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.871587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.871618 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.871606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.871703 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.871626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1105e369-502e-4360-94b6-82419f6f42ce-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972301 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972301 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1105e369-502e-4360-94b6-82419f6f42ce-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972488 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5gqf\" (UniqueName: \"kubernetes.io/projected/1105e369-502e-4360-94b6-82419f6f42ce-kube-api-access-b5gqf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972665 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.972840 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972815    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.973009 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.972865    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.974589 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.974569    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1105e369-502e-4360-94b6-82419f6f42ce-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.974818 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.974801    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1105e369-502e-4360-94b6-82419f6f42ce-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:13.979762 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:13.979740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5gqf\" (UniqueName: \"kubernetes.io/projected/1105e369-502e-4360-94b6-82419f6f42ce-kube-api-access-b5gqf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97\" (UID: \"1105e369-502e-4360-94b6-82419f6f42ce\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:14.152901 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:14.152799    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:14.282537 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:14.282505    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"]
Jul 15 16:54:14.284616 ip-10-0-128-117 kubenswrapper[2567]: W0715 16:54:14.284583    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1105e369_502e_4360_94b6_82419f6f42ce.slice/crio-91614b2445be1efbdb9c0ad9441ff49ffca5e63753176a9ff4c605376317cf59 WatchSource:0}: Error finding container 91614b2445be1efbdb9c0ad9441ff49ffca5e63753176a9ff4c605376317cf59: Status 404 returned error can't find the container with id 91614b2445be1efbdb9c0ad9441ff49ffca5e63753176a9ff4c605376317cf59
Jul 15 16:54:15.031071 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:15.031033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97" event={"ID":"1105e369-502e-4360-94b6-82419f6f42ce","Type":"ContainerStarted","Data":"42899e371b8af3fe5b198031d2c5c0d15ee3d43364ac1efd202d332fe895d21b"}
Jul 15 16:54:15.031479 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:15.031079    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97" event={"ID":"1105e369-502e-4360-94b6-82419f6f42ce","Type":"ContainerStarted","Data":"91614b2445be1efbdb9c0ad9441ff49ffca5e63753176a9ff4c605376317cf59"}
Jul 15 16:54:15.048899 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:15.048848    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97" podStartSLOduration=1.871667279 podStartE2EDuration="2.048832833s" totalImagesPullingTime="177.165554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:54:15.047368424 +0000 UTC m=+851.142306668" watchObservedRunningTime="2026-07-15 16:54:15.048832833 +0000 UTC m=+851.143771129"
Jul 15 16:54:16.363234 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:16.363196    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:54:24.153807 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:24.153764    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:24.154240 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:24.153821    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:24.166470 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:24.166441    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:54:25.091831 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:54:25.091796    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97"
Jul 15 16:55:04.399568 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:55:04.399486    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:55:04.401879 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:55:04.401860    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 16:55:37.265389 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:55:37.265354    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:55:46.355886 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:55:46.355852    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:55:57.959371 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:55:57.959341    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:56:06.376304 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:56:06.376269    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:56:16.354289 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:56:16.354251    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:56:43.970835 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:56:43.970755    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:56:56.958066 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:56:56.958032    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:57:04.421755 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:57:04.421723    2567 scope.go:117] "RemoveContainer" containerID="510198f2c7b35da8b757f6a608fdfcfe3d7c3f03c63f46fcd32e8f0fec09d9fc"
Jul 15 16:57:30.953316 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:57:30.953281    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:57:40.259142 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:57:40.259107    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:57:48.761773 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:57:48.761739    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:57:58.959263 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:57:58.959231    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:58:08.460105 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:58:08.460070    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:58:17.164335 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:58:17.164303    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:58:29.464855 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:58:29.464822    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:58:39.355559 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:58:39.355522    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:59:01.659147 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:59:01.659110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:59:13.865240 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:59:13.865203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:59:36.362909 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:59:36.362835    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 16:59:48.159875 ip-10-0-128-117 kubenswrapper[2567]: I0715 16:59:48.159834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:00:01.964841 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:00:01.964809    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:00:04.429376 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:00:04.429327    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:00:04.433255 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:00:04.433236    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:00:13.066076 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:00:13.066039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:00:22.162057 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:00:22.162015    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:00:31.267343 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:00:31.267304    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:00:42.066709 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:00:42.066671    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:02:30.169608 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:02:30.169529    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:02:42.568854 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:02:42.568824    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:02:51.060043 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:02:51.060002    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:03:02.764329 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:03:02.764284    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:03:14.765943 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:03:14.765908    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:03:24.060858 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:03:24.060822    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:03:33.567440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:03:33.567407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:03:43.768081 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:03:43.768046    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:03:54.467131 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:03:54.467094    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:04:04.553742 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:04:04.553658    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:04:15.360632 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:04:15.360602    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:04:39.362675 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:04:39.362642    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:04:46.765354 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:04:46.765320    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:04:56.462263 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:04:56.462136    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:05:04.459297 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:04.459266    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:05:04.465872 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:04.465851    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:05:07.554672 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:07.554637    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:05:15.074526 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:15.074492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:05:26.771575 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:26.771493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:05:39.355360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:39.355329    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:05:47.162886 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:47.162852    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:05:56.860889 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:05:56.860841    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:06:06.564365 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:06:06.564334    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:06:17.961467 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:06:17.961429    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:06:31.261815 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:06:31.261779    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:06:40.263039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:06:40.263009    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:06:49.666292 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:06:49.666258    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:06:59.361964 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:06:59.361877    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:07:10.655272 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:07:10.655235    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:07:17.268898 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:07:17.268865    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:07:33.769103 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:07:33.769072    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:07:46.858800 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:07:46.858768    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:07:55.756549 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:07:55.756515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:08:09.863908 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:09.863868    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:08:21.960811 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:21.960782    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:08:27.026888 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.026811    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"]
Jul 15 17:08:27.033290 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.033273    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.035728 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.035710    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7bb30196-openshift-default-dockercfg-xxjrk\""
Jul 15 17:08:27.048745 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.048721    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"]
Jul 15 17:08:27.125681 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125651    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-envoy\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125848 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-socket\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125848 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-certs\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125848 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-token\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125848 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125830    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08aff107-aea5-4bd4-8c1b-42edc341b468-istiod-ca-cert\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-credential-socket\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-data\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-podinfo\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.125991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.125946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz975\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-kube-api-access-cz975\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.226892 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.226863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-envoy\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227089 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.226914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-socket\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227089 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.226944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-certs\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227089 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.226966    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-token\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227089 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.226987    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08aff107-aea5-4bd4-8c1b-42edc341b468-istiod-ca-cert\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227135    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-credential-socket\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-data\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227250    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-podinfo\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz975\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-kube-api-access-cz975\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227884 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-certs\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227884 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227462    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-socket\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227884 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227498    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-credential-socket\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227884 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-data\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.227884 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.227751    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08aff107-aea5-4bd4-8c1b-42edc341b468-istiod-ca-cert\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.229149 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.229119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-envoy\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.229679 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.229651    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-podinfo\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.240602 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.240571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz975\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-kube-api-access-cz975\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.240683 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.240620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-token\") pod \"e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") " pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.344013 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.343940    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:27.478334 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.478300    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"]
Jul 15 17:08:27.479342 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:08:27.479314    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08aff107_aea5_4bd4_8c1b_42edc341b468.slice/crio-87dba8705457a2d324a50d3308c65e866bfc4ed8f1d50e0d1ce7ae5c2ec5b152 WatchSource:0}: Error finding container 87dba8705457a2d324a50d3308c65e866bfc4ed8f1d50e0d1ce7ae5c2ec5b152: Status 404 returned error can't find the container with id 87dba8705457a2d324a50d3308c65e866bfc4ed8f1d50e0d1ce7ae5c2ec5b152
Jul 15 17:08:27.481483 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.481452    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:27.481561 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.481516    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:27.481561 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:27.481548    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:28.195766 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:28.195732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" event={"ID":"08aff107-aea5-4bd4-8c1b-42edc341b468","Type":"ContainerStarted","Data":"ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7"}
Jul 15 17:08:28.196150 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:28.195788    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" event={"ID":"08aff107-aea5-4bd4-8c1b-42edc341b468","Type":"ContainerStarted","Data":"87dba8705457a2d324a50d3308c65e866bfc4ed8f1d50e0d1ce7ae5c2ec5b152"}
Jul 15 17:08:28.218378 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:28.218328    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" podStartSLOduration=1.2183139490000001 podStartE2EDuration="1.218313949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:08:28.217143804 +0000 UTC m=+1704.312082054" watchObservedRunningTime="2026-07-15 17:08:28.218313949 +0000 UTC m=+1704.313252194"
Jul 15 17:08:28.345019 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:28.344985    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:28.350550 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:28.350524    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:29.200865 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:29.200838    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:29.201925 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:29.201907    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:32.356954 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:32.356924    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:08:40.258519 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:40.258487    2567 generic.go:356] "Generic (PLEG): container finished" podID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerID="ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7" exitCode=0
Jul 15 17:08:40.259003 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:40.258567    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" event={"ID":"08aff107-aea5-4bd4-8c1b-42edc341b468","Type":"ContainerDied","Data":"ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7"}
Jul 15 17:08:40.259096 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:40.259080    2567 scope.go:117] "RemoveContainer" containerID="ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7"
Jul 15 17:08:40.260029 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:40.260006    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:40.260131 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:40.260073    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:40.260131 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:40.260104    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:41.264629 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:41.264593    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" event={"ID":"08aff107-aea5-4bd4-8c1b-42edc341b468","Type":"ContainerStarted","Data":"33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e"}
Jul 15 17:08:41.344370 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:41.344336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:41.345435 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:41.345412    2567 patch_prober.go:28] interesting pod/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 15 17:08:41.345531 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:41.345468    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 15 17:08:42.344427 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:42.344392    2567 patch_prober.go:28] interesting pod/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 15 17:08:42.344818 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:42.344449    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 15 17:08:43.344307 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:43.344271    2567 patch_prober.go:28] interesting pod/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 15 17:08:43.344487 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:43.344327    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 15 17:08:44.201279 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:44.201237    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:44.344677 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:44.344639    2567 patch_prober.go:28] interesting pod/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 15 17:08:44.345028 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:44.344709    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 15 17:08:45.349264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:45.349229    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:45.350139 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:45.350119    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:08:46.362410 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:46.362379    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:08:58.452286 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:58.452250    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"]
Jul 15 17:08:58.452704 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:58.452458    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy" containerID="cri-o://33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e" gracePeriod=30
Jul 15 17:08:59.077442 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.077406    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"]
Jul 15 17:08:59.080631 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.080608    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.084053 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.084024    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-000d7ff6-gw-openshift-default-dockercfg-qdfvl\""
Jul 15 17:08:59.093878 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.093859    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"]
Jul 15 17:08:59.129260 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-credential-socket\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129377 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-socket\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129377 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129319    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istiod-ca-cert\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129497 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-token\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129497 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-data\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129497 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-certs\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129497 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-envoy\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129679 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd8tq\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-kube-api-access-dd8tq\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.129679 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.129574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-podinfo\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.229965 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.229935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-socket\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.229970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istiod-ca-cert\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-token\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-data\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230081    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-certs\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-envoy\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230421 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd8tq\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-kube-api-access-dd8tq\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230421 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230207    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-podinfo\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230421 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-credential-socket\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230571 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-socket\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230571 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-certs\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230676 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-data\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230758 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-credential-socket\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.230951 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.230909    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istiod-ca-cert\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.232564 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.232543    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-envoy\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.232666 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.232651    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-podinfo\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.237663 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.237644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-token\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.237763 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.237647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd8tq\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-kube-api-access-dd8tq\") pod \"e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") " pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.391868 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.391802    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:08:59.528465 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.528442    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"]
Jul 15 17:08:59.530220 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:08:59.530191    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bc5ad5_4a50_4305_b01a_684b6e13abf6.slice/crio-60011cbdc21bfae68180e3b9e24d088d6a02a5248ac3a480c1d7307826b5fc2a WatchSource:0}: Error finding container 60011cbdc21bfae68180e3b9e24d088d6a02a5248ac3a480c1d7307826b5fc2a: Status 404 returned error can't find the container with id 60011cbdc21bfae68180e3b9e24d088d6a02a5248ac3a480c1d7307826b5fc2a
Jul 15 17:08:59.532544 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.532507    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:59.532635 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.532589    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:08:59.532678 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:08:59.532633    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:09:00.351799 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:00.351767    2567 patch_prober.go:28] interesting pod/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 17:09:00.351960 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:00.351832    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 17:09:00.361612 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:00.361580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" event={"ID":"68bc5ad5-4a50-4305-b01a-684b6e13abf6","Type":"ContainerStarted","Data":"276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee"}
Jul 15 17:09:00.361745 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:00.361636    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" event={"ID":"68bc5ad5-4a50-4305-b01a-684b6e13abf6","Type":"ContainerStarted","Data":"60011cbdc21bfae68180e3b9e24d088d6a02a5248ac3a480c1d7307826b5fc2a"}
Jul 15 17:09:00.385139 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:00.385086    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" podStartSLOduration=1.385068186 podStartE2EDuration="1.385068186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:09:00.384495095 +0000 UTC m=+1736.479433365" watchObservedRunningTime="2026-07-15 17:09:00.385068186 +0000 UTC m=+1736.480006412"
Jul 15 17:09:00.392622 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:00.392603    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:00.397544 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:00.397527    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:01.366613 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:01.366579    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:01.367639 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:01.367619    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:03.704475 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.704455    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:09:03.766975 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.766946    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-socket\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767115 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.766999    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-podinfo\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767115 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767049    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-credential-socket\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767115 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767081    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-envoy\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767290 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767211    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-token\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767290 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767284    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08aff107-aea5-4bd4-8c1b-42edc341b468-istiod-ca-cert\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767401 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767343    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-data\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767401 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767226    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:09:03.767513 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767405    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-certs\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767513 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz975\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-kube-api-access-cz975\") pod \"08aff107-aea5-4bd4-8c1b-42edc341b468\" (UID: \"08aff107-aea5-4bd4-8c1b-42edc341b468\") "
Jul 15 17:09:03.767727 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767708    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.767992 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767377    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:09:03.768078 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767683    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08aff107-aea5-4bd4-8c1b-42edc341b468-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:09:03.768078 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.767917    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:09:03.768838 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.768793    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-data" (OuterVolumeSpecName: "istio-data") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:09:03.769649 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.769560    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:09:03.769754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.769705    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:09:03.769965 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.769942    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-token" (OuterVolumeSpecName: "istio-token") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:09:03.770270 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.770233    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-kube-api-access-cz975" (OuterVolumeSpecName: "kube-api-access-cz975") pod "08aff107-aea5-4bd4-8c1b-42edc341b468" (UID: "08aff107-aea5-4bd4-8c1b-42edc341b468"). InnerVolumeSpecName "kube-api-access-cz975". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:09:03.868546 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868521    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.868546 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868543    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08aff107-aea5-4bd4-8c1b-42edc341b468-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.868691 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868553    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.868691 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868562    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.868691 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868570    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz975\" (UniqueName: \"kubernetes.io/projected/08aff107-aea5-4bd4-8c1b-42edc341b468-kube-api-access-cz975\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.868691 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868578    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.868691 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868586    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:03.868691 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:03.868596    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08aff107-aea5-4bd4-8c1b-42edc341b468-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:09:04.384453 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.384423    2567 generic.go:356] "Generic (PLEG): container finished" podID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerID="33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e" exitCode=0
Jul 15 17:09:04.384621 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.384470    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"
Jul 15 17:09:04.384621 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.384504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" event={"ID":"08aff107-aea5-4bd4-8c1b-42edc341b468","Type":"ContainerDied","Data":"33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e"}
Jul 15 17:09:04.384621 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.384561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz" event={"ID":"08aff107-aea5-4bd4-8c1b-42edc341b468","Type":"ContainerDied","Data":"87dba8705457a2d324a50d3308c65e866bfc4ed8f1d50e0d1ce7ae5c2ec5b152"}
Jul 15 17:09:04.384621 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.384583    2567 scope.go:117] "RemoveContainer" containerID="33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e"
Jul 15 17:09:04.393855 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.393836    2567 scope.go:117] "RemoveContainer" containerID="ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7"
Jul 15 17:09:04.402045 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.402028    2567 scope.go:117] "RemoveContainer" containerID="33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e"
Jul 15 17:09:04.402323 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:09:04.402304    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e\": container with ID starting with 33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e not found: ID does not exist" containerID="33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e"
Jul 15 17:09:04.402404 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.402337    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e"} err="failed to get container status \"33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e\": rpc error: code = NotFound desc = could not find container \"33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e\": container with ID starting with 33e3c6b4b022efcf6e068a543e6401d411539062ea9b18a8396991061aa3557e not found: ID does not exist"
Jul 15 17:09:04.402404 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.402360    2567 scope.go:117] "RemoveContainer" containerID="ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7"
Jul 15 17:09:04.402591 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:09:04.402575    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7\": container with ID starting with ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7 not found: ID does not exist" containerID="ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7"
Jul 15 17:09:04.402630 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.402597    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7"} err="failed to get container status \"ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7\": rpc error: code = NotFound desc = could not find container \"ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7\": container with ID starting with ca15a3af80d8fd4183f289356c83205abf5bbedca09ca9fb66cad8fa16c191b7 not found: ID does not exist"
Jul 15 17:09:04.405418 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.405397    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"]
Jul 15 17:09:04.409423 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.409404    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7bb30196-openshift-default-7c467f5f87-d25cz"]
Jul 15 17:09:04.518389 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:04.518348    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" path="/var/lib/kubelet/pods/08aff107-aea5-4bd4-8c1b-42edc341b468/volumes"
Jul 15 17:09:07.260100 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:07.260066    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:09:15.441090 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:15.441057    2567 generic.go:356] "Generic (PLEG): container finished" podID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerID="276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee" exitCode=0
Jul 15 17:09:15.441611 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:15.441132    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" event={"ID":"68bc5ad5-4a50-4305-b01a-684b6e13abf6","Type":"ContainerDied","Data":"276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee"}
Jul 15 17:09:15.441684 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:15.441638    2567 scope.go:117] "RemoveContainer" containerID="276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee"
Jul 15 17:09:15.442655 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:15.442628    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:09:15.442754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:15.442692    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:09:15.442754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:15.442722    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:09:16.367353 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:16.367316    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:16.448281 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:16.448248    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" event={"ID":"68bc5ad5-4a50-4305-b01a-684b6e13abf6","Type":"ContainerStarted","Data":"3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e"}
Jul 15 17:09:17.393377 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:17.393346    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:17.393734 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:17.393711    2567 patch_prober.go:28] interesting pod/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 15 17:09:17.393899 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:17.393877    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 15 17:09:18.393078 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:18.393042    2567 patch_prober.go:28] interesting pod/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 15 17:09:18.393690 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:18.393660    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 15 17:09:19.392517 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:19.392480    2567 patch_prober.go:28] interesting pod/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 15 17:09:19.392780 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:19.392750    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 15 17:09:20.392588 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:20.392552    2567 patch_prober.go:28] interesting pod/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 15 17:09:20.393175 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:20.393126    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 15 17:09:21.396227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:21.396200    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:21.396662 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:21.396479    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:09:21.397234 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:09:21.397216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:10:04.489608 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:04.489582    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:10:04.496632 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:04.496610    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:10:04.905386 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:04.905359    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"]
Jul 15 17:10:04.905572 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:04.905544    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy" containerID="cri-o://3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e" gracePeriod=30
Jul 15 17:10:06.398732 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:06.398691    2567 patch_prober.go:28] interesting pod/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 17:10:06.399080 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:06.398765    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 17:10:07.554079 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:07.554045    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:10:10.155902 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.155881    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:10:10.221083 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221059    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istiod-ca-cert\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221094    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd8tq\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-kube-api-access-dd8tq\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221126    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-envoy\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221145    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-podinfo\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221385 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-credential-socket\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221385 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221308    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-token\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221385 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221333    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-data\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221385 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221375    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-socket\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221585 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221444    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-certs\") pod \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\" (UID: \"68bc5ad5-4a50-4305-b01a-684b6e13abf6\") "
Jul 15 17:10:10.221585 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221484    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:10:10.221585 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:10:10.221756 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221728    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:10:10.221817 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221793    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.221864 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221813    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.221910 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.221876    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:10:10.222576 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.222550    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-data" (OuterVolumeSpecName: "istio-data") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:10:10.223362 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.223340    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:10:10.223563 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.223539    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-token" (OuterVolumeSpecName: "istio-token") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:10:10.223790 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.223765    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:10:10.224462 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.224441    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-kube-api-access-dd8tq" (OuterVolumeSpecName: "kube-api-access-dd8tq") pod "68bc5ad5-4a50-4305-b01a-684b6e13abf6" (UID: "68bc5ad5-4a50-4305-b01a-684b6e13abf6"). InnerVolumeSpecName "kube-api-access-dd8tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:10:10.322914 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.322886    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd8tq\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-kube-api-access-dd8tq\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.322914 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.322913    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.323079 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.322922    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.323079 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.322931    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.323079 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.322940    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.323079 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.322947    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.323079 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.322966    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bc5ad5-4a50-4305-b01a-684b6e13abf6-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:10:10.708540 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.708500    2567 generic.go:356] "Generic (PLEG): container finished" podID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerID="3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e" exitCode=0
Jul 15 17:10:10.708684 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.708554    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"
Jul 15 17:10:10.708684 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.708587    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" event={"ID":"68bc5ad5-4a50-4305-b01a-684b6e13abf6","Type":"ContainerDied","Data":"3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e"}
Jul 15 17:10:10.708684 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.708642    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp" event={"ID":"68bc5ad5-4a50-4305-b01a-684b6e13abf6","Type":"ContainerDied","Data":"60011cbdc21bfae68180e3b9e24d088d6a02a5248ac3a480c1d7307826b5fc2a"}
Jul 15 17:10:10.708684 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.708665    2567 scope.go:117] "RemoveContainer" containerID="3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e"
Jul 15 17:10:10.717445 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.717430    2567 scope.go:117] "RemoveContainer" containerID="276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee"
Jul 15 17:10:10.725481 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.725455    2567 scope.go:117] "RemoveContainer" containerID="3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e"
Jul 15 17:10:10.725747 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:10:10.725729    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e\": container with ID starting with 3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e not found: ID does not exist" containerID="3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e"
Jul 15 17:10:10.725795 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.725756    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e"} err="failed to get container status \"3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e\": rpc error: code = NotFound desc = could not find container \"3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e\": container with ID starting with 3e0859b29a071de7f1f4e254c3d8e0bad7e81c9eb506764ec31c7a000f443b0e not found: ID does not exist"
Jul 15 17:10:10.725795 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.725773    2567 scope.go:117] "RemoveContainer" containerID="276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee"
Jul 15 17:10:10.726038 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:10:10.726020    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee\": container with ID starting with 276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee not found: ID does not exist" containerID="276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee"
Jul 15 17:10:10.726096 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.726041    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee"} err="failed to get container status \"276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee\": rpc error: code = NotFound desc = could not find container \"276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee\": container with ID starting with 276d98a90a09ba4bbeedbd9812c9bdb2a4420bd962bc4993ea5c2aff3be6d8ee not found: ID does not exist"
Jul 15 17:10:10.726403 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.726385    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"]
Jul 15 17:10:10.729882 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:10.729863    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-000d7ff6-gw-openshift-default-5f86d76bc9-zhlbp"]
Jul 15 17:10:11.233264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233237    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"]
Jul 15 17:10:11.233627 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233568    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy"
Jul 15 17:10:11.233627 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233580    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy"
Jul 15 17:10:11.233627 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233594    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy"
Jul 15 17:10:11.233627 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233599    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy"
Jul 15 17:10:11.233627 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233617    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy"
Jul 15 17:10:11.233627 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233626    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy"
Jul 15 17:10:11.233886 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233683    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy"
Jul 15 17:10:11.233886 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233694    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" containerName="istio-proxy"
Jul 15 17:10:11.233886 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233707    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy"
Jul 15 17:10:11.233886 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.233714    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy"
Jul 15 17:10:11.236685 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.236664    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.239072 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.239052    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3e01659b-openshift-default-dockercfg-mprjz\""
Jul 15 17:10:11.248871 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.248848    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"]
Jul 15 17:10:11.331143 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-token\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331328 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-socket\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331328 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxjfn\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-kube-api-access-cxjfn\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331328 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331252    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-podinfo\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331456 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-certs\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331456 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331376    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-data\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331456 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-envoy\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331456 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-credential-socket\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.331703 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.331465    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istiod-ca-cert\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432617 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-podinfo\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-certs\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-data\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-envoy\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-credential-socket\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istiod-ca-cert\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-token\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.432808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-socket\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.433199 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.432830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxjfn\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-kube-api-access-cxjfn\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.433199 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.433108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-certs\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.433310 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.433215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-data\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.433413 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.433396    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-credential-socket\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.433619 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.433589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-socket\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.433825 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.433802    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istiod-ca-cert\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.435020 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.435002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-envoy\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.435273 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.435256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-podinfo\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.441720 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.441688    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-token\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.441944 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.441913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxjfn\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-kube-api-access-cxjfn\") pod \"e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") " pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.546893 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.546868    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:11.686575 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.682625    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"]
Jul 15 17:10:11.687615 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.687580    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:10:11.687735 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.687660    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:10:11.687735 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.687702    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:10:11.714087 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:11.714058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" event={"ID":"8cb559a0-b7f7-4826-a5e9-5211d1c1a901","Type":"ContainerStarted","Data":"47dc9fb577e0a1fbe4e60fe8223d1ac4855d86929688834a38fc62ab1e889afd"}
Jul 15 17:10:12.511582 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:12.511507    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68bc5ad5-4a50-4305-b01a-684b6e13abf6" path="/var/lib/kubelet/pods/68bc5ad5-4a50-4305-b01a-684b6e13abf6/volumes"
Jul 15 17:10:12.722102 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:12.722062    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" event={"ID":"8cb559a0-b7f7-4826-a5e9-5211d1c1a901","Type":"ContainerStarted","Data":"5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129"}
Jul 15 17:10:12.745003 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:12.744960    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" podStartSLOduration=1.744943203 podStartE2EDuration="1.744943203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:10:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:10:12.744733758 +0000 UTC m=+1808.839672004" watchObservedRunningTime="2026-07-15 17:10:12.744943203 +0000 UTC m=+1808.839881425"
Jul 15 17:10:13.547221 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:13.547192    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:13.551856 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:13.551830    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:13.726934 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:13.726903    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:13.727772 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:13.727752    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:19.163410 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:19.163368    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:10:27.803508 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:27.803475    2567 generic.go:356] "Generic (PLEG): container finished" podID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerID="5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129" exitCode=0
Jul 15 17:10:27.803912 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:27.803541    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" event={"ID":"8cb559a0-b7f7-4826-a5e9-5211d1c1a901","Type":"ContainerDied","Data":"5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129"}
Jul 15 17:10:27.803912 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:27.803879    2567 scope.go:117] "RemoveContainer" containerID="5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129"
Jul 15 17:10:27.804800 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:27.804776    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:10:27.804852 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:27.804844    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:10:27.804887 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:27.804874    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:10:28.727362 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:28.727322    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:28.810560 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:28.810526    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" event={"ID":"8cb559a0-b7f7-4826-a5e9-5211d1c1a901","Type":"ContainerStarted","Data":"c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129"}
Jul 15 17:10:29.548062 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:29.548014    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:29.549211 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:29.549187    2567 patch_prober.go:28] interesting pod/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 15 17:10:29.549286 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:29.549239    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 15 17:10:30.547697 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:30.547665    2567 patch_prober.go:28] interesting pod/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 15 17:10:30.548078 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:30.547720    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 15 17:10:31.547206 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:31.547171    2567 patch_prober.go:28] interesting pod/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 15 17:10:31.547362 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:31.547234    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 15 17:10:32.547724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:32.547693    2567 patch_prober.go:28] interesting pod/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 15 17:10:32.548131 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:32.547740    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 15 17:10:33.551208 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:33.551179    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:33.551647 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:33.551477    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:10:33.552243 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:10:33.552227    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:11:20.862388 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:20.862356    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:11:33.658110 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.658019    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"]
Jul 15 17:11:33.658500 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.658305    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy" containerID="cri-o://c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129" gracePeriod=30
Jul 15 17:11:33.965645 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.965563    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"]
Jul 15 17:11:33.965911 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.965892    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy"
Jul 15 17:11:33.965911 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.965907    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="08aff107-aea5-4bd4-8c1b-42edc341b468" containerName="istio-proxy"
Jul 15 17:11:33.969111 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.969089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:33.972021 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.971997    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0be65efc-openshift-default-dockercfg-dk9wq\""
Jul 15 17:11:33.982253 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:33.982231    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"]
Jul 15 17:11:34.043292 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-token\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-socket\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-data\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istiod-ca-cert\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-envoy\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-podinfo\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043458    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-credential-socket\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043746 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pc8m\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-kube-api-access-7pc8m\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.043746 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.043597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-certs\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144065 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-credential-socket\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144244 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc8m\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-kube-api-access-7pc8m\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144244 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144111    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-certs\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144244 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-token\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144244 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-socket\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144244 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-data\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144510 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istiod-ca-cert\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144510 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-envoy\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144510 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-podinfo\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144510 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-credential-socket\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144736 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-certs\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144736 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-socket\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.144736 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.144686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-data\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.145034 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.145013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istiod-ca-cert\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.146594 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.146568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-envoy\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.146711 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.146694    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-podinfo\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.151873 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.151854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-token\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.152229 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.152209    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pc8m\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-kube-api-access-7pc8m\") pod \"e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") " pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.279931 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.279897    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:34.418424 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.418387    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"]
Jul 15 17:11:34.419573 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:11:34.419543    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82dc8187_b63e_4fb0_a3b4_997910c2aa93.slice/crio-a94642d9cd374f423394ff5e0adeb3e8a7144b3d9f2aa0ac5f0cd69c3a1b58ad WatchSource:0}: Error finding container a94642d9cd374f423394ff5e0adeb3e8a7144b3d9f2aa0ac5f0cd69c3a1b58ad: Status 404 returned error can't find the container with id a94642d9cd374f423394ff5e0adeb3e8a7144b3d9f2aa0ac5f0cd69c3a1b58ad
Jul 15 17:11:34.421987 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.421951    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:11:34.422067 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.422040    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:11:34.422114 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:34.422083    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:11:35.134950 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:35.134911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" event={"ID":"82dc8187-b63e-4fb0-a3b4-997910c2aa93","Type":"ContainerStarted","Data":"d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b"}
Jul 15 17:11:35.135366 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:35.134965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" event={"ID":"82dc8187-b63e-4fb0-a3b4-997910c2aa93","Type":"ContainerStarted","Data":"a94642d9cd374f423394ff5e0adeb3e8a7144b3d9f2aa0ac5f0cd69c3a1b58ad"}
Jul 15 17:11:35.160841 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:35.160783    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podStartSLOduration=2.1607563499999998 podStartE2EDuration="2.16075635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:11:35.157120904 +0000 UTC m=+1891.252059163" watchObservedRunningTime="2026-07-15 17:11:35.16075635 +0000 UTC m=+1891.255694601"
Jul 15 17:11:35.280118 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:35.280082    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:35.281730 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:35.281698    2567 patch_prober.go:28] interesting pod/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 15 17:11:35.281882 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:35.281767    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 15 17:11:36.284531 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:36.284503    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:37.145563 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:37.145529    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:37.146439 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:37.146421    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:38.907649 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.907626    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:11:38.981629 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981602    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-certs\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.981808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981646    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-data\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.981808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981673    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-token\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.981808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981689    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-envoy\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.981808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981709    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-socket\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.981808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981724    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-credential-socket\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.981808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981749    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-podinfo\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.982134 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981811    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxjfn\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-kube-api-access-cxjfn\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.982134 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981843    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istiod-ca-cert\") pod \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\" (UID: \"8cb559a0-b7f7-4826-a5e9-5211d1c1a901\") "
Jul 15 17:11:38.982134 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.981903    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:11:38.982134 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.982020    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:11:38.982368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.982209    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:38.982368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.982232    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:38.982368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.982331    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:11:38.982526 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.982396    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:11:38.982526 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.982489    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-data" (OuterVolumeSpecName: "istio-data") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:11:38.984011 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.983982    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:11:38.984256 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.984235    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-token" (OuterVolumeSpecName: "istio-token") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:11:38.984348 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.984324    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:11:38.984390 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:38.984332    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-kube-api-access-cxjfn" (OuterVolumeSpecName: "kube-api-access-cxjfn") pod "8cb559a0-b7f7-4826-a5e9-5211d1c1a901" (UID: "8cb559a0-b7f7-4826-a5e9-5211d1c1a901"). InnerVolumeSpecName "kube-api-access-cxjfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:11:39.083260 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.083233    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxjfn\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-kube-api-access-cxjfn\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:39.083260 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.083257    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:39.083260 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.083267    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:39.083486 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.083274    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:39.083486 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.083282    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:39.083486 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.083289    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:39.083486 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.083298    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb559a0-b7f7-4826-a5e9-5211d1c1a901-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:11:39.156109 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.156075    2567 generic.go:356] "Generic (PLEG): container finished" podID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerID="c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129" exitCode=0
Jul 15 17:11:39.156290 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.156128    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"
Jul 15 17:11:39.156290 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.156148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" event={"ID":"8cb559a0-b7f7-4826-a5e9-5211d1c1a901","Type":"ContainerDied","Data":"c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129"}
Jul 15 17:11:39.156290 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.156225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv" event={"ID":"8cb559a0-b7f7-4826-a5e9-5211d1c1a901","Type":"ContainerDied","Data":"47dc9fb577e0a1fbe4e60fe8223d1ac4855d86929688834a38fc62ab1e889afd"}
Jul 15 17:11:39.156290 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.156254    2567 scope.go:117] "RemoveContainer" containerID="c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129"
Jul 15 17:11:39.165906 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.165889    2567 scope.go:117] "RemoveContainer" containerID="5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129"
Jul 15 17:11:39.173423 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.173408    2567 scope.go:117] "RemoveContainer" containerID="c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129"
Jul 15 17:11:39.173663 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:11:39.173645    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129\": container with ID starting with c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129 not found: ID does not exist" containerID="c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129"
Jul 15 17:11:39.173714 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.173671    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129"} err="failed to get container status \"c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129\": rpc error: code = NotFound desc = could not find container \"c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129\": container with ID starting with c3219c1b7e6606d56a77ca48ef6ee55962c68c8ac1ff244ab5ffc9263636b129 not found: ID does not exist"
Jul 15 17:11:39.173714 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.173688    2567 scope.go:117] "RemoveContainer" containerID="5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129"
Jul 15 17:11:39.173922 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:11:39.173905    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129\": container with ID starting with 5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129 not found: ID does not exist" containerID="5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129"
Jul 15 17:11:39.173970 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.173926    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129"} err="failed to get container status \"5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129\": rpc error: code = NotFound desc = could not find container \"5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129\": container with ID starting with 5f9b87d3fd7590d24134cc83b8fc4cfb6a01b266d55ac434cad26e6170364129 not found: ID does not exist"
Jul 15 17:11:39.178541 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.178518    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"]
Jul 15 17:11:39.182435 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:39.182411    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3e01659b-openshift-default-7c956866d5-6lmmv"]
Jul 15 17:11:40.517489 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:40.513591    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" path="/var/lib/kubelet/pods/8cb559a0-b7f7-4826-a5e9-5211d1c1a901/volumes"
Jul 15 17:11:42.063921 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:42.063883    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:11:50.225020 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:50.224931    2567 generic.go:356] "Generic (PLEG): container finished" podID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerID="d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b" exitCode=0
Jul 15 17:11:50.225020 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:50.225006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" event={"ID":"82dc8187-b63e-4fb0-a3b4-997910c2aa93","Type":"ContainerDied","Data":"d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b"}
Jul 15 17:11:50.225461 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:50.225393    2567 scope.go:117] "RemoveContainer" containerID="d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b"
Jul 15 17:11:50.226407 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:50.226379    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:11:50.226477 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:50.226461    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:11:50.226523 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:50.226509    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:11:51.232223 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:51.232184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" event={"ID":"82dc8187-b63e-4fb0-a3b4-997910c2aa93","Type":"ContainerStarted","Data":"6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000"}
Jul 15 17:11:51.280768 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:51.280655    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:51.282511 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:51.282461    2567 patch_prober.go:28] interesting pod/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 15 17:11:51.282748 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:51.282723    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 15 17:11:52.146380 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:52.146321    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:52.281322 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:52.281284    2567 patch_prober.go:28] interesting pod/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 15 17:11:52.281944 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:52.281906    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 15 17:11:53.280866 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:53.280821    2567 patch_prober.go:28] interesting pod/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 15 17:11:53.281080 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:53.280897    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 15 17:11:54.281276 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:54.281235    2567 patch_prober.go:28] interesting pod/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 15 17:11:54.281807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:54.281306    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 15 17:11:55.284169 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:55.284128    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:11:55.285018 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:11:55.285002    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:12:42.762091 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:12:42.762054    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:12:54.845093 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:12:54.845054    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"]
Jul 15 17:12:54.845537 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:12:54.845301    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy" containerID="cri-o://6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000" gracePeriod=30
Jul 15 17:12:55.287212 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:12:55.287175    2567 patch_prober.go:28] interesting pod/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 17:12:55.287374 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:12:55.287249    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 17:13:00.101425 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.101399    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:13:00.189143 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189114    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-token\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189143 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189203    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-data\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189242    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-certs\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189279    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pc8m\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-kube-api-access-7pc8m\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189315    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-podinfo\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-socket\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189390    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-credential-socket\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-envoy\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189471    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istiod-ca-cert\") pod \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\" (UID: \"82dc8187-b63e-4fb0-a3b4-997910c2aa93\") "
Jul 15 17:13:00.189824 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189695    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:13:00.189824 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189796    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.190041 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.190018    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:13:00.190200 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.189868    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:13:00.190325 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.190305    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-data" (OuterVolumeSpecName: "istio-data") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:13:00.190501 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.190458    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:13:00.191560 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.191535    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-token" (OuterVolumeSpecName: "istio-token") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:13:00.191696 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.191676    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-kube-api-access-7pc8m" (OuterVolumeSpecName: "kube-api-access-7pc8m") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "kube-api-access-7pc8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:13:00.192014 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.191990    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:13:00.192137 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.192114    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82dc8187-b63e-4fb0-a3b4-997910c2aa93" (UID: "82dc8187-b63e-4fb0-a3b4-997910c2aa93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:13:00.291015 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.290982    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pc8m\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-kube-api-access-7pc8m\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.291015 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.291009    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.291015 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.291019    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.291282 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.291028    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.291282 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.291037    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.291282 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.291045    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.291282 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.291052    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.291282 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.291061    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82dc8187-b63e-4fb0-a3b4-997910c2aa93-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:13:00.569542 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.569515    2567 generic.go:356] "Generic (PLEG): container finished" podID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerID="6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000" exitCode=0
Jul 15 17:13:00.569706 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.569582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" event={"ID":"82dc8187-b63e-4fb0-a3b4-997910c2aa93","Type":"ContainerDied","Data":"6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000"}
Jul 15 17:13:00.569706 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.569596    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"
Jul 15 17:13:00.569706 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.569628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh" event={"ID":"82dc8187-b63e-4fb0-a3b4-997910c2aa93","Type":"ContainerDied","Data":"a94642d9cd374f423394ff5e0adeb3e8a7144b3d9f2aa0ac5f0cd69c3a1b58ad"}
Jul 15 17:13:00.569706 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.569651    2567 scope.go:117] "RemoveContainer" containerID="6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000"
Jul 15 17:13:00.578977 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.578958    2567 scope.go:117] "RemoveContainer" containerID="d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b"
Jul 15 17:13:00.587004 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.586979    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"]
Jul 15 17:13:00.587488 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.587469    2567 scope.go:117] "RemoveContainer" containerID="6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000"
Jul 15 17:13:00.587766 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:13:00.587748    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000\": container with ID starting with 6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000 not found: ID does not exist" containerID="6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000"
Jul 15 17:13:00.587844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.587777    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000"} err="failed to get container status \"6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000\": rpc error: code = NotFound desc = could not find container \"6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000\": container with ID starting with 6343c94b9a883d1df7a660b3ecec41b26b6eeea4be14af3c2c21a343b329e000 not found: ID does not exist"
Jul 15 17:13:00.587844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.587800    2567 scope.go:117] "RemoveContainer" containerID="d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b"
Jul 15 17:13:00.588246 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:13:00.588221    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b\": container with ID starting with d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b not found: ID does not exist" containerID="d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b"
Jul 15 17:13:00.588387 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.588255    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b"} err="failed to get container status \"d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b\": rpc error: code = NotFound desc = could not find container \"d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b\": container with ID starting with d41c8ca1681046d2ff5f5864a67d282cc6a519b3f8d1d003fb70b92274c7722b not found: ID does not exist"
Jul 15 17:13:00.590564 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:00.590545    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0be65efc-openshift-default-58cdfc4779-t92kh"]
Jul 15 17:13:02.511940 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:13:02.511906    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" path="/var/lib/kubelet/pods/82dc8187-b63e-4fb0-a3b4-997910c2aa93/volumes"
Jul 15 17:14:17.962266 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:17.962232    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:14:27.160544 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:27.160467    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:14:31.179631 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179601    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"]
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179917    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy"
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179928    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy"
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179941    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy"
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179946    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy"
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179954    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy"
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179961    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy"
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179970    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy"
Jul 15 17:14:31.179991 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.179976    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy"
Jul 15 17:14:31.180293 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.180029    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy"
Jul 15 17:14:31.180293 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.180036    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy"
Jul 15 17:14:31.180293 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.180041    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="82dc8187-b63e-4fb0-a3b4-997910c2aa93" containerName="istio-proxy"
Jul 15 17:14:31.180293 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.180049    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cb559a0-b7f7-4826-a5e9-5211d1c1a901" containerName="istio-proxy"
Jul 15 17:14:31.183073 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.183056    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.185597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.185576    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-68500967-openshift-default-dockercfg-qh7nh\""
Jul 15 17:14:31.200458 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.200435    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"]
Jul 15 17:14:31.271271 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-podinfo\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271478 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-249px\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-kube-api-access-249px\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271478 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-socket\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271478 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-token\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271478 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-credential-socket\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271478 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-envoy\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271478 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-certs\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271715 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istiod-ca-cert\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.271715 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.271642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-data\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372034 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.371999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istiod-ca-cert\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372045    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-data\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-podinfo\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-249px\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-kube-api-access-249px\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-socket\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372135    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-token\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372185    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-credential-socket\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-envoy\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372264 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-certs\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372667 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372550    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-socket\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372667 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372565    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-data\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372760 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-certs\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372760 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372739    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-credential-socket\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.372874 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.372856    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istiod-ca-cert\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.374602 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.374581    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-podinfo\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.374682 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.374612    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-envoy\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.382999 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.382975    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-token\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.383113 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.383031    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-249px\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-kube-api-access-249px\") pod \"e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") " pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.492582 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.492503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:31.627147 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.627121    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"]
Jul 15 17:14:31.628637 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:14:31.628614    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7bd783_5bf0_4f4c_8b8c_0f4355b5d04c.slice/crio-ac88da6f9e1fb633b9f1a8daf6682a260024dab047a4ebcdd3a6adeb07178338 WatchSource:0}: Error finding container ac88da6f9e1fb633b9f1a8daf6682a260024dab047a4ebcdd3a6adeb07178338: Status 404 returned error can't find the container with id ac88da6f9e1fb633b9f1a8daf6682a260024dab047a4ebcdd3a6adeb07178338
Jul 15 17:14:31.630708 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.630677    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:14:31.630774 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.630762    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:14:31.630810 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:31.630802    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:14:32.017075 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:32.017041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" event={"ID":"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c","Type":"ContainerStarted","Data":"4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d"}
Jul 15 17:14:32.017269 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:32.017093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" event={"ID":"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c","Type":"ContainerStarted","Data":"ac88da6f9e1fb633b9f1a8daf6682a260024dab047a4ebcdd3a6adeb07178338"}
Jul 15 17:14:32.041053 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:32.041001    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" podStartSLOduration=1.040985813 podStartE2EDuration="1.040985813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:14:32.038094155 +0000 UTC m=+2068.133032400" watchObservedRunningTime="2026-07-15 17:14:32.040985813 +0000 UTC m=+2068.135924128"
Jul 15 17:14:32.492694 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:32.492602    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:32.497817 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:32.497791    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:33.022139 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:33.022105    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:33.022986 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:33.022968    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:39.567452 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:39.567419    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:14:48.023622 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.023585    2567 patch_prober.go:28] interesting pod/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 17:14:48.024091 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.023661    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 17:14:48.097664 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.097633    2567 generic.go:356] "Generic (PLEG): container finished" podID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerID="4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d" exitCode=0
Jul 15 17:14:48.097854 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.097710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" event={"ID":"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c","Type":"ContainerDied","Data":"4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d"}
Jul 15 17:14:48.098178 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.098132    2567 scope.go:117] "RemoveContainer" containerID="4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d"
Jul 15 17:14:48.099136 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.099109    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:14:48.099209 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.099197    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:14:48.099247 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:48.099230    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:14:49.105875 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:49.105840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" event={"ID":"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c","Type":"ContainerStarted","Data":"0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8"}
Jul 15 17:14:49.493042 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:49.492944    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:49.493451 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:49.493359    2567 patch_prober.go:28] interesting pod/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 17:14:49.493641 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:49.493619    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 17:14:50.493944 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:50.493904    2567 patch_prober.go:28] interesting pod/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 17:14:50.494538 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:50.494506    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 17:14:51.493009 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:51.492962    2567 patch_prober.go:28] interesting pod/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 17:14:51.493249 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:51.493035    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 17:14:52.493762 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:52.493718    2567 patch_prober.go:28] interesting pod/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 15 17:14:52.494294 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:52.493813    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 15 17:14:53.497312 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:53.497275    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:53.497784 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:53.497691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:53.498324 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:53.498306    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:14:58.861010 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:14:58.860974    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:15:04.523518 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:04.523490    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:15:04.532143 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:04.532121    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:15:11.307390 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:11.307350    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"]
Jul 15 17:15:11.307869 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:11.307569    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy" containerID="cri-o://0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8" gracePeriod=30
Jul 15 17:15:16.566247 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.566218    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:15:16.571199 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571175    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-249px\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-kube-api-access-249px\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571336 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571205    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-socket\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571336 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571240    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-data\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571336 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571259    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-token\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571336 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571293    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-certs\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571336 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571311    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-credential-socket\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571588 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571337    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istiod-ca-cert\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571588 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571398    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-podinfo\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571588 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571424    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-envoy\") pod \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\" (UID: \"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c\") "
Jul 15 17:15:16.571752 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571679    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:15:16.571752 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571700    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:15:16.571938 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.571912    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:15:16.572044 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.572015    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:15:16.572409 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.572384    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:15:16.573514 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.573446    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-kube-api-access-249px" (OuterVolumeSpecName: "kube-api-access-249px") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "kube-api-access-249px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:15:16.573636 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.573621    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:15:16.573764 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.573750    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:15:16.573812 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.573799    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" (UID: "7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:15:16.672596 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672560    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672596 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672590    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672596 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672603    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672611    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672619    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672629    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-249px\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-kube-api-access-249px\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672637    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672645    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:16.672844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:16.672652    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:15:17.248422 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.248381    2567 generic.go:356] "Generic (PLEG): container finished" podID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerID="0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8" exitCode=0
Jul 15 17:15:17.248600 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.248428    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"
Jul 15 17:15:17.248600 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.248458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" event={"ID":"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c","Type":"ContainerDied","Data":"0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8"}
Jul 15 17:15:17.248600 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.248512    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2" event={"ID":"7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c","Type":"ContainerDied","Data":"ac88da6f9e1fb633b9f1a8daf6682a260024dab047a4ebcdd3a6adeb07178338"}
Jul 15 17:15:17.248600 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.248536    2567 scope.go:117] "RemoveContainer" containerID="0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8"
Jul 15 17:15:17.257864 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.257850    2567 scope.go:117] "RemoveContainer" containerID="4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d"
Jul 15 17:15:17.266235 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.266214    2567 scope.go:117] "RemoveContainer" containerID="0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8"
Jul 15 17:15:17.266484 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:15:17.266467    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8\": container with ID starting with 0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8 not found: ID does not exist" containerID="0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8"
Jul 15 17:15:17.266536 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.266491    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8"} err="failed to get container status \"0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8\": rpc error: code = NotFound desc = could not find container \"0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8\": container with ID starting with 0da88235c45913dac84233928367de46e41070d772dbf11ad55b06a64aa45da8 not found: ID does not exist"
Jul 15 17:15:17.266536 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.266510    2567 scope.go:117] "RemoveContainer" containerID="4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d"
Jul 15 17:15:17.266747 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:15:17.266733    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d\": container with ID starting with 4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d not found: ID does not exist" containerID="4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d"
Jul 15 17:15:17.266789 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.266750    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d"} err="failed to get container status \"4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d\": rpc error: code = NotFound desc = could not find container \"4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d\": container with ID starting with 4da5beb15bb921262f59ddb1f85f0e7427a59957849fdfe171485b5a7062251d not found: ID does not exist"
Jul 15 17:15:17.270515 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.270495    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"]
Jul 15 17:15:17.275478 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:17.275459    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-68500967-openshift-default-65dbd44f6c-gwtd2"]
Jul 15 17:15:18.511799 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:18.511766    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" path="/var/lib/kubelet/pods/7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c/volumes"
Jul 15 17:15:30.575775 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.575741    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"]
Jul 15 17:15:30.576277 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.576094    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy"
Jul 15 17:15:30.576277 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.576106    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy"
Jul 15 17:15:30.576277 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.576116    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy"
Jul 15 17:15:30.576277 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.576121    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy"
Jul 15 17:15:30.576277 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.576198    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy"
Jul 15 17:15:30.576277 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.576207    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f7bd783-5bf0-4f4c-8b8c-0f4355b5d04c" containerName="istio-proxy"
Jul 15 17:15:30.579181 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.579149    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.581813 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.581789    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1858e64a-openshift-default-dockercfg-6hqzh\""
Jul 15 17:15:30.592024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.592003    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"]
Jul 15 17:15:30.701939 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.701902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-certs\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.701939 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.701940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmlb6\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-kube-api-access-pmlb6\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.702180 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.701978    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-socket\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.702180 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.702044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-envoy\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.702180 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.702087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-credential-socket\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.702180 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.702129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-data\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.702180 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.702145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85437fad-336d-4490-be90-124090060e0c-istio-podinfo\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.702354 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.702258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85437fad-336d-4490-be90-124090060e0c-istiod-ca-cert\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.702354 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.702284    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-istio-token\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.802949 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.802912    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-envoy\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.802949 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.802953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-credential-socket\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.802982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-data\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85437fad-336d-4490-be90-124090060e0c-istio-podinfo\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85437fad-336d-4490-be90-124090060e0c-istiod-ca-cert\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803098    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-istio-token\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803125    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-certs\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803147    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmlb6\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-kube-api-access-pmlb6\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-socket\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803618 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-data\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803618 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-credential-socket\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803618 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803529    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-socket\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803780 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-certs\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.803998 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.803975    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85437fad-336d-4490-be90-124090060e0c-istiod-ca-cert\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.805366 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.805342    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-envoy\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.805553 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.805534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85437fad-336d-4490-be90-124090060e0c-istio-podinfo\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.811349 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.811326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-istio-token\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.811949 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.811922    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmlb6\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-kube-api-access-pmlb6\") pod \"e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") " pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:30.889661 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:30.889566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:31.034495 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.034471    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"]
Jul 15 17:15:31.036623 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:15:31.036597    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85437fad_336d_4490_be90_124090060e0c.slice/crio-9df63d7120b3185970210fef9c06cf78f7136abeb61595f2ae0193886f1c44cc WatchSource:0}: Error finding container 9df63d7120b3185970210fef9c06cf78f7136abeb61595f2ae0193886f1c44cc: Status 404 returned error can't find the container with id 9df63d7120b3185970210fef9c06cf78f7136abeb61595f2ae0193886f1c44cc
Jul 15 17:15:31.038774 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.038740    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:15:31.038854 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.038820    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:15:31.038893 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.038859    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:15:31.320323 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.320289    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" event={"ID":"85437fad-336d-4490-be90-124090060e0c","Type":"ContainerStarted","Data":"3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e"}
Jul 15 17:15:31.320518 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.320344    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" event={"ID":"85437fad-336d-4490-be90-124090060e0c","Type":"ContainerStarted","Data":"9df63d7120b3185970210fef9c06cf78f7136abeb61595f2ae0193886f1c44cc"}
Jul 15 17:15:31.341366 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.341315    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" podStartSLOduration=1.341297028 podStartE2EDuration="1.341297028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:15:31.339751315 +0000 UTC m=+2127.434689561" watchObservedRunningTime="2026-07-15 17:15:31.341297028 +0000 UTC m=+2127.436235275"
Jul 15 17:15:31.889693 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:31.889659    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:32.895607 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:32.895579    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:33.332142 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:33.332110    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:33.333238 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:33.333214    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:35.960262 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:35.960225    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:15:44.028257 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.028219    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"]
Jul 15 17:15:44.030848 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.030825    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.034445 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.034417    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1858e64a\"/\"kube-root-ca.crt\""
Jul 15 17:15:44.034569 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.034458    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1858e64a\"/\"default-dockercfg-d6lnv\""
Jul 15 17:15:44.034569 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.034481    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1858e64a\"/\"openshift-service-ca.crt\""
Jul 15 17:15:44.034569 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.034485    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1858e64a\"/\"e2e-lifecycle-model-1858e64a-kserve-self-signed-certs\""
Jul 15 17:15:44.042080 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.042052    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"]
Jul 15 17:15:44.135887 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.135792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-tmp-dir\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.135887 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.135833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbt95\" (UniqueName: \"kubernetes.io/projected/e4f15c64-010a-451e-9342-0e418df1f9a8-kube-api-access-cbt95\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.135887 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.135867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f15c64-010a-451e-9342-0e418df1f9a8-tls-certs\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.136190 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.135917    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-home\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.136190 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.135970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-dshm\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.136190 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.135994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-model-cache\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237314 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-dshm\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237314 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-model-cache\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237562 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-tmp-dir\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237562 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbt95\" (UniqueName: \"kubernetes.io/projected/e4f15c64-010a-451e-9342-0e418df1f9a8-kube-api-access-cbt95\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237562 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f15c64-010a-451e-9342-0e418df1f9a8-tls-certs\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237562 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237445    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-home\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237779 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-tmp-dir\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237837 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-model-cache\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.237837 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.237798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-home\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.239623 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.239601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-dshm\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.239879 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.239791    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f15c64-010a-451e-9342-0e418df1f9a8-tls-certs\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.246795 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.246773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbt95\" (UniqueName: \"kubernetes.io/projected/e4f15c64-010a-451e-9342-0e418df1f9a8-kube-api-access-cbt95\") pod \"e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") " pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.340542 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.340507    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:44.395603 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.395568    2567 generic.go:356] "Generic (PLEG): container finished" podID="85437fad-336d-4490-be90-124090060e0c" containerID="3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e" exitCode=0
Jul 15 17:15:44.395737 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.395625    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" event={"ID":"85437fad-336d-4490-be90-124090060e0c","Type":"ContainerDied","Data":"3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e"}
Jul 15 17:15:44.396061 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.396040    2567 scope.go:117] "RemoveContainer" containerID="3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e"
Jul 15 17:15:44.397235 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.397202    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:15:44.397330 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.397292    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:15:44.397392 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.397340    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:15:44.500502 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:44.500471    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"]
Jul 15 17:15:44.501898 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:15:44.501873    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4f15c64_010a_451e_9342_0e418df1f9a8.slice/crio-47b7df09c92febd3bde6362d59143f4fc31b039bb069429526b54e51ee166e57 WatchSource:0}: Error finding container 47b7df09c92febd3bde6362d59143f4fc31b039bb069429526b54e51ee166e57: Status 404 returned error can't find the container with id 47b7df09c92febd3bde6362d59143f4fc31b039bb069429526b54e51ee166e57
Jul 15 17:15:45.405113 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:45.405070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" event={"ID":"85437fad-336d-4490-be90-124090060e0c","Type":"ContainerStarted","Data":"98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3"}
Jul 15 17:15:45.406574 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:45.406549    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj" event={"ID":"e4f15c64-010a-451e-9342-0e418df1f9a8","Type":"ContainerStarted","Data":"2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33"}
Jul 15 17:15:45.406687 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:45.406586    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj" event={"ID":"e4f15c64-010a-451e-9342-0e418df1f9a8","Type":"ContainerStarted","Data":"47b7df09c92febd3bde6362d59143f4fc31b039bb069429526b54e51ee166e57"}
Jul 15 17:15:45.442922 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:45.442873    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj" podStartSLOduration=1.442853958 podStartE2EDuration="1.442853958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:15:45.441591054 +0000 UTC m=+2141.536529298" watchObservedRunningTime="2026-07-15 17:15:45.442853958 +0000 UTC m=+2141.537792203"
Jul 15 17:15:45.892043 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:45.890565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:45.892744 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:45.892402    2567 patch_prober.go:28] interesting pod/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 17:15:45.892744 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:45.892457    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 17:15:46.656858 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:46.656815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:15:46.890690 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:46.890643    2567 patch_prober.go:28] interesting pod/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 17:15:46.890910 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:46.890713    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 17:15:47.890864 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:47.890823    2567 patch_prober.go:28] interesting pod/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 17:15:47.891514 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:47.891478    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 17:15:48.332241 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:48.332200    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:48.890597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:48.890559    2567 patch_prober.go:28] interesting pod/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 15 17:15:48.890940 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:48.890910    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 15 17:15:49.894335 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:49.894301    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:49.895238 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:49.895223    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:15:54.340970 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:54.340915    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:54.340970 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:54.340977    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:54.353390 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:54.353359    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:15:54.463122 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:15:54.463097    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:16:24.967735 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:16:24.967695    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:16:45.259686 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:16:45.259652    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:16:51.434514 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:16:51.434474    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"]
Jul 15 17:17:06.455299 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.455225    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj" podUID="e4f15c64-010a-451e-9342-0e418df1f9a8" containerName="main" containerID="cri-o://2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33" gracePeriod=45
Jul 15 17:17:06.710429 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.710373    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:17:06.771463 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.771431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-dshm\") pod \"e4f15c64-010a-451e-9342-0e418df1f9a8\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") "
Jul 15 17:17:06.771463 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.771468    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f15c64-010a-451e-9342-0e418df1f9a8-tls-certs\") pod \"e4f15c64-010a-451e-9342-0e418df1f9a8\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") "
Jul 15 17:17:06.771711 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.771530    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-tmp-dir\") pod \"e4f15c64-010a-451e-9342-0e418df1f9a8\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") "
Jul 15 17:17:06.771711 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.771554    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbt95\" (UniqueName: \"kubernetes.io/projected/e4f15c64-010a-451e-9342-0e418df1f9a8-kube-api-access-cbt95\") pod \"e4f15c64-010a-451e-9342-0e418df1f9a8\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") "
Jul 15 17:17:06.771711 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.771628    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-home\") pod \"e4f15c64-010a-451e-9342-0e418df1f9a8\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") "
Jul 15 17:17:06.771711 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.771668    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-model-cache\") pod \"e4f15c64-010a-451e-9342-0e418df1f9a8\" (UID: \"e4f15c64-010a-451e-9342-0e418df1f9a8\") "
Jul 15 17:17:06.771962 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.771917    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-home" (OuterVolumeSpecName: "home") pod "e4f15c64-010a-451e-9342-0e418df1f9a8" (UID: "e4f15c64-010a-451e-9342-0e418df1f9a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:06.772112 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.772090    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4f15c64-010a-451e-9342-0e418df1f9a8" (UID: "e4f15c64-010a-451e-9342-0e418df1f9a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:06.772112 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.772104    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4f15c64-010a-451e-9342-0e418df1f9a8" (UID: "e4f15c64-010a-451e-9342-0e418df1f9a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:06.773826 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.773798    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f15c64-010a-451e-9342-0e418df1f9a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4f15c64-010a-451e-9342-0e418df1f9a8" (UID: "e4f15c64-010a-451e-9342-0e418df1f9a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:17:06.774068 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.774039    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f15c64-010a-451e-9342-0e418df1f9a8-kube-api-access-cbt95" (OuterVolumeSpecName: "kube-api-access-cbt95") pod "e4f15c64-010a-451e-9342-0e418df1f9a8" (UID: "e4f15c64-010a-451e-9342-0e418df1f9a8"). InnerVolumeSpecName "kube-api-access-cbt95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:17:06.774186 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.774099    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-dshm" (OuterVolumeSpecName: "dshm") pod "e4f15c64-010a-451e-9342-0e418df1f9a8" (UID: "e4f15c64-010a-451e-9342-0e418df1f9a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:06.820238 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.820204    2567 generic.go:356] "Generic (PLEG): container finished" podID="e4f15c64-010a-451e-9342-0e418df1f9a8" containerID="2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33" exitCode=0
Jul 15 17:17:06.820439 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.820257    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"
Jul 15 17:17:06.820439 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.820291    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj" event={"ID":"e4f15c64-010a-451e-9342-0e418df1f9a8","Type":"ContainerDied","Data":"2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33"}
Jul 15 17:17:06.820439 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.820342    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj" event={"ID":"e4f15c64-010a-451e-9342-0e418df1f9a8","Type":"ContainerDied","Data":"47b7df09c92febd3bde6362d59143f4fc31b039bb069429526b54e51ee166e57"}
Jul 15 17:17:06.820439 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.820366    2567 scope.go:117] "RemoveContainer" containerID="2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33"
Jul 15 17:17:06.829244 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.829227    2567 scope.go:117] "RemoveContainer" containerID="2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33"
Jul 15 17:17:06.829525 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:17:06.829505    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33\": container with ID starting with 2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33 not found: ID does not exist" containerID="2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33"
Jul 15 17:17:06.829602 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.829535    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33"} err="failed to get container status \"2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33\": rpc error: code = NotFound desc = could not find container \"2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33\": container with ID starting with 2d189acf25aa47f17a8f22bf76b25a426123d3d789bdb6a9315e1ef29f684e33 not found: ID does not exist"
Jul 15 17:17:06.840574 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.840545    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"]
Jul 15 17:17:06.843520 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.843497    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-1858e64a/e2e-lifecycle-model-1858e64a-kserve-69bc9c7779-7v6mj"]
Jul 15 17:17:06.872771 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.872744    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-tmp-dir\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:06.872771 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.872769    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbt95\" (UniqueName: \"kubernetes.io/projected/e4f15c64-010a-451e-9342-0e418df1f9a8-kube-api-access-cbt95\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:06.872960 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.872779    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-home\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:06.872960 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.872792    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-model-cache\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:06.872960 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.872800    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4f15c64-010a-451e-9342-0e418df1f9a8-dshm\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:06.872960 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:06.872810    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4f15c64-010a-451e-9342-0e418df1f9a8-tls-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:08.511905 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:08.511868    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4f15c64-010a-451e-9342-0e418df1f9a8" path="/var/lib/kubelet/pods/e4f15c64-010a-451e-9342-0e418df1f9a8/volumes"
Jul 15 17:17:48.679892 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:48.679853    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"]
Jul 15 17:17:48.680447 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:48.680139    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy" containerID="cri-o://98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3" gracePeriod=30
Jul 15 17:17:49.897603 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:49.897566    2567 patch_prober.go:28] interesting pod/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 17:17:49.898061 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:49.897632    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 17:17:53.066312 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.066277    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:17:53.937698 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.937673    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:17:53.981077 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.980995    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85437fad-336d-4490-be90-124090060e0c-istio-podinfo\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981077 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981043    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-certs\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981077 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981068    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-envoy\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981087    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-credential-socket\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981111    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-socket\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981145    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmlb6\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-kube-api-access-pmlb6\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-data\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981244    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-istio-token\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981268    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85437fad-336d-4490-be90-124090060e0c-istiod-ca-cert\") pod \"85437fad-336d-4490-be90-124090060e0c\" (UID: \"85437fad-336d-4490-be90-124090060e0c\") "
Jul 15 17:17:53.981669 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981548    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:53.981828 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981789    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:53.981911 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981822    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85437fad-336d-4490-be90-124090060e0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:17:53.981962 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.981898    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:53.982755 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.982731    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:53.983774 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.983747    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-kube-api-access-pmlb6" (OuterVolumeSpecName: "kube-api-access-pmlb6") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "kube-api-access-pmlb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:17:53.983868 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.983768    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:17:53.983868 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.983768    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85437fad-336d-4490-be90-124090060e0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:17:53.984006 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:53.983885    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "85437fad-336d-4490-be90-124090060e0c" (UID: "85437fad-336d-4490-be90-124090060e0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:17:54.051373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.051336    2567 generic.go:356] "Generic (PLEG): container finished" podID="85437fad-336d-4490-be90-124090060e0c" containerID="98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3" exitCode=0
Jul 15 17:17:54.051540 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.051378    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" event={"ID":"85437fad-336d-4490-be90-124090060e0c","Type":"ContainerDied","Data":"98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3"}
Jul 15 17:17:54.051540 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.051435    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw" event={"ID":"85437fad-336d-4490-be90-124090060e0c","Type":"ContainerDied","Data":"9df63d7120b3185970210fef9c06cf78f7136abeb61595f2ae0193886f1c44cc"}
Jul 15 17:17:54.051540 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.051390    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"
Jul 15 17:17:54.051540 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.051456    2567 scope.go:117] "RemoveContainer" containerID="98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3"
Jul 15 17:17:54.062045 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.062020    2567 scope.go:117] "RemoveContainer" containerID="3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e"
Jul 15 17:17:54.070400 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.070381    2567 scope.go:117] "RemoveContainer" containerID="98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3"
Jul 15 17:17:54.070690 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:17:54.070672    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3\": container with ID starting with 98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3 not found: ID does not exist" containerID="98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3"
Jul 15 17:17:54.070743 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.070699    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3"} err="failed to get container status \"98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3\": rpc error: code = NotFound desc = could not find container \"98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3\": container with ID starting with 98a1ebc3ed2a3bf3874fd26c32dfd6efbae3ab36dca96d3bd03d5b2de4e691a3 not found: ID does not exist"
Jul 15 17:17:54.070743 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.070717    2567 scope.go:117] "RemoveContainer" containerID="3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e"
Jul 15 17:17:54.070959 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:17:54.070941    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e\": container with ID starting with 3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e not found: ID does not exist" containerID="3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e"
Jul 15 17:17:54.071002 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.070965    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e"} err="failed to get container status \"3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e\": rpc error: code = NotFound desc = could not find container \"3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e\": container with ID starting with 3fc876889536ffe3bbfe51d25ff3683c8304e0a2de681b02aa5b6c62c4d8430e not found: ID does not exist"
Jul 15 17:17:54.076006 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.075983    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"]
Jul 15 17:17:54.080491 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.080471    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1858e64a-openshift-default-77f658b76c-5ghbw"]
Jul 15 17:17:54.081925 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081910    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.081979 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081929    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.081979 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081938    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.081979 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081948    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.081979 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081957    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmlb6\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-kube-api-access-pmlb6\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.081979 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081967    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85437fad-336d-4490-be90-124090060e0c-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.081979 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081975    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85437fad-336d-4490-be90-124090060e0c-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.082198 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081983    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85437fad-336d-4490-be90-124090060e0c-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.082198 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.081990    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85437fad-336d-4490-be90-124090060e0c-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:17:54.517883 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:17:54.517850    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85437fad-336d-4490-be90-124090060e0c" path="/var/lib/kubelet/pods/85437fad-336d-4490-be90-124090060e0c/volumes"
Jul 15 17:18:06.460648 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:06.460604    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:18:42.969786 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.969749    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"]
Jul 15 17:18:42.971089 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971064    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f15c64-010a-451e-9342-0e418df1f9a8" containerName="main"
Jul 15 17:18:42.971259 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971246    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f15c64-010a-451e-9342-0e418df1f9a8" containerName="main"
Jul 15 17:18:42.971367 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971357    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy"
Jul 15 17:18:42.971439 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971431    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy"
Jul 15 17:18:42.971545 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971535    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy"
Jul 15 17:18:42.971614 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971606    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy"
Jul 15 17:18:42.971863 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971851    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f15c64-010a-451e-9342-0e418df1f9a8" containerName="main"
Jul 15 17:18:42.971958 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.971949    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy"
Jul 15 17:18:42.976293 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.976266    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:42.978727 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.978691    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-53dfff-openshift-default-dockercfg-6sjnb\""
Jul 15 17:18:42.982199 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:42.982179    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"]
Jul 15 17:18:43.100241 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-data\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100437 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-credential-socket\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100437 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-envoy\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100437 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100317    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-socket\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100437 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73eec9e3-2463-4a05-845f-e6d32da3bb51-istiod-ca-cert\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100437 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100389    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-podinfo\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100644 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-token\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100644 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-certs\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.100644 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.100498    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zrm9\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-kube-api-access-7zrm9\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201491 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-data\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201689 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201506    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-credential-socket\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201689 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-envoy\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201689 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-socket\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201689 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73eec9e3-2463-4a05-845f-e6d32da3bb51-istiod-ca-cert\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201689 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201621    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-podinfo\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201689 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-token\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.201689 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-certs\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.202040 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zrm9\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-kube-api-access-7zrm9\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.202040 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201919    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-data\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.202040 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.201987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-socket\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.202221 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.202188    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-credential-socket\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.202400 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.202374    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-certs\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.202400 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.202385    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73eec9e3-2463-4a05-845f-e6d32da3bb51-istiod-ca-cert\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.203831 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.203810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-envoy\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.204052 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.204034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-podinfo\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.209504 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.209478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-token\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.209584 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.209564    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zrm9\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-kube-api-access-7zrm9\") pod \"e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") " pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.287707 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.287676    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:43.423842 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.423799    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"]
Jul 15 17:18:43.425978 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:18:43.425951    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73eec9e3_2463_4a05_845f_e6d32da3bb51.slice/crio-1bca675e14bdd58e248609e9200e1095578029b302d707ec88d733193c29b0e0 WatchSource:0}: Error finding container 1bca675e14bdd58e248609e9200e1095578029b302d707ec88d733193c29b0e0: Status 404 returned error can't find the container with id 1bca675e14bdd58e248609e9200e1095578029b302d707ec88d733193c29b0e0
Jul 15 17:18:43.428395 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.428364    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:18:43.428485 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.428462    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:18:43.428556 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:43.428506    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:18:44.297576 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:44.297541    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" event={"ID":"73eec9e3-2463-4a05-845f-e6d32da3bb51","Type":"ContainerStarted","Data":"65949ef5a92a07773feaddd3f158c5f4d2846e81b2fee8b2214e757321d3f6a8"}
Jul 15 17:18:44.297958 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:44.297603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" event={"ID":"73eec9e3-2463-4a05-845f-e6d32da3bb51","Type":"ContainerStarted","Data":"1bca675e14bdd58e248609e9200e1095578029b302d707ec88d733193c29b0e0"}
Jul 15 17:18:44.319985 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:44.319936    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" podStartSLOduration=2.319915827 podStartE2EDuration="2.319915827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:18:44.318916192 +0000 UTC m=+2320.413854437" watchObservedRunningTime="2026-07-15 17:18:44.319915827 +0000 UTC m=+2320.414854073"
Jul 15 17:18:45.288724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:45.288682    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:45.293481 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:45.293459    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:45.302393 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:45.302366    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:45.303075 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:45.303057    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:18:51.319308 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.319274    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"]
Jul 15 17:18:51.319884 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.319666    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="85437fad-336d-4490-be90-124090060e0c" containerName="istio-proxy"
Jul 15 17:18:51.322763 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.322734    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.325210 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.325188    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c6b351-openshift-default-dockercfg-857xs\""
Jul 15 17:18:51.334749 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.334723    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"]
Jul 15 17:18:51.361654 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-certs\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.361807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-socket\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.361807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-podinfo\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.361807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-data\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.361807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361778    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-credential-socket\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.362029 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-envoy\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.362029 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-token\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.362029 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361893    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz8td\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-kube-api-access-xz8td\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.362029 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.361940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istiod-ca-cert\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463179 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-certs\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463179 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-socket\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463409 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-podinfo\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463409 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-data\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463409 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-credential-socket\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463568 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-envoy\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463568 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-token\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463568 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463520    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz8td\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-kube-api-access-xz8td\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463568 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463556    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-certs\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463744 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istiod-ca-cert\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.463744 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463596    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-socket\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.464148 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-credential-socket\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.464148 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.463805    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-data\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.464300 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.464184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istiod-ca-cert\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.465665 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.465638    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-envoy\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.465794 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.465777    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-podinfo\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.470637 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.470612    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz8td\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-kube-api-access-xz8td\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.470739 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.470642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-token\") pod \"e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") " pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.635372 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.635289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:51.769663 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.769635    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"]
Jul 15 17:18:51.770601 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:18:51.770574    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfaf3ec0_92e0_4981_aaab_b27e1e41d193.slice/crio-34a69c7b67c79ebee0bc443036561c782385d638208952736b2ba5b4627e5f60 WatchSource:0}: Error finding container 34a69c7b67c79ebee0bc443036561c782385d638208952736b2ba5b4627e5f60: Status 404 returned error can't find the container with id 34a69c7b67c79ebee0bc443036561c782385d638208952736b2ba5b4627e5f60
Jul 15 17:18:51.772803 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.772765    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:18:51.772866 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.772850    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:18:51.772904 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:51.772890    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:18:52.337911 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:52.337850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" event={"ID":"bfaf3ec0-92e0-4981-aaab-b27e1e41d193","Type":"ContainerStarted","Data":"4236fa921ac8a2e114aa355824a2bc37663ea5c9e432aeb4a23570811e148efc"}
Jul 15 17:18:52.338294 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:52.337928    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" event={"ID":"bfaf3ec0-92e0-4981-aaab-b27e1e41d193","Type":"ContainerStarted","Data":"34a69c7b67c79ebee0bc443036561c782385d638208952736b2ba5b4627e5f60"}
Jul 15 17:18:52.358983 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:52.358940    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" podStartSLOduration=1.358925127 podStartE2EDuration="1.358925127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:18:52.357464271 +0000 UTC m=+2328.452402517" watchObservedRunningTime="2026-07-15 17:18:52.358925127 +0000 UTC m=+2328.453863373"
Jul 15 17:18:52.635890 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:52.635803    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:52.640701 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:52.640677    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:53.343864 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:53.343829    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:53.344876 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:53.344853    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:18:54.366179 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:18:54.366127    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:19:01.344316 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:01.344278    2567 patch_prober.go:28] interesting pod/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 17:19:01.344767 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:01.344351    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 17:19:03.404617 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:03.404585    2567 generic.go:356] "Generic (PLEG): container finished" podID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerID="65949ef5a92a07773feaddd3f158c5f4d2846e81b2fee8b2214e757321d3f6a8" exitCode=0
Jul 15 17:19:03.405045 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:03.404638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" event={"ID":"73eec9e3-2463-4a05-845f-e6d32da3bb51","Type":"ContainerDied","Data":"65949ef5a92a07773feaddd3f158c5f4d2846e81b2fee8b2214e757321d3f6a8"}
Jul 15 17:19:03.405045 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:03.405032    2567 scope.go:117] "RemoveContainer" containerID="65949ef5a92a07773feaddd3f158c5f4d2846e81b2fee8b2214e757321d3f6a8"
Jul 15 17:19:03.406079 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:03.406050    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:19:03.406234 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:03.406115    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:19:03.406234 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:03.406145    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:19:04.416988 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:04.415911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" event={"ID":"73eec9e3-2463-4a05-845f-e6d32da3bb51","Type":"ContainerStarted","Data":"09228baa626acbf0063d844884e3e029e6dee26f500c5fc05a5538fc5f2c30f4"}
Jul 15 17:19:05.288821 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:05.288779    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:19:05.289057 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:05.288872    2567 patch_prober.go:28] interesting pod/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 17:19:05.289057 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:05.288934    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 17:19:05.662958 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:05.662882    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:19:06.289281 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:06.288819    2567 patch_prober.go:28] interesting pod/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 17:19:06.289281 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:06.288885    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 17:19:07.289529 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:07.289057    2567 patch_prober.go:28] interesting pod/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 17:19:07.289529 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:07.289123    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 17:19:08.288227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:08.288182    2567 patch_prober.go:28] interesting pod/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 15 17:19:08.288406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:08.288286    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 15 17:19:09.291839 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.291808    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:19:09.294486 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.292183    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:19:09.294486 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.292784    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:19:09.307557 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.307534    2567 patch_prober.go:28] interesting pod/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:54672->10.132.0.48:15021: read: connection reset by peer" start-of-body=
Jul 15 17:19:09.307673 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.307602    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:54672->10.132.0.48:15021: read: connection reset by peer"
Jul 15 17:19:09.446309 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.446278    2567 generic.go:356] "Generic (PLEG): container finished" podID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerID="4236fa921ac8a2e114aa355824a2bc37663ea5c9e432aeb4a23570811e148efc" exitCode=0
Jul 15 17:19:09.446479 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.446352    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" event={"ID":"bfaf3ec0-92e0-4981-aaab-b27e1e41d193","Type":"ContainerDied","Data":"4236fa921ac8a2e114aa355824a2bc37663ea5c9e432aeb4a23570811e148efc"}
Jul 15 17:19:09.446861 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.446845    2567 scope.go:117] "RemoveContainer" containerID="4236fa921ac8a2e114aa355824a2bc37663ea5c9e432aeb4a23570811e148efc"
Jul 15 17:19:09.447881 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.447852    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:19:09.447971 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.447933    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:19:09.448012 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:09.447975    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:19:10.453205 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:10.453146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" event={"ID":"bfaf3ec0-92e0-4981-aaab-b27e1e41d193","Type":"ContainerStarted","Data":"d397bf4f504c099c7b37b9cb6a39bd6ae5bc6d5a2edfb63303c75055e9663da2"}
Jul 15 17:19:10.636474 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:10.636437    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:19:10.636650 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:10.636607    2567 patch_prober.go:28] interesting pod/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 15 17:19:10.636695 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:10.636654    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 15 17:19:11.059214 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.059181    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"]
Jul 15 17:19:11.061668 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.061647    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.063889 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.063868    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53dfff\"/\"openshift-service-ca.crt\""
Jul 15 17:19:11.064005 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.063874    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53dfff\"/\"test-model-53dfff-kserve-self-signed-certs\""
Jul 15 17:19:11.064674 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.064658    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-53dfff\"/\"default-dockercfg-mtzcx\""
Jul 15 17:19:11.064728 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.064659    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-53dfff\"/\"kube-root-ca.crt\""
Jul 15 17:19:11.073315 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.073292    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"]
Jul 15 17:19:11.151556 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.151520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-tmp-dir\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.151731 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.151566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssl8\" (UniqueName: \"kubernetes.io/projected/3508642d-87f0-4691-a7cf-c24f7f30488f-kube-api-access-pssl8\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.151731 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.151596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-home\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.151731 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.151641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-model-cache\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.151731 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.151696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3508642d-87f0-4691-a7cf-c24f7f30488f-tls-certs\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.151731 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.151723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-dshm\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.252986    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-home\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253270 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-model-cache\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253270 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3508642d-87f0-4691-a7cf-c24f7f30488f-tls-certs\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253270 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-dshm\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253270 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-tmp-dir\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253270 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pssl8\" (UniqueName: \"kubernetes.io/projected/3508642d-87f0-4691-a7cf-c24f7f30488f-kube-api-access-pssl8\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253521 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253496    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-model-cache\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253569 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253502    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-home\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.253569 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.253552    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-tmp-dir\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.255414 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.255392    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-dshm\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.255560 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.255544    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3508642d-87f0-4691-a7cf-c24f7f30488f-tls-certs\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.260234 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.260215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssl8\" (UniqueName: \"kubernetes.io/projected/3508642d-87f0-4691-a7cf-c24f7f30488f-kube-api-access-pssl8\") pod \"test-model-53dfff-kserve-545bcdb849-ckvwd\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") " pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.371363 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.371277    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:11.552761 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.552736    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"]
Jul 15 17:19:11.554689 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:19:11.554667    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3508642d_87f0_4691_a7cf_c24f7f30488f.slice/crio-32443210b8c0cb86e3d6ca6c9e74d83d44f04b872c52662451301f75c3b9b350 WatchSource:0}: Error finding container 32443210b8c0cb86e3d6ca6c9e74d83d44f04b872c52662451301f75c3b9b350: Status 404 returned error can't find the container with id 32443210b8c0cb86e3d6ca6c9e74d83d44f04b872c52662451301f75c3b9b350
Jul 15 17:19:11.635895 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.635869    2567 patch_prober.go:28] interesting pod/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 15 17:19:11.636035 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:11.635915    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 15 17:19:12.468676 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:12.468641    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd" event={"ID":"3508642d-87f0-4691-a7cf-c24f7f30488f","Type":"ContainerStarted","Data":"66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe"}
Jul 15 17:19:12.468861 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:12.468686    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd" event={"ID":"3508642d-87f0-4691-a7cf-c24f7f30488f","Type":"ContainerStarted","Data":"32443210b8c0cb86e3d6ca6c9e74d83d44f04b872c52662451301f75c3b9b350"}
Jul 15 17:19:12.636362 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:12.636327    2567 patch_prober.go:28] interesting pod/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 15 17:19:12.636703 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:12.636387    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 15 17:19:13.636025 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:13.635988    2567 patch_prober.go:28] interesting pod/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 15 17:19:13.636283 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:13.636044    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 15 17:19:14.639410 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:14.639377    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:19:14.639867 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:14.639658    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:19:14.640260 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:14.640243    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:19:14.661934 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:14.661893    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd" podStartSLOduration=3.6618780920000003 podStartE2EDuration="3.661878092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:19:12.488402827 +0000 UTC m=+2348.583341074" watchObservedRunningTime="2026-07-15 17:19:14.661878092 +0000 UTC m=+2350.756816338"
Jul 15 17:19:17.757449 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:17.757414    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:19:21.371685 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:21.371647    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:21.372113 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:21.371701    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:21.384889 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:21.384857    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:21.525431 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:21.525400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:19:54.055603 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:19:54.055555    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:20:04.562072 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:04.562045    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:20:04.569932 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:04.569913    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:20:07.755003 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:07.754968    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:20:28.001862 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:28.001784    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"]
Jul 15 17:20:32.766271 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:32.766225    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:20:43.021869 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.021803    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd" podUID="3508642d-87f0-4691-a7cf-c24f7f30488f" containerName="main" containerID="cri-o://66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe" gracePeriod=45
Jul 15 17:20:43.263957 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.263934    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:20:43.370901 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.370808    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-tmp-dir\") pod \"3508642d-87f0-4691-a7cf-c24f7f30488f\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") "
Jul 15 17:20:43.370901 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.370849    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pssl8\" (UniqueName: \"kubernetes.io/projected/3508642d-87f0-4691-a7cf-c24f7f30488f-kube-api-access-pssl8\") pod \"3508642d-87f0-4691-a7cf-c24f7f30488f\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") "
Jul 15 17:20:43.370901 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.370875    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-model-cache\") pod \"3508642d-87f0-4691-a7cf-c24f7f30488f\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") "
Jul 15 17:20:43.371130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371079    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-home\") pod \"3508642d-87f0-4691-a7cf-c24f7f30488f\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") "
Jul 15 17:20:43.371206 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-dshm\") pod \"3508642d-87f0-4691-a7cf-c24f7f30488f\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") "
Jul 15 17:20:43.371206 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371183    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3508642d-87f0-4691-a7cf-c24f7f30488f" (UID: "3508642d-87f0-4691-a7cf-c24f7f30488f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:43.371305 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371207    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3508642d-87f0-4691-a7cf-c24f7f30488f-tls-certs\") pod \"3508642d-87f0-4691-a7cf-c24f7f30488f\" (UID: \"3508642d-87f0-4691-a7cf-c24f7f30488f\") "
Jul 15 17:20:43.371354 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371190    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-model-cache" (OuterVolumeSpecName: "model-cache") pod "3508642d-87f0-4691-a7cf-c24f7f30488f" (UID: "3508642d-87f0-4691-a7cf-c24f7f30488f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:43.371398 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371348    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-home" (OuterVolumeSpecName: "home") pod "3508642d-87f0-4691-a7cf-c24f7f30488f" (UID: "3508642d-87f0-4691-a7cf-c24f7f30488f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:43.371632 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371602    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-tmp-dir\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:20:43.371632 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371634    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-model-cache\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:20:43.371799 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.371647    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-home\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:20:43.373344 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.373318    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3508642d-87f0-4691-a7cf-c24f7f30488f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3508642d-87f0-4691-a7cf-c24f7f30488f" (UID: "3508642d-87f0-4691-a7cf-c24f7f30488f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:20:43.373441 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.373333    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-dshm" (OuterVolumeSpecName: "dshm") pod "3508642d-87f0-4691-a7cf-c24f7f30488f" (UID: "3508642d-87f0-4691-a7cf-c24f7f30488f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:43.373441 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.373390    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3508642d-87f0-4691-a7cf-c24f7f30488f-kube-api-access-pssl8" (OuterVolumeSpecName: "kube-api-access-pssl8") pod "3508642d-87f0-4691-a7cf-c24f7f30488f" (UID: "3508642d-87f0-4691-a7cf-c24f7f30488f"). InnerVolumeSpecName "kube-api-access-pssl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:20:43.472178 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.472120    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pssl8\" (UniqueName: \"kubernetes.io/projected/3508642d-87f0-4691-a7cf-c24f7f30488f-kube-api-access-pssl8\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:20:43.472178 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.472148    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3508642d-87f0-4691-a7cf-c24f7f30488f-dshm\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:20:43.472178 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.472181    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3508642d-87f0-4691-a7cf-c24f7f30488f-tls-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:20:43.946749 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.946719    2567 generic.go:356] "Generic (PLEG): container finished" podID="3508642d-87f0-4691-a7cf-c24f7f30488f" containerID="66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe" exitCode=0
Jul 15 17:20:43.946923 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.946760    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"
Jul 15 17:20:43.946923 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.946811    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd" event={"ID":"3508642d-87f0-4691-a7cf-c24f7f30488f","Type":"ContainerDied","Data":"66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe"}
Jul 15 17:20:43.946923 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.946848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd" event={"ID":"3508642d-87f0-4691-a7cf-c24f7f30488f","Type":"ContainerDied","Data":"32443210b8c0cb86e3d6ca6c9e74d83d44f04b872c52662451301f75c3b9b350"}
Jul 15 17:20:43.946923 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.946869    2567 scope.go:117] "RemoveContainer" containerID="66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe"
Jul 15 17:20:43.956673 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.956654    2567 scope.go:117] "RemoveContainer" containerID="66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe"
Jul 15 17:20:43.956933 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:20:43.956915    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe\": container with ID starting with 66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe not found: ID does not exist" containerID="66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe"
Jul 15 17:20:43.956981 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.956941    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe"} err="failed to get container status \"66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe\": rpc error: code = NotFound desc = could not find container \"66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe\": container with ID starting with 66fcd5205916a3928080cc3612c4d243931d9358e90ec8b27a294346b48757fe not found: ID does not exist"
Jul 15 17:20:43.968191 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.968143    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"]
Jul 15 17:20:43.971909 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:43.971886    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-53dfff/test-model-53dfff-kserve-545bcdb849-ckvwd"]
Jul 15 17:20:44.513320 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:44.513290    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3508642d-87f0-4691-a7cf-c24f7f30488f" path="/var/lib/kubelet/pods/3508642d-87f0-4691-a7cf-c24f7f30488f/volumes"
Jul 15 17:20:46.054939 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:46.054905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:20:54.875088 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:54.875050    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"]
Jul 15 17:20:54.875586 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:20:54.875280    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy" containerID="cri-o://09228baa626acbf0063d844884e3e029e6dee26f500c5fc05a5538fc5f2c30f4" gracePeriod=30
Jul 15 17:21:00.035922 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.035889    2567 generic.go:356] "Generic (PLEG): container finished" podID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerID="09228baa626acbf0063d844884e3e029e6dee26f500c5fc05a5538fc5f2c30f4" exitCode=0
Jul 15 17:21:00.036491 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.035962    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" event={"ID":"73eec9e3-2463-4a05-845f-e6d32da3bb51","Type":"ContainerDied","Data":"09228baa626acbf0063d844884e3e029e6dee26f500c5fc05a5538fc5f2c30f4"}
Jul 15 17:21:00.036491 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.036024    2567 scope.go:117] "RemoveContainer" containerID="65949ef5a92a07773feaddd3f158c5f4d2846e81b2fee8b2214e757321d3f6a8"
Jul 15 17:21:00.128829 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.128807    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:21:00.227141 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227043    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-token\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227141 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227094    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-credential-socket\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227144    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-podinfo\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zrm9\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-kube-api-access-7zrm9\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227281    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73eec9e3-2463-4a05-845f-e6d32da3bb51-istiod-ca-cert\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227333    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-socket\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227370    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-certs\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227406    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-data\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227726 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227455    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-envoy\") pod \"73eec9e3-2463-4a05-845f-e6d32da3bb51\" (UID: \"73eec9e3-2463-4a05-845f-e6d32da3bb51\") "
Jul 15 17:21:00.227726 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227477    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:00.227726 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227616    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:00.227726 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227632    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:00.227931 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227648    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73eec9e3-2463-4a05-845f-e6d32da3bb51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:21:00.227931 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227805    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.227931 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227826    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73eec9e3-2463-4a05-845f-e6d32da3bb51-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.227931 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227841    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.227931 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.227857    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.228367 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.228346    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-data" (OuterVolumeSpecName: "istio-data") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:00.229618 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.229590    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:21:00.229754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.229668    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-token" (OuterVolumeSpecName: "istio-token") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:21:00.229754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.229694    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-kube-api-access-7zrm9" (OuterVolumeSpecName: "kube-api-access-7zrm9") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "kube-api-access-7zrm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:21:00.229754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.229742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73eec9e3-2463-4a05-845f-e6d32da3bb51" (UID: "73eec9e3-2463-4a05-845f-e6d32da3bb51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:00.329119 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.329087    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.329119 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.329112    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.329119 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.329121    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.329364 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.329130    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zrm9\" (UniqueName: \"kubernetes.io/projected/73eec9e3-2463-4a05-845f-e6d32da3bb51-kube-api-access-7zrm9\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:00.329364 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:00.329140    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73eec9e3-2463-4a05-845f-e6d32da3bb51-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:01.042249 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:01.042217    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"
Jul 15 17:21:01.042645 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:01.042262    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs" event={"ID":"73eec9e3-2463-4a05-845f-e6d32da3bb51","Type":"ContainerDied","Data":"1bca675e14bdd58e248609e9200e1095578029b302d707ec88d733193c29b0e0"}
Jul 15 17:21:01.042645 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:01.042317    2567 scope.go:117] "RemoveContainer" containerID="09228baa626acbf0063d844884e3e029e6dee26f500c5fc05a5538fc5f2c30f4"
Jul 15 17:21:01.058575 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:01.058552    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"]
Jul 15 17:21:01.062657 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:01.062637    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-53dfff-openshift-default-64b9c85645-qx9vs"]
Jul 15 17:21:02.511442 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:02.511409    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" path="/var/lib/kubelet/pods/73eec9e3-2463-4a05-845f-e6d32da3bb51/volumes"
Jul 15 17:21:08.664060 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:08.664019    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:21:20.984699 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:20.984658    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"]
Jul 15 17:21:20.985147 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:20.984907    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy" containerID="cri-o://d397bf4f504c099c7b37b9cb6a39bd6ae5bc6d5a2edfb63303c75055e9663da2" gracePeriod=30
Jul 15 17:21:21.888667 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.888634    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"]
Jul 15 17:21:21.888974 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.888959    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy"
Jul 15 17:21:21.888974 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.888974    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy"
Jul 15 17:21:21.889117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.888986    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3508642d-87f0-4691-a7cf-c24f7f30488f" containerName="main"
Jul 15 17:21:21.889117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.888991    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3508642d-87f0-4691-a7cf-c24f7f30488f" containerName="main"
Jul 15 17:21:21.889117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.888999    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy"
Jul 15 17:21:21.889117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.889005    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy"
Jul 15 17:21:21.889117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.889062    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy"
Jul 15 17:21:21.889117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.889072    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3508642d-87f0-4691-a7cf-c24f7f30488f" containerName="main"
Jul 15 17:21:21.889117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.889079    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="73eec9e3-2463-4a05-845f-e6d32da3bb51" containerName="istio-proxy"
Jul 15 17:21:21.891118 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.891099    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.893459 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.893438    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-29071b-openshift-default-dockercfg-bncn5\""
Jul 15 17:21:21.903633 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.903610    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"]
Jul 15 17:21:21.915657 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-credential-socket\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.915777 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-data\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.915777 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915692    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786420bb-ea8b-4a98-834f-f74ce129e32e-istiod-ca-cert\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.915777 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-envoy\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.915943 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-socket\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.915943 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915889    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-certs\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.915943 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-token\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.916093 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-podinfo\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:21.916093 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:21.915982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26s5l\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-kube-api-access-26s5l\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.016556 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016520    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-podinfo\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016558    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26s5l\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-kube-api-access-26s5l\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016607    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-credential-socket\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-data\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786420bb-ea8b-4a98-834f-f74ce129e32e-istiod-ca-cert\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016692    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-envoy\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016774    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-socket\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-certs\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.016922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-token\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017524 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.017085    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-credential-socket\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017524 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.017139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-data\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017524 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.017250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-socket\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017713 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.017532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786420bb-ea8b-4a98-834f-f74ce129e32e-istiod-ca-cert\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.017786 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.017765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-certs\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.018906 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.018890    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-envoy\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.019199 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.019183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-podinfo\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.024373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.024344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-token\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.024472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.024430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26s5l\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-kube-api-access-26s5l\") pod \"e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") " pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.201273 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.201196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:22.342972 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.342945    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"]
Jul 15 17:21:22.344746 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:21:22.344719    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786420bb_ea8b_4a98_834f_f74ce129e32e.slice/crio-79acc8296139aae0aef9b855505cb849a81b86d19d786e85fb9bfb435c4f7571 WatchSource:0}: Error finding container 79acc8296139aae0aef9b855505cb849a81b86d19d786e85fb9bfb435c4f7571: Status 404 returned error can't find the container with id 79acc8296139aae0aef9b855505cb849a81b86d19d786e85fb9bfb435c4f7571
Jul 15 17:21:22.347607 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.347574    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:22.347675 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.347658    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:22.347713 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:22.347699    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:23.154162 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:23.154120    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" event={"ID":"786420bb-ea8b-4a98-834f-f74ce129e32e","Type":"ContainerStarted","Data":"c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4"}
Jul 15 17:21:23.154527 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:23.154190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" event={"ID":"786420bb-ea8b-4a98-834f-f74ce129e32e","Type":"ContainerStarted","Data":"79acc8296139aae0aef9b855505cb849a81b86d19d786e85fb9bfb435c4f7571"}
Jul 15 17:21:23.174669 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:23.174626    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" podStartSLOduration=2.174610451 podStartE2EDuration="2.174610451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:21:23.173381197 +0000 UTC m=+2479.268319455" watchObservedRunningTime="2026-07-15 17:21:23.174610451 +0000 UTC m=+2479.269548696"
Jul 15 17:21:23.201575 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:23.201542    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:23.206412 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:23.206389    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:24.159443 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:24.159416    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:24.166979 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:24.166951    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:26.172659 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.172604    2567 generic.go:356] "Generic (PLEG): container finished" podID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerID="d397bf4f504c099c7b37b9cb6a39bd6ae5bc6d5a2edfb63303c75055e9663da2" exitCode=0
Jul 15 17:21:26.173053 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.172672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" event={"ID":"bfaf3ec0-92e0-4981-aaab-b27e1e41d193","Type":"ContainerDied","Data":"d397bf4f504c099c7b37b9cb6a39bd6ae5bc6d5a2edfb63303c75055e9663da2"}
Jul 15 17:21:26.173053 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.172735    2567 scope.go:117] "RemoveContainer" containerID="4236fa921ac8a2e114aa355824a2bc37663ea5c9e432aeb4a23570811e148efc"
Jul 15 17:21:26.240542 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.240518    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:21:26.358073 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358037    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-certs\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358073 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358080    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istiod-ca-cert\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358136    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-data\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358179    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-socket\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358204    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-envoy\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358236    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz8td\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-kube-api-access-xz8td\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358287    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-credential-socket\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358315    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-token\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358747 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358418    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:26.358747 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358436    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:26.358747 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358498    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-podinfo\") pod \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\" (UID: \"bfaf3ec0-92e0-4981-aaab-b27e1e41d193\") "
Jul 15 17:21:26.358747 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358552    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:21:26.358747 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358600    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:26.358975 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358833    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.358975 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358853    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.358975 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358866    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.358975 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.358880    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.359117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.359030    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:26.360544 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.360522    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:21:26.360635 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.360578    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-kube-api-access-xz8td" (OuterVolumeSpecName: "kube-api-access-xz8td") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "kube-api-access-xz8td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:21:26.360821 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.360802    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:21:26.360860 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.360822    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfaf3ec0-92e0-4981-aaab-b27e1e41d193" (UID: "bfaf3ec0-92e0-4981-aaab-b27e1e41d193"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:21:26.459513 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.459479    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.459513 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.459507    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.459513 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.459518    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz8td\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-kube-api-access-xz8td\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.459743 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.459527    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:26.459743 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:26.459534    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfaf3ec0-92e0-4981-aaab-b27e1e41d193-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:21:27.178371 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:27.178334    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"
Jul 15 17:21:27.178786 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:27.178392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk" event={"ID":"bfaf3ec0-92e0-4981-aaab-b27e1e41d193","Type":"ContainerDied","Data":"34a69c7b67c79ebee0bc443036561c782385d638208952736b2ba5b4627e5f60"}
Jul 15 17:21:27.178786 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:27.178448    2567 scope.go:117] "RemoveContainer" containerID="d397bf4f504c099c7b37b9cb6a39bd6ae5bc6d5a2edfb63303c75055e9663da2"
Jul 15 17:21:27.196547 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:27.196523    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"]
Jul 15 17:21:27.200629 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:27.200607    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c6b351-openshift-default-b7c86bf47-x48pk"]
Jul 15 17:21:28.512080 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:28.512030    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" path="/var/lib/kubelet/pods/bfaf3ec0-92e0-4981-aaab-b27e1e41d193/volumes"
Jul 15 17:21:28.961525 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:28.961456    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:21:30.312551 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.312517    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"]
Jul 15 17:21:30.313046 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.313030    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy"
Jul 15 17:21:30.313092 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.313050    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy"
Jul 15 17:21:30.313145 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.313135    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy"
Jul 15 17:21:30.313205 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.313150    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy"
Jul 15 17:21:30.316837 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.316815    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.319335 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.319313    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-714199-openshift-default-dockercfg-9xtm4\""
Jul 15 17:21:30.335768 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.335740    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"]
Jul 15 17:21:30.395651 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-data\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.395867 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395679    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-token\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.395867 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istiod-ca-cert\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.395867 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znhcm\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-kube-api-access-znhcm\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.395867 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-envoy\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.395867 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395827    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-credential-socket\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.395867 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395855    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-podinfo\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.396266 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-certs\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.396266 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.395983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-socket\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.496676 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-certs\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.496863 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-socket\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.496863 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-data\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.496863 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-token\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.496863 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istiod-ca-cert\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.496863 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znhcm\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-kube-api-access-znhcm\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.497253 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-envoy\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.497253 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496923    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-credential-socket\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.497253 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.496948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-podinfo\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.498105 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.498076    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-data\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.498320 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.498143    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-certs\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.498430 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.498405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istiod-ca-cert\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.498499 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.498390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-credential-socket\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.498764 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.498738    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-socket\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.501177 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.500377    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-podinfo\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.501574 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.501534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-envoy\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.505197 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.505172    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znhcm\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-kube-api-access-znhcm\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.505197 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.505190    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-token\") pod \"e2e-api-b-714199-openshift-default-6f545767d7-zld7f\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") " pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.634412 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.634319    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:30.804194 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.803991    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"]
Jul 15 17:21:30.808411 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:21:30.808374    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4142e0ac_c9a2_405c_bcd6_aa5d54142b98.slice/crio-c4a82649a8a8079d13760b6cb1300189d9fb024315e45fd28ea5cf569ed627dc WatchSource:0}: Error finding container c4a82649a8a8079d13760b6cb1300189d9fb024315e45fd28ea5cf569ed627dc: Status 404 returned error can't find the container with id c4a82649a8a8079d13760b6cb1300189d9fb024315e45fd28ea5cf569ed627dc
Jul 15 17:21:30.810540 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.810512    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:30.810648 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.810587    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:30.810648 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:30.810631    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:31.203400 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:31.203355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" event={"ID":"4142e0ac-c9a2-405c-bcd6-aa5d54142b98","Type":"ContainerStarted","Data":"3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2"}
Jul 15 17:21:31.203614 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:31.203422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" event={"ID":"4142e0ac-c9a2-405c-bcd6-aa5d54142b98","Type":"ContainerStarted","Data":"c4a82649a8a8079d13760b6cb1300189d9fb024315e45fd28ea5cf569ed627dc"}
Jul 15 17:21:31.226995 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:31.226946    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podStartSLOduration=1.226927728 podStartE2EDuration="1.226927728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:21:31.225410453 +0000 UTC m=+2487.320348697" watchObservedRunningTime="2026-07-15 17:21:31.226927728 +0000 UTC m=+2487.321865973"
Jul 15 17:21:31.634768 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:31.634732    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:31.639706 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:31.639680    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:32.209437 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:32.209405    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:32.210475 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:32.210452    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:38.247320 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:38.247289    2567 generic.go:356] "Generic (PLEG): container finished" podID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerID="c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4" exitCode=0
Jul 15 17:21:38.247749 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:38.247364    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" event={"ID":"786420bb-ea8b-4a98-834f-f74ce129e32e","Type":"ContainerDied","Data":"c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4"}
Jul 15 17:21:38.247795 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:38.247749    2567 scope.go:117] "RemoveContainer" containerID="c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4"
Jul 15 17:21:38.248716 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:38.248692    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:38.248814 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:38.248799    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:38.248855 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:38.248836    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:39.160239 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:39.160190    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:39.254653 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:39.254614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" event={"ID":"786420bb-ea8b-4a98-834f-f74ce129e32e","Type":"ContainerStarted","Data":"6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc"}
Jul 15 17:21:40.202256 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:40.202211    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:40.203618 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:40.203591    2567 patch_prober.go:28] interesting pod/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 17:21:40.203753 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:40.203641    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 17:21:40.864690 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:40.864656    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:21:41.201684 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:41.201638    2567 patch_prober.go:28] interesting pod/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 17:21:41.201870 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:41.201713    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 17:21:42.202463 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:42.202416    2567 patch_prober.go:28] interesting pod/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 15 17:21:42.203082 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:42.203047    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 15 17:21:43.208119 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:43.208079    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:43.208599 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:43.208520    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:43.209674 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:43.209652    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:21:48.251347 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:48.251303    2567 patch_prober.go:28] interesting pod/e2e-api-b-714199-openshift-default-6f545767d7-zld7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 17:21:48.251783 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:48.251372    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 17:21:49.315007 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:49.314969    2567 generic.go:356] "Generic (PLEG): container finished" podID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerID="3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2" exitCode=0
Jul 15 17:21:49.315462 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:49.315019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" event={"ID":"4142e0ac-c9a2-405c-bcd6-aa5d54142b98","Type":"ContainerDied","Data":"3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2"}
Jul 15 17:21:49.315462 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:49.315391    2567 scope.go:117] "RemoveContainer" containerID="3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2"
Jul 15 17:21:49.316494 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:49.316462    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:49.316587 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:49.316572    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:49.316630 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:49.316609    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:21:50.323690 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:50.323657    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" event={"ID":"4142e0ac-c9a2-405c-bcd6-aa5d54142b98","Type":"ContainerStarted","Data":"3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840"}
Jul 15 17:21:50.635035 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:50.634946    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:50.635338 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:50.635311    2567 patch_prober.go:28] interesting pod/e2e-api-b-714199-openshift-default-6f545767d7-zld7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 17:21:50.635443 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:50.635368    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 17:21:51.634981 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:51.634945    2567 patch_prober.go:28] interesting pod/e2e-api-b-714199-openshift-default-6f545767d7-zld7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 17:21:51.635406 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:51.635002    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 17:21:52.634734 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:52.634703    2567 patch_prober.go:28] interesting pod/e2e-api-b-714199-openshift-default-6f545767d7-zld7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 17:21:52.634914 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:52.634758    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 17:21:53.634939 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:53.634896    2567 patch_prober.go:28] interesting pod/e2e-api-b-714199-openshift-default-6f545767d7-zld7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 15 17:21:53.635380 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:53.634964    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 15 17:21:54.638719 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:54.638686    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:54.639124 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:54.639028    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:54.639750 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:54.639733    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:21:59.360339 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:21:59.360248    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:22:11.402669 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:11.402632    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"]
Jul 15 17:22:11.403297 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:11.402904    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy" containerID="cri-o://6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc" gracePeriod=30
Jul 15 17:22:13.211331 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:13.211293    2567 patch_prober.go:28] interesting pod/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 17:22:13.211695 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:13.211356    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 17:22:16.652196 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.652169    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:22:16.740693 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740591    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-socket\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.740693 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740645    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-data\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.740693 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740674    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-credential-socket\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.740693 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740694    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-envoy\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.741039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740732    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-podinfo\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.741039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740755    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-token\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.741039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740780    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-certs\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.741039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740802    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26s5l\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-kube-api-access-26s5l\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.741039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740838    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786420bb-ea8b-4a98-834f-f74ce129e32e-istiod-ca-cert\") pod \"786420bb-ea8b-4a98-834f-f74ce129e32e\" (UID: \"786420bb-ea8b-4a98-834f-f74ce129e32e\") "
Jul 15 17:22:16.741039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.740946    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:16.741396 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.741035    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:16.741396 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.741124    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.741396 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.741205    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.741396 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.741236    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:16.741396 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.741343    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/786420bb-ea8b-4a98-834f-f74ce129e32e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:22:16.741827 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.741794    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-data" (OuterVolumeSpecName: "istio-data") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:16.743083 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.743055    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-kube-api-access-26s5l" (OuterVolumeSpecName: "kube-api-access-26s5l") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "kube-api-access-26s5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:22:16.743223 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.743095    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-token" (OuterVolumeSpecName: "istio-token") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:22:16.743223 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.743126    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:22:16.743223 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.743187    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "786420bb-ea8b-4a98-834f-f74ce129e32e" (UID: "786420bb-ea8b-4a98-834f-f74ce129e32e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:16.842389 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.842346    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.842389 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.842383    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.842389 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.842397    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.842643 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.842409    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.842643 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.842421    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786420bb-ea8b-4a98-834f-f74ce129e32e-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.842643 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.842433    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26s5l\" (UniqueName: \"kubernetes.io/projected/786420bb-ea8b-4a98-834f-f74ce129e32e-kube-api-access-26s5l\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:16.842643 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:16.842445    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786420bb-ea8b-4a98-834f-f74ce129e32e-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:17.469167 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.469129    2567 generic.go:356] "Generic (PLEG): container finished" podID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerID="6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc" exitCode=0
Jul 15 17:22:17.469355 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.469198    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"
Jul 15 17:22:17.469355 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.469214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" event={"ID":"786420bb-ea8b-4a98-834f-f74ce129e32e","Type":"ContainerDied","Data":"6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc"}
Jul 15 17:22:17.469355 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.469277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf" event={"ID":"786420bb-ea8b-4a98-834f-f74ce129e32e","Type":"ContainerDied","Data":"79acc8296139aae0aef9b855505cb849a81b86d19d786e85fb9bfb435c4f7571"}
Jul 15 17:22:17.469355 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.469306    2567 scope.go:117] "RemoveContainer" containerID="6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc"
Jul 15 17:22:17.479114 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.479092    2567 scope.go:117] "RemoveContainer" containerID="c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4"
Jul 15 17:22:17.487466 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.487449    2567 scope.go:117] "RemoveContainer" containerID="6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc"
Jul 15 17:22:17.487772 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:22:17.487752    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc\": container with ID starting with 6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc not found: ID does not exist" containerID="6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc"
Jul 15 17:22:17.487823 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.487782    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc"} err="failed to get container status \"6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc\": rpc error: code = NotFound desc = could not find container \"6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc\": container with ID starting with 6ea26e99a6b256e51443845fe60136c1f39b4c91f02251004a26ba571e0ff8cc not found: ID does not exist"
Jul 15 17:22:17.487823 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.487807    2567 scope.go:117] "RemoveContainer" containerID="c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4"
Jul 15 17:22:17.488084 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:22:17.488063    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4\": container with ID starting with c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4 not found: ID does not exist" containerID="c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4"
Jul 15 17:22:17.488140 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.488093    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4"} err="failed to get container status \"c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4\": rpc error: code = NotFound desc = could not find container \"c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4\": container with ID starting with c49625d34b2fa1bf8c24d8670793f4771761d0cba26956f1cedc7a4dc6794fd4 not found: ID does not exist"
Jul 15 17:22:17.490584 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.490564    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"]
Jul 15 17:22:17.494450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:17.494427    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-29071b-openshift-default-6c6d945c89-nh6sf"]
Jul 15 17:22:18.512868 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:18.512833    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" path="/var/lib/kubelet/pods/786420bb-ea8b-4a98-834f-f74ce129e32e/volumes"
Jul 15 17:22:25.159948 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:25.159911    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:22:37.495259 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:37.495216    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"]
Jul 15 17:22:37.495778 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:37.495571    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy" containerID="cri-o://3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840" gracePeriod=30
Jul 15 17:22:38.383563 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.383522    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"]
Jul 15 17:22:38.384009 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.383992    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy"
Jul 15 17:22:38.384071 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.384014    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf3ec0-92e0-4981-aaab-b27e1e41d193" containerName="istio-proxy"
Jul 15 17:22:38.384071 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.384062    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy"
Jul 15 17:22:38.384139 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.384071    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy"
Jul 15 17:22:38.384139 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.384084    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy"
Jul 15 17:22:38.384139 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.384092    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy"
Jul 15 17:22:38.384274 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.384189    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy"
Jul 15 17:22:38.387267 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.387250    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.389559 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.389531    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-abaf36-openshift-default-dockercfg-gkpcv\""
Jul 15 17:22:38.398254 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.398227    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"]
Jul 15 17:22:38.531861 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.531825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-socket\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.531861 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.531865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-credential-socket\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.532319 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.531899    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-envoy\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.532319 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.531926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-token\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.532319 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.531964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-podinfo\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.532319 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.531983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istiod-ca-cert\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.532319 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.532000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-certs\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.532319 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.532018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-data\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.532319 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.532092    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglgh\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-kube-api-access-vglgh\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.632970 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.632934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-podinfo\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.632970 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.632970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istiod-ca-cert\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633229 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.632988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-certs\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633229 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633059    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-data\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633229 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglgh\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-kube-api-access-vglgh\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633229 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-socket\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633229 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-credential-socket\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633505 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-envoy\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633505 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-token\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633505 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633471    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-data\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633685 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633625    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-credential-socket\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633756 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633693    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-socket\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633756 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633727    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-certs\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.633831 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.633771    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istiod-ca-cert\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.635612 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.635590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-envoy\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.636019 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.636000    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-podinfo\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.640668 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.640649    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-token\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.640969 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.640949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglgh\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-kube-api-access-vglgh\") pod \"e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") " pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.697363 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.697327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:38.831852 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.831827    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"]
Jul 15 17:22:38.833790 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:22:38.833765    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf72e1f20_9ca2_4e93_bd09_27c995eab01d.slice/crio-4c6c4af253f2895edbd76b2b9f2f83b52b99e77e96e56b7acceee45027e5c2c5 WatchSource:0}: Error finding container 4c6c4af253f2895edbd76b2b9f2f83b52b99e77e96e56b7acceee45027e5c2c5: Status 404 returned error can't find the container with id 4c6c4af253f2895edbd76b2b9f2f83b52b99e77e96e56b7acceee45027e5c2c5
Jul 15 17:22:38.835759 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.835730    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:38.835828 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.835793    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:38.835828 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:38.835820    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:39.583795 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:39.583753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" event={"ID":"f72e1f20-9ca2-4e93-bd09-27c995eab01d","Type":"ContainerStarted","Data":"ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53"}
Jul 15 17:22:39.584218 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:39.583818    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" event={"ID":"f72e1f20-9ca2-4e93-bd09-27c995eab01d","Type":"ContainerStarted","Data":"4c6c4af253f2895edbd76b2b9f2f83b52b99e77e96e56b7acceee45027e5c2c5"}
Jul 15 17:22:39.604622 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:39.604570    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" podStartSLOduration=1.604555726 podStartE2EDuration="1.604555726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:22:39.60335618 +0000 UTC m=+2555.698294437" watchObservedRunningTime="2026-07-15 17:22:39.604555726 +0000 UTC m=+2555.699493971"
Jul 15 17:22:39.641595 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:39.641561    2567 patch_prober.go:28] interesting pod/e2e-api-b-714199-openshift-default-6f545767d7-zld7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 17:22:39.641765 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:39.641626    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 17:22:39.698492 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:39.698454    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:39.703480 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:39.703454    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:40.589734 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:40.589704    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:40.590783 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:40.590765    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:42.752355 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.752328    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:22:42.875848 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.875807    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znhcm\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-kube-api-access-znhcm\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876063 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.875861    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istiod-ca-cert\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876063 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.875915    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-socket\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876063 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.875943    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-credential-socket\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876063 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.875975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-data\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876063 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876003    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-certs\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876071    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-token\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876119    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-envoy\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876195    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-podinfo\") pod \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\" (UID: \"4142e0ac-c9a2-405c-bcd6-aa5d54142b98\") "
Jul 15 17:22:42.876537 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876431    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:42.876537 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876453    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:42.876537 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876482    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:22:42.876888 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.876864    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:42.877084 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.877056    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-data" (OuterVolumeSpecName: "istio-data") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:42.878545 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.878510    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-kube-api-access-znhcm" (OuterVolumeSpecName: "kube-api-access-znhcm") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "kube-api-access-znhcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:22:42.878838 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.878815    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:22:42.878943 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.878854    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:22:42.878943 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.878927    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-token" (OuterVolumeSpecName: "istio-token") pod "4142e0ac-c9a2-405c-bcd6-aa5d54142b98" (UID: "4142e0ac-c9a2-405c-bcd6-aa5d54142b98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:22:42.977368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977333    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znhcm\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-kube-api-access-znhcm\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977362    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977368 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977374    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977383    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977392    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977401    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977408    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977419    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:42.977597 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:42.977431    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4142e0ac-c9a2-405c-bcd6-aa5d54142b98-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:22:43.607939 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.607904    2567 generic.go:356] "Generic (PLEG): container finished" podID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerID="3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840" exitCode=0
Jul 15 17:22:43.608108 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.607953    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"
Jul 15 17:22:43.608108 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.607992    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" event={"ID":"4142e0ac-c9a2-405c-bcd6-aa5d54142b98","Type":"ContainerDied","Data":"3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840"}
Jul 15 17:22:43.608108 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.608051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f" event={"ID":"4142e0ac-c9a2-405c-bcd6-aa5d54142b98","Type":"ContainerDied","Data":"c4a82649a8a8079d13760b6cb1300189d9fb024315e45fd28ea5cf569ed627dc"}
Jul 15 17:22:43.608108 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.608078    2567 scope.go:117] "RemoveContainer" containerID="3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840"
Jul 15 17:22:43.617617 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.617476    2567 scope.go:117] "RemoveContainer" containerID="3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2"
Jul 15 17:22:43.625852 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.625835    2567 scope.go:117] "RemoveContainer" containerID="3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840"
Jul 15 17:22:43.626126 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:22:43.626108    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840\": container with ID starting with 3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840 not found: ID does not exist" containerID="3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840"
Jul 15 17:22:43.626223 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.626140    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840"} err="failed to get container status \"3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840\": rpc error: code = NotFound desc = could not find container \"3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840\": container with ID starting with 3cedbdb0a1d07f3b9ad2359299c5db4f5a75e14fab7d05985b77ef977d46c840 not found: ID does not exist"
Jul 15 17:22:43.626223 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.626184    2567 scope.go:117] "RemoveContainer" containerID="3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2"
Jul 15 17:22:43.626470 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:22:43.626441    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2\": container with ID starting with 3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2 not found: ID does not exist" containerID="3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2"
Jul 15 17:22:43.626617 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.626498    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2"} err="failed to get container status \"3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2\": rpc error: code = NotFound desc = could not find container \"3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2\": container with ID starting with 3ed5d8754f2585bcf62ba173c014429a48cbae274f06061ee71c4e0db3ddffb2 not found: ID does not exist"
Jul 15 17:22:43.629222 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.629200    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"]
Jul 15 17:22:43.632461 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:43.632441    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-714199-openshift-default-6f545767d7-zld7f"]
Jul 15 17:22:44.512304 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:44.512267    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" path="/var/lib/kubelet/pods/4142e0ac-c9a2-405c-bcd6-aa5d54142b98/volumes"
Jul 15 17:22:45.654924 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:45.654895    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:22:46.621124 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621090    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"]
Jul 15 17:22:46.621613 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621593    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy"
Jul 15 17:22:46.621613 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621614    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy"
Jul 15 17:22:46.621807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621634    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy"
Jul 15 17:22:46.621807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621642    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy"
Jul 15 17:22:46.621807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621725    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="786420bb-ea8b-4a98-834f-f74ce129e32e" containerName="istio-proxy"
Jul 15 17:22:46.621807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621737    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy"
Jul 15 17:22:46.621807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.621748    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4142e0ac-c9a2-405c-bcd6-aa5d54142b98" containerName="istio-proxy"
Jul 15 17:22:46.625518 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.625499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.627916 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.627897    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1e0e66-openshift-default-dockercfg-vnqt6\""
Jul 15 17:22:46.635767 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.635745    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"]
Jul 15 17:22:46.815273 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.815223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-socket\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.815887 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.815861    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-data\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.816035 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.816021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-envoy\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.816251 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.816221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-podinfo\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.816375 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.816274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-credential-socket\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.816375 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.816334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-certs\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.816375 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.816367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzkms\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-kube-api-access-vzkms\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.816545 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.816480    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-token\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.816545 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.816536    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istiod-ca-cert\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917398 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-token\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917398 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istiod-ca-cert\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917398 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-socket\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917398 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917388    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-data\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917750 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-envoy\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917750 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917444    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-podinfo\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917750 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-credential-socket\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917750 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-certs\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.917750 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzkms\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-kube-api-access-vzkms\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.918012 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917754    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-socket\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.918012 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.917817    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-data\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.918012 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.918002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-credential-socket\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.918012 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.918010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-certs\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.918245 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.918223    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istiod-ca-cert\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.919704 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.919686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-envoy\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.920022 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.919992    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-podinfo\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.926694 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.926668    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-token\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.931591 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.931565    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzkms\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-kube-api-access-vzkms\") pod \"e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") " pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:46.936180 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:46.936141    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:47.106418 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.106379    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"]
Jul 15 17:22:47.110329 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:22:47.110291    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c89746_bd48_4eb8_8f56_b07348ae3b0d.slice/crio-a1c7fc6b53eabbf2ba5fe30ebc846dfff1d08d802389acd81129c4916d0b58ef WatchSource:0}: Error finding container a1c7fc6b53eabbf2ba5fe30ebc846dfff1d08d802389acd81129c4916d0b58ef: Status 404 returned error can't find the container with id a1c7fc6b53eabbf2ba5fe30ebc846dfff1d08d802389acd81129c4916d0b58ef
Jul 15 17:22:47.112351 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.112318    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:47.112432 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.112388    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:47.112432 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.112421    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:47.631380 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.631337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" event={"ID":"52c89746-bd48-4eb8-8f56-b07348ae3b0d","Type":"ContainerStarted","Data":"901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1"}
Jul 15 17:22:47.631564 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.631405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" event={"ID":"52c89746-bd48-4eb8-8f56-b07348ae3b0d","Type":"ContainerStarted","Data":"a1c7fc6b53eabbf2ba5fe30ebc846dfff1d08d802389acd81129c4916d0b58ef"}
Jul 15 17:22:47.650695 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.650644    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" podStartSLOduration=1.650627932 podStartE2EDuration="1.650627932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:22:47.64958823 +0000 UTC m=+2563.744526476" watchObservedRunningTime="2026-07-15 17:22:47.650627932 +0000 UTC m=+2563.745566176"
Jul 15 17:22:47.936293 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:47.936210    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:48.941516 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:48.941480    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:49.643014 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:49.642944    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:49.644767 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:49.644742    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:22:54.671578 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:54.671542    2567 generic.go:356] "Generic (PLEG): container finished" podID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerID="ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53" exitCode=0
Jul 15 17:22:54.672024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:54.671617    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" event={"ID":"f72e1f20-9ca2-4e93-bd09-27c995eab01d","Type":"ContainerDied","Data":"ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53"}
Jul 15 17:22:54.672024 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:54.672018    2567 scope.go:117] "RemoveContainer" containerID="ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53"
Jul 15 17:22:54.673127 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:54.673100    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:54.673218 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:54.673190    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:54.673262 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:54.673224    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:22:55.590315 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:55.590268    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:55.680865 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:55.680822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" event={"ID":"f72e1f20-9ca2-4e93-bd09-27c995eab01d","Type":"ContainerStarted","Data":"8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8"}
Jul 15 17:22:55.697837 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:55.697747    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:55.699194 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:55.699130    2567 patch_prober.go:28] interesting pod/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 17:22:55.699443 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:55.699411    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 17:22:56.698352 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:56.698311    2567 patch_prober.go:28] interesting pod/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 17:22:56.698964 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:56.698931    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 17:22:56.955354 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:56.955271    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:22:57.698622 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:57.698585    2567 patch_prober.go:28] interesting pod/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 17:22:57.699247 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:57.699216    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 17:22:58.698780 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:58.698742    2567 patch_prober.go:28] interesting pod/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 15 17:22:58.699384 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:58.699351    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 15 17:22:59.703412 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:59.703380    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:59.703831 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:59.703752    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:22:59.704552 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:22:59.704533    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:23:04.644814 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.644781    2567 patch_prober.go:28] interesting pod/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 17:23:04.645279 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.644848    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 17:23:04.738921 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.738892    2567 generic.go:356] "Generic (PLEG): container finished" podID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerID="901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1" exitCode=0
Jul 15 17:23:04.739099 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.738978    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" event={"ID":"52c89746-bd48-4eb8-8f56-b07348ae3b0d","Type":"ContainerDied","Data":"901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1"}
Jul 15 17:23:04.739433 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.739417    2567 scope.go:117] "RemoveContainer" containerID="901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1"
Jul 15 17:23:04.740441 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.740417    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:23:04.740508 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.740496    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:23:04.740547 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:04.740531    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 15 17:23:05.748857 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:05.748821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" event={"ID":"52c89746-bd48-4eb8-8f56-b07348ae3b0d","Type":"ContainerStarted","Data":"5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca"}
Jul 15 17:23:05.936645 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:05.936602    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:23:05.936923 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:05.936898    2567 patch_prober.go:28] interesting pod/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 17:23:05.937015 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:05.936955    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 17:23:06.937607 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:06.937568    2567 patch_prober.go:28] interesting pod/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 17:23:06.937996 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:06.937630    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 17:23:07.936839 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:07.936802    2567 patch_prober.go:28] interesting pod/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 17:23:07.937061 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:07.936858    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 17:23:08.937413 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:08.937376    2567 patch_prober.go:28] interesting pod/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 15 17:23:08.937811 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:08.937432    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 15 17:23:09.940473 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:09.940439    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:23:09.940848 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:09.940670    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:23:09.941489 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:09.941474    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:23:12.170810 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:12.170769    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:23:40.942283 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:40.942207    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"]
Jul 15 17:23:40.944699 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:40.944680    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:40.947228 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:40.947205    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"kube-root-ca.crt\""
Jul 15 17:23:40.948111 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:40.948091    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"auth-test-model-1e0e66-kserve-self-signed-certs\""
Jul 15 17:23:40.948111 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:40.948110    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"default-dockercfg-p9fzq\""
Jul 15 17:23:40.948311 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:40.948144    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"openshift-service-ca.crt\""
Jul 15 17:23:40.956371 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:40.956347    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"]
Jul 15 17:23:41.026185 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.026126    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-home\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.026373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.026215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-model-cache\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.026373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.026289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-dshm\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.026373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.026313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tmp-dir\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.026373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.026331    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tls-certs\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.026527 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.026383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drb5m\" (UniqueName: \"kubernetes.io/projected/55d95925-e6a5-4dde-a7b3-bdc43b793a50-kube-api-access-drb5m\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.126928 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.126894    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-dshm\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.126928 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.126937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tmp-dir\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.127231 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.126960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tls-certs\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.127231 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.126983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drb5m\" (UniqueName: \"kubernetes.io/projected/55d95925-e6a5-4dde-a7b3-bdc43b793a50-kube-api-access-drb5m\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.127231 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.127048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-home\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.127231 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.127092    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-model-cache\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.127555 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.127533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-model-cache\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.128017 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.127989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tmp-dir\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.128302 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.128267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-home\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.130489 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.130467    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-dshm\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.133456 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.133431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tls-certs\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.137744 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.137723    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drb5m\" (UniqueName: \"kubernetes.io/projected/55d95925-e6a5-4dde-a7b3-bdc43b793a50-kube-api-access-drb5m\") pod \"auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") " pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.254704 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.254617    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:41.396433 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.396408    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"]
Jul 15 17:23:41.398699 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:23:41.398674    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55d95925_e6a5_4dde_a7b3_bdc43b793a50.slice/crio-a55ca21468b73cec259eeb76c1947aa5e23b1ee9bf1cf9ace9f258f6edd87cde WatchSource:0}: Error finding container a55ca21468b73cec259eeb76c1947aa5e23b1ee9bf1cf9ace9f258f6edd87cde: Status 404 returned error can't find the container with id a55ca21468b73cec259eeb76c1947aa5e23b1ee9bf1cf9ace9f258f6edd87cde
Jul 15 17:23:41.934186 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.934140    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8" event={"ID":"55d95925-e6a5-4dde-a7b3-bdc43b793a50","Type":"ContainerStarted","Data":"bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325"}
Jul 15 17:23:41.934372 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.934196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8" event={"ID":"55d95925-e6a5-4dde-a7b3-bdc43b793a50","Type":"ContainerStarted","Data":"a55ca21468b73cec259eeb76c1947aa5e23b1ee9bf1cf9ace9f258f6edd87cde"}
Jul 15 17:23:41.960023 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:41.959970    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8" podStartSLOduration=1.9599531460000001 podStartE2EDuration="1.959953146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:23:41.958084887 +0000 UTC m=+2618.053023135" watchObservedRunningTime="2026-07-15 17:23:41.959953146 +0000 UTC m=+2618.054891390"
Jul 15 17:23:44.361682 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:44.361634    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:23:51.254844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:51.254806    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:51.255492 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:51.255139    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:51.267647 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:51.267619    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:23:52.001073 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:23:52.001040    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:24:03.659961 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:24:03.659928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:24:21.957283 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:24:21.957245    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:24:38.554443 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:24:38.554408    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:24:57.456767 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:24:57.456676    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:25:04.593292 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:25:04.593263    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:25:04.601659 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:25:04.601637    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:25:16.357238 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:25:16.357202    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:25:33.858716 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:25:33.858681    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:25:50.024468 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:25:50.024435    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"]
Jul 15 17:25:52.755309 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:25:52.755275    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:26:05.045394 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.045328    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8" podUID="55d95925-e6a5-4dde-a7b3-bdc43b793a50" containerName="main" containerID="cri-o://bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325" gracePeriod=45
Jul 15 17:26:05.297078 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.297011    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:26:05.342028 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.341992    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-dshm\") pod \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") "
Jul 15 17:26:05.342249 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342041    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-model-cache\") pod \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") "
Jul 15 17:26:05.342249 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342091    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-home\") pod \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") "
Jul 15 17:26:05.342249 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342132    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tmp-dir\") pod \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") "
Jul 15 17:26:05.342249 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342235    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tls-certs\") pod \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") "
Jul 15 17:26:05.342470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342260    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drb5m\" (UniqueName: \"kubernetes.io/projected/55d95925-e6a5-4dde-a7b3-bdc43b793a50-kube-api-access-drb5m\") pod \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\" (UID: \"55d95925-e6a5-4dde-a7b3-bdc43b793a50\") "
Jul 15 17:26:05.342470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342377    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-model-cache" (OuterVolumeSpecName: "model-cache") pod "55d95925-e6a5-4dde-a7b3-bdc43b793a50" (UID: "55d95925-e6a5-4dde-a7b3-bdc43b793a50"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:05.342470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342418    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-home" (OuterVolumeSpecName: "home") pod "55d95925-e6a5-4dde-a7b3-bdc43b793a50" (UID: "55d95925-e6a5-4dde-a7b3-bdc43b793a50"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:05.342633 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342570    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-model-cache\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:26:05.342633 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342583    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-home\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:26:05.342777 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.342751    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "55d95925-e6a5-4dde-a7b3-bdc43b793a50" (UID: "55d95925-e6a5-4dde-a7b3-bdc43b793a50"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:05.344664 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.344633    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d95925-e6a5-4dde-a7b3-bdc43b793a50-kube-api-access-drb5m" (OuterVolumeSpecName: "kube-api-access-drb5m") pod "55d95925-e6a5-4dde-a7b3-bdc43b793a50" (UID: "55d95925-e6a5-4dde-a7b3-bdc43b793a50"). InnerVolumeSpecName "kube-api-access-drb5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:26:05.344789 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.344740    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-dshm" (OuterVolumeSpecName: "dshm") pod "55d95925-e6a5-4dde-a7b3-bdc43b793a50" (UID: "55d95925-e6a5-4dde-a7b3-bdc43b793a50"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:05.344836 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.344779    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "55d95925-e6a5-4dde-a7b3-bdc43b793a50" (UID: "55d95925-e6a5-4dde-a7b3-bdc43b793a50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:26:05.443780 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.443735    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tmp-dir\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:26:05.443780 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.443773    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55d95925-e6a5-4dde-a7b3-bdc43b793a50-tls-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:26:05.443780 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.443782    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drb5m\" (UniqueName: \"kubernetes.io/projected/55d95925-e6a5-4dde-a7b3-bdc43b793a50-kube-api-access-drb5m\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:26:05.443780 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.443791    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55d95925-e6a5-4dde-a7b3-bdc43b793a50-dshm\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:26:05.692450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.692355    2567 generic.go:356] "Generic (PLEG): container finished" podID="55d95925-e6a5-4dde-a7b3-bdc43b793a50" containerID="bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325" exitCode=0
Jul 15 17:26:05.692450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.692405    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"
Jul 15 17:26:05.692667 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.692444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8" event={"ID":"55d95925-e6a5-4dde-a7b3-bdc43b793a50","Type":"ContainerDied","Data":"bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325"}
Jul 15 17:26:05.692667 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.692485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8" event={"ID":"55d95925-e6a5-4dde-a7b3-bdc43b793a50","Type":"ContainerDied","Data":"a55ca21468b73cec259eeb76c1947aa5e23b1ee9bf1cf9ace9f258f6edd87cde"}
Jul 15 17:26:05.692667 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.692502    2567 scope.go:117] "RemoveContainer" containerID="bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325"
Jul 15 17:26:05.701622 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.701605    2567 scope.go:117] "RemoveContainer" containerID="bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325"
Jul 15 17:26:05.701885 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:26:05.701864    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325\": container with ID starting with bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325 not found: ID does not exist" containerID="bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325"
Jul 15 17:26:05.701936 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.701894    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325"} err="failed to get container status \"bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325\": rpc error: code = NotFound desc = could not find container \"bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325\": container with ID starting with bed7b3b3d9d95cdc65a44de1b87f2c9c53aa02708b863a19362f8a81ed967325 not found: ID does not exist"
Jul 15 17:26:05.713618 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.713587    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"]
Jul 15 17:26:05.715393 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:05.715373    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/auth-test-model-1e0e66-kserve-5bd97784dc-hvfw8"]
Jul 15 17:26:06.512773 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:06.512737    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55d95925-e6a5-4dde-a7b3-bdc43b793a50" path="/var/lib/kubelet/pods/55d95925-e6a5-4dde-a7b3-bdc43b793a50/volumes"
Jul 15 17:26:07.352148 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:07.352113    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:26:16.435822 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.435790    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"]
Jul 15 17:26:16.436299 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.436146    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d95925-e6a5-4dde-a7b3-bdc43b793a50" containerName="main"
Jul 15 17:26:16.436299 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.436171    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d95925-e6a5-4dde-a7b3-bdc43b793a50" containerName="main"
Jul 15 17:26:16.436299 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.436248    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d95925-e6a5-4dde-a7b3-bdc43b793a50" containerName="main"
Jul 15 17:26:16.438564 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.438544    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.441984 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.441952    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"kube-root-ca.crt\""
Jul 15 17:26:16.441984 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.441980    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"sub-test-model-abaf36-kserve-self-signed-certs\""
Jul 15 17:26:16.442142 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.441986    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"default-dockercfg-nzb7n\""
Jul 15 17:26:16.442142 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.441952    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"openshift-service-ca.crt\""
Jul 15 17:26:16.449082 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.449059    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"]
Jul 15 17:26:16.539763 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.539718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52279d22-e586-44d5-8b3c-edf5ca8ba230-tls-certs\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.540111 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.540079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-dshm\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.540265 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.540147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdb59\" (UniqueName: \"kubernetes.io/projected/52279d22-e586-44d5-8b3c-edf5ca8ba230-kube-api-access-vdb59\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.540265 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.540193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-home\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.540265 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.540242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-tmp-dir\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.540439 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.540321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-model-cache\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641066 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52279d22-e586-44d5-8b3c-edf5ca8ba230-tls-certs\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641306 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-dshm\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641306 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdb59\" (UniqueName: \"kubernetes.io/projected/52279d22-e586-44d5-8b3c-edf5ca8ba230-kube-api-access-vdb59\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641306 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641281    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-home\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641482 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641364    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-tmp-dir\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641482 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-model-cache\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641707 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641677    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-home\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641866 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641742    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-tmp-dir\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.641954 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.641889    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-model-cache\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.643482 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.643459    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-dshm\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.643650 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.643633    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52279d22-e586-44d5-8b3c-edf5ca8ba230-tls-certs\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.648502 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.648480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdb59\" (UniqueName: \"kubernetes.io/projected/52279d22-e586-44d5-8b3c-edf5ca8ba230-kube-api-access-vdb59\") pod \"sub-test-model-abaf36-kserve-5f64d68849-4wkvw\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") " pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.748110 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.748007    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:16.883307 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:16.883285    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"]
Jul 15 17:26:16.884999 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:26:16.884971    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52279d22_e586_44d5_8b3c_edf5ca8ba230.slice/crio-7002e63d61ebc24cf28061560731c105fdba8d8a947e0043725683152dc10f46 WatchSource:0}: Error finding container 7002e63d61ebc24cf28061560731c105fdba8d8a947e0043725683152dc10f46: Status 404 returned error can't find the container with id 7002e63d61ebc24cf28061560731c105fdba8d8a947e0043725683152dc10f46
Jul 15 17:26:17.757830 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:17.757798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw" event={"ID":"52279d22-e586-44d5-8b3c-edf5ca8ba230","Type":"ContainerStarted","Data":"a4b4d62a845f92e4829cda98ff0510da2fde4ae4074f7d995b936011db91e5ce"}
Jul 15 17:26:17.758228 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:17.757839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw" event={"ID":"52279d22-e586-44d5-8b3c-edf5ca8ba230","Type":"ContainerStarted","Data":"7002e63d61ebc24cf28061560731c105fdba8d8a947e0043725683152dc10f46"}
Jul 15 17:26:17.774150 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:17.774105    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw" podStartSLOduration=1.774087399 podStartE2EDuration="1.774087399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:26:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:26:17.772609856 +0000 UTC m=+2773.867548102" watchObservedRunningTime="2026-07-15 17:26:17.774087399 +0000 UTC m=+2773.869025645"
Jul 15 17:26:20.163925 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:20.163885    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:26:26.749036 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:26.748935    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:26.749036 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:26.748987    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:26.761423 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:26.761393    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:26.816380 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:26.816341    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:26:42.759887 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:42.759823    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:26:58.467311 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:26:58.467274    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:27:17.923462 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:17.923429    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"]
Jul 15 17:27:21.736529 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.736496    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"]
Jul 15 17:27:21.739952 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.739931    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.742299 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.742279    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"rate-test-model-abaf36-kserve-self-signed-certs\""
Jul 15 17:27:21.749920 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.749894    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"]
Jul 15 17:27:21.843140 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.843100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-home\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.843140 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.843143    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-model-cache\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.843459 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.843196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838fd092-fc84-482d-9e0f-0abcc04313f6-tls-certs\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.843459 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.843250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-tmp-dir\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.843459 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.843350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7l62\" (UniqueName: \"kubernetes.io/projected/838fd092-fc84-482d-9e0f-0abcc04313f6-kube-api-access-t7l62\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.843459 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.843399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-dshm\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.944523 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.944489    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838fd092-fc84-482d-9e0f-0abcc04313f6-tls-certs\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.944724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.944532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-tmp-dir\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.944724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.944571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7l62\" (UniqueName: \"kubernetes.io/projected/838fd092-fc84-482d-9e0f-0abcc04313f6-kube-api-access-t7l62\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.944724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.944606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-dshm\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.944724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.944673    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-home\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.944724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.944703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-model-cache\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.945113 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.945094    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-tmp-dir\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.945191 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.945113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-home\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.945191 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.945120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-model-cache\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.946952 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.946931    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-dshm\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.947063 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.947046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838fd092-fc84-482d-9e0f-0abcc04313f6-tls-certs\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:21.952370 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:21.952350    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7l62\" (UniqueName: \"kubernetes.io/projected/838fd092-fc84-482d-9e0f-0abcc04313f6-kube-api-access-t7l62\") pod \"rate-test-model-abaf36-kserve-7997b48c95-97mkz\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") " pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:22.050106 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:22.050071    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:22.190996 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:22.190972    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"]
Jul 15 17:27:22.193017 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:27:22.192966    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod838fd092_fc84_482d_9e0f_0abcc04313f6.slice/crio-dc570d442bd0a4ba732b12f1730e6c35f8cb8026ba31930e20a3fa89ec9c42df WatchSource:0}: Error finding container dc570d442bd0a4ba732b12f1730e6c35f8cb8026ba31930e20a3fa89ec9c42df: Status 404 returned error can't find the container with id dc570d442bd0a4ba732b12f1730e6c35f8cb8026ba31930e20a3fa89ec9c42df
Jul 15 17:27:22.762270 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:22.762232    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:27:23.097131 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:23.097087    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz" event={"ID":"838fd092-fc84-482d-9e0f-0abcc04313f6","Type":"ContainerStarted","Data":"e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea"}
Jul 15 17:27:23.097340 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:23.097139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz" event={"ID":"838fd092-fc84-482d-9e0f-0abcc04313f6","Type":"ContainerStarted","Data":"dc570d442bd0a4ba732b12f1730e6c35f8cb8026ba31930e20a3fa89ec9c42df"}
Jul 15 17:27:23.113997 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:23.113951    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz" podStartSLOduration=2.113934601 podStartE2EDuration="2.113934601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:27:23.11214766 +0000 UTC m=+2839.207085919" watchObservedRunningTime="2026-07-15 17:27:23.113934601 +0000 UTC m=+2839.208872847"
Jul 15 17:27:32.050265 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:32.050220    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:32.050265 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:32.050275    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:32.062785 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:32.062758    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:32.154683 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:32.154651    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:27:32.943715 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:32.943681    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw" podUID="52279d22-e586-44d5-8b3c-edf5ca8ba230" containerName="main" containerID="cri-o://a4b4d62a845f92e4829cda98ff0510da2fde4ae4074f7d995b936011db91e5ce" gracePeriod=45
Jul 15 17:27:33.150202 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.150170    2567 generic.go:356] "Generic (PLEG): container finished" podID="52279d22-e586-44d5-8b3c-edf5ca8ba230" containerID="a4b4d62a845f92e4829cda98ff0510da2fde4ae4074f7d995b936011db91e5ce" exitCode=0
Jul 15 17:27:33.150202 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.150190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw" event={"ID":"52279d22-e586-44d5-8b3c-edf5ca8ba230","Type":"ContainerDied","Data":"a4b4d62a845f92e4829cda98ff0510da2fde4ae4074f7d995b936011db91e5ce"}
Jul 15 17:27:33.201303 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.201228    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:27:33.244954 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.244921    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdb59\" (UniqueName: \"kubernetes.io/projected/52279d22-e586-44d5-8b3c-edf5ca8ba230-kube-api-access-vdb59\") pod \"52279d22-e586-44d5-8b3c-edf5ca8ba230\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") "
Jul 15 17:27:33.245186 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.244967    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-model-cache\") pod \"52279d22-e586-44d5-8b3c-edf5ca8ba230\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") "
Jul 15 17:27:33.245186 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245112    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-dshm\") pod \"52279d22-e586-44d5-8b3c-edf5ca8ba230\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") "
Jul 15 17:27:33.245329 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245193    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-home\") pod \"52279d22-e586-44d5-8b3c-edf5ca8ba230\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") "
Jul 15 17:27:33.245329 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245248    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-tmp-dir\") pod \"52279d22-e586-44d5-8b3c-edf5ca8ba230\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") "
Jul 15 17:27:33.245329 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245315    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-model-cache" (OuterVolumeSpecName: "model-cache") pod "52279d22-e586-44d5-8b3c-edf5ca8ba230" (UID: "52279d22-e586-44d5-8b3c-edf5ca8ba230"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:33.245496 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245331    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52279d22-e586-44d5-8b3c-edf5ca8ba230-tls-certs\") pod \"52279d22-e586-44d5-8b3c-edf5ca8ba230\" (UID: \"52279d22-e586-44d5-8b3c-edf5ca8ba230\") "
Jul 15 17:27:33.245553 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245494    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "52279d22-e586-44d5-8b3c-edf5ca8ba230" (UID: "52279d22-e586-44d5-8b3c-edf5ca8ba230"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:33.245553 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245531    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-home" (OuterVolumeSpecName: "home") pod "52279d22-e586-44d5-8b3c-edf5ca8ba230" (UID: "52279d22-e586-44d5-8b3c-edf5ca8ba230"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:33.245697 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245674    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-home\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:27:33.245697 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245697    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-tmp-dir\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:27:33.245895 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.245709    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-model-cache\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:27:33.247345 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.247313    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-dshm" (OuterVolumeSpecName: "dshm") pod "52279d22-e586-44d5-8b3c-edf5ca8ba230" (UID: "52279d22-e586-44d5-8b3c-edf5ca8ba230"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:33.247449 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.247406    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52279d22-e586-44d5-8b3c-edf5ca8ba230-kube-api-access-vdb59" (OuterVolumeSpecName: "kube-api-access-vdb59") pod "52279d22-e586-44d5-8b3c-edf5ca8ba230" (UID: "52279d22-e586-44d5-8b3c-edf5ca8ba230"). InnerVolumeSpecName "kube-api-access-vdb59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:27:33.247449 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.247440    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52279d22-e586-44d5-8b3c-edf5ca8ba230-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "52279d22-e586-44d5-8b3c-edf5ca8ba230" (UID: "52279d22-e586-44d5-8b3c-edf5ca8ba230"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:27:33.346130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.346088    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52279d22-e586-44d5-8b3c-edf5ca8ba230-tls-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:27:33.346130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.346121    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdb59\" (UniqueName: \"kubernetes.io/projected/52279d22-e586-44d5-8b3c-edf5ca8ba230-kube-api-access-vdb59\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:27:33.346130 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:33.346133    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52279d22-e586-44d5-8b3c-edf5ca8ba230-dshm\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:27:34.156844 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:34.156812    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"
Jul 15 17:27:34.157315 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:34.156821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw" event={"ID":"52279d22-e586-44d5-8b3c-edf5ca8ba230","Type":"ContainerDied","Data":"7002e63d61ebc24cf28061560731c105fdba8d8a947e0043725683152dc10f46"}
Jul 15 17:27:34.157315 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:34.156942    2567 scope.go:117] "RemoveContainer" containerID="a4b4d62a845f92e4829cda98ff0510da2fde4ae4074f7d995b936011db91e5ce"
Jul 15 17:27:34.183711 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:34.183684    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"]
Jul 15 17:27:34.185705 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:34.185685    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/sub-test-model-abaf36-kserve-5f64d68849-4wkvw"]
Jul 15 17:27:34.512341 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:34.512261    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52279d22-e586-44d5-8b3c-edf5ca8ba230" path="/var/lib/kubelet/pods/52279d22-e586-44d5-8b3c-edf5ca8ba230/volumes"
Jul 15 17:27:38.357010 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:38.356975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:27:57.158810 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:27:57.158727    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:28:12.165142 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:12.165109    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:28:27.755215 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:27.755177    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:28:34.756565 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:34.756527    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"]
Jul 15 17:28:39.456076 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.456031    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-139836660542000"]
Jul 15 17:28:39.456676 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.456563    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52279d22-e586-44d5-8b3c-edf5ca8ba230" containerName="main"
Jul 15 17:28:39.456676 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.456583    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="52279d22-e586-44d5-8b3c-edf5ca8ba230" containerName="main"
Jul 15 17:28:39.456807 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.456686    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="52279d22-e586-44d5-8b3c-edf5ca8ba230" containerName="main"
Jul 15 17:28:39.459802 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.459780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:39.462141 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.462117    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kmfwn\""
Jul 15 17:28:39.463546 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.463523    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660542000"]
Jul 15 17:28:39.529954 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.529912    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lbhd\" (UniqueName: \"kubernetes.io/projected/4dbd61e4-600c-4ec3-8e3a-23002e4913a1-kube-api-access-5lbhd\") pod \"test-curl-7542-139836660542000\" (UID: \"4dbd61e4-600c-4ec3-8e3a-23002e4913a1\") " pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:39.630883 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.630851    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lbhd\" (UniqueName: \"kubernetes.io/projected/4dbd61e4-600c-4ec3-8e3a-23002e4913a1-kube-api-access-5lbhd\") pod \"test-curl-7542-139836660542000\" (UID: \"4dbd61e4-600c-4ec3-8e3a-23002e4913a1\") " pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:39.638310 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.638279    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lbhd\" (UniqueName: \"kubernetes.io/projected/4dbd61e4-600c-4ec3-8e3a-23002e4913a1-kube-api-access-5lbhd\") pod \"test-curl-7542-139836660542000\" (UID: \"4dbd61e4-600c-4ec3-8e3a-23002e4913a1\") " pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:39.770890 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.770862    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:39.904526 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.904496    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660542000"]
Jul 15 17:28:39.906008 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:28:39.905985    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dbd61e4_600c_4ec3_8e3a_23002e4913a1.slice/crio-f9b3581a3f8af0f9fd1811df4cc5850724b1c325e2afafd5919210f2d1d92cf6 WatchSource:0}: Error finding container f9b3581a3f8af0f9fd1811df4cc5850724b1c325e2afafd5919210f2d1d92cf6: Status 404 returned error can't find the container with id f9b3581a3f8af0f9fd1811df4cc5850724b1c325e2afafd5919210f2d1d92cf6
Jul 15 17:28:39.907487 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:39.907466    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:28:40.502655 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:40.502621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660542000" event={"ID":"4dbd61e4-600c-4ec3-8e3a-23002e4913a1","Type":"ContainerStarted","Data":"f9b3581a3f8af0f9fd1811df4cc5850724b1c325e2afafd5919210f2d1d92cf6"}
Jul 15 17:28:41.511980 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:41.511892    2567 generic.go:356] "Generic (PLEG): container finished" podID="4dbd61e4-600c-4ec3-8e3a-23002e4913a1" containerID="c449eaba3da2fee47255799e142c8db2012f40d7c06c56801be331528a5cf2ad" exitCode=0
Jul 15 17:28:41.512364 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:41.511976    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660542000" event={"ID":"4dbd61e4-600c-4ec3-8e3a-23002e4913a1","Type":"ContainerDied","Data":"c449eaba3da2fee47255799e142c8db2012f40d7c06c56801be331528a5cf2ad"}
Jul 15 17:28:41.964037 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:41.963999    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:28:42.648281 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:42.648256    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:42.679240 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:42.679206    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7542-139836660542000_4dbd61e4-600c-4ec3-8e3a-23002e4913a1/test-curl-7542-139836660542000/0.log"
Jul 15 17:28:42.701434 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:42.701402    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-139836660542000"]
Jul 15 17:28:42.704360 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:42.704336    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-139836660542000"]
Jul 15 17:28:42.758006 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:42.757976    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lbhd\" (UniqueName: \"kubernetes.io/projected/4dbd61e4-600c-4ec3-8e3a-23002e4913a1-kube-api-access-5lbhd\") pod \"4dbd61e4-600c-4ec3-8e3a-23002e4913a1\" (UID: \"4dbd61e4-600c-4ec3-8e3a-23002e4913a1\") "
Jul 15 17:28:42.760133 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:42.760103    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dbd61e4-600c-4ec3-8e3a-23002e4913a1-kube-api-access-5lbhd" (OuterVolumeSpecName: "kube-api-access-5lbhd") pod "4dbd61e4-600c-4ec3-8e3a-23002e4913a1" (UID: "4dbd61e4-600c-4ec3-8e3a-23002e4913a1"). InnerVolumeSpecName "kube-api-access-5lbhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:42.859753 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:42.859659    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lbhd\" (UniqueName: \"kubernetes.io/projected/4dbd61e4-600c-4ec3-8e3a-23002e4913a1-kube-api-access-5lbhd\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:43.522729 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:43.522698    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9b3581a3f8af0f9fd1811df4cc5850724b1c325e2afafd5919210f2d1d92cf6"
Jul 15 17:28:43.522729 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:43.522725    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:43.532443 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:28:43.532416    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-139836660542000\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="4dbd61e4-600c-4ec3-8e3a-23002e4913a1" pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:44.511040 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:28:44.510999    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-139836660542000\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="4dbd61e4-600c-4ec3-8e3a-23002e4913a1" pod="opendatahub/test-curl-7542-139836660542000"
Jul 15 17:28:44.512470 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:44.512450    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dbd61e4-600c-4ec3-8e3a-23002e4913a1" path="/var/lib/kubelet/pods/4dbd61e4-600c-4ec3-8e3a-23002e4913a1/volumes"
Jul 15 17:28:45.483348 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.483314    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:45.483693 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.483677    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dbd61e4-600c-4ec3-8e3a-23002e4913a1" containerName="test-curl-7542-139836660542000"
Jul 15 17:28:45.483748 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.483695    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dbd61e4-600c-4ec3-8e3a-23002e4913a1" containerName="test-curl-7542-139836660542000"
Jul 15 17:28:45.483786 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.483758    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dbd61e4-600c-4ec3-8e3a-23002e4913a1" containerName="test-curl-7542-139836660542000"
Jul 15 17:28:45.486679 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.486664    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:45.488958 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.488937    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kmfwn\""
Jul 15 17:28:45.492599 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.492575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:45.585595 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.585561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89gl\" (UniqueName: \"kubernetes.io/projected/54a38319-1afe-4cde-82fa-876d3bfa0932-kube-api-access-n89gl\") pod \"test-curl-7542-139836660666416\" (UID: \"54a38319-1afe-4cde-82fa-876d3bfa0932\") " pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:45.686681 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.686645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89gl\" (UniqueName: \"kubernetes.io/projected/54a38319-1afe-4cde-82fa-876d3bfa0932-kube-api-access-n89gl\") pod \"test-curl-7542-139836660666416\" (UID: \"54a38319-1afe-4cde-82fa-876d3bfa0932\") " pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:45.694480 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.694455    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89gl\" (UniqueName: \"kubernetes.io/projected/54a38319-1afe-4cde-82fa-876d3bfa0932-kube-api-access-n89gl\") pod \"test-curl-7542-139836660666416\" (UID: \"54a38319-1afe-4cde-82fa-876d3bfa0932\") " pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:45.797726 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.797694    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:45.929628 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:45.929605    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:45.932475 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:28:45.932448    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54a38319_1afe_4cde_82fa_876d3bfa0932.slice/crio-87da859e247f40ec50adc820de9e92569e99e3d3971a907c1067508d84604c92 WatchSource:0}: Error finding container 87da859e247f40ec50adc820de9e92569e99e3d3971a907c1067508d84604c92: Status 404 returned error can't find the container with id 87da859e247f40ec50adc820de9e92569e99e3d3971a907c1067508d84604c92
Jul 15 17:28:46.538901 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:46.538866    2567 generic.go:356] "Generic (PLEG): container finished" podID="54a38319-1afe-4cde-82fa-876d3bfa0932" containerID="881a4667548c402b06e2fdf0fe7a25c3f6cf645543d5529ff5d6f05b9de91d4e" exitCode=0
Jul 15 17:28:46.539065 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:46.538916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660666416" event={"ID":"54a38319-1afe-4cde-82fa-876d3bfa0932","Type":"ContainerDied","Data":"881a4667548c402b06e2fdf0fe7a25c3f6cf645543d5529ff5d6f05b9de91d4e"}
Jul 15 17:28:46.539065 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:46.538956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660666416" event={"ID":"54a38319-1afe-4cde-82fa-876d3bfa0932","Type":"ContainerStarted","Data":"87da859e247f40ec50adc820de9e92569e99e3d3971a907c1067508d84604c92"}
Jul 15 17:28:47.677041 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:47.677017    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:47.696731 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:47.696707    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7542-139836660666416_54a38319-1afe-4cde-82fa-876d3bfa0932/test-curl-7542-139836660666416/0.log"
Jul 15 17:28:47.723872 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:47.723844    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:47.725892 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:47.725869    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:47.807420 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:47.807326    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n89gl\" (UniqueName: \"kubernetes.io/projected/54a38319-1afe-4cde-82fa-876d3bfa0932-kube-api-access-n89gl\") pod \"54a38319-1afe-4cde-82fa-876d3bfa0932\" (UID: \"54a38319-1afe-4cde-82fa-876d3bfa0932\") "
Jul 15 17:28:47.809357 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:47.809336    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54a38319-1afe-4cde-82fa-876d3bfa0932-kube-api-access-n89gl" (OuterVolumeSpecName: "kube-api-access-n89gl") pod "54a38319-1afe-4cde-82fa-876d3bfa0932" (UID: "54a38319-1afe-4cde-82fa-876d3bfa0932"). InnerVolumeSpecName "kube-api-access-n89gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:47.908276 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:47.908239    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n89gl\" (UniqueName: \"kubernetes.io/projected/54a38319-1afe-4cde-82fa-876d3bfa0932-kube-api-access-n89gl\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:48.514680 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:48.514636    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54a38319-1afe-4cde-82fa-876d3bfa0932" path="/var/lib/kubelet/pods/54a38319-1afe-4cde-82fa-876d3bfa0932/volumes"
Jul 15 17:28:48.550415 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:48.550386    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:48.550583 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:48.550418    2567 scope.go:117] "RemoveContainer" containerID="881a4667548c402b06e2fdf0fe7a25c3f6cf645543d5529ff5d6f05b9de91d4e"
Jul 15 17:28:49.777281 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:49.777240    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz" podUID="838fd092-fc84-482d-9e0f-0abcc04313f6" containerName="main" containerID="cri-o://e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea" gracePeriod=45
Jul 15 17:28:50.036812 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.036753    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:28:50.128882 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.128850    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-model-cache\") pod \"838fd092-fc84-482d-9e0f-0abcc04313f6\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") "
Jul 15 17:28:50.129051 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.128915    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-home\") pod \"838fd092-fc84-482d-9e0f-0abcc04313f6\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") "
Jul 15 17:28:50.129051 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.128966    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7l62\" (UniqueName: \"kubernetes.io/projected/838fd092-fc84-482d-9e0f-0abcc04313f6-kube-api-access-t7l62\") pod \"838fd092-fc84-482d-9e0f-0abcc04313f6\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") "
Jul 15 17:28:50.129051 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.128987    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838fd092-fc84-482d-9e0f-0abcc04313f6-tls-certs\") pod \"838fd092-fc84-482d-9e0f-0abcc04313f6\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") "
Jul 15 17:28:50.129051 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129012    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-dshm\") pod \"838fd092-fc84-482d-9e0f-0abcc04313f6\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") "
Jul 15 17:28:50.129322 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129061    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-tmp-dir\") pod \"838fd092-fc84-482d-9e0f-0abcc04313f6\" (UID: \"838fd092-fc84-482d-9e0f-0abcc04313f6\") "
Jul 15 17:28:50.129322 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129178    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "838fd092-fc84-482d-9e0f-0abcc04313f6" (UID: "838fd092-fc84-482d-9e0f-0abcc04313f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:50.129322 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129271    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-home" (OuterVolumeSpecName: "home") pod "838fd092-fc84-482d-9e0f-0abcc04313f6" (UID: "838fd092-fc84-482d-9e0f-0abcc04313f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:50.129472 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129387    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "838fd092-fc84-482d-9e0f-0abcc04313f6" (UID: "838fd092-fc84-482d-9e0f-0abcc04313f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:50.129606 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129589    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-tmp-dir\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:50.129670 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129608    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-model-cache\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:50.129670 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.129621    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-home\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:50.131221 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.131191    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/838fd092-fc84-482d-9e0f-0abcc04313f6-kube-api-access-t7l62" (OuterVolumeSpecName: "kube-api-access-t7l62") pod "838fd092-fc84-482d-9e0f-0abcc04313f6" (UID: "838fd092-fc84-482d-9e0f-0abcc04313f6"). InnerVolumeSpecName "kube-api-access-t7l62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:50.131221 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.131211    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/838fd092-fc84-482d-9e0f-0abcc04313f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "838fd092-fc84-482d-9e0f-0abcc04313f6" (UID: "838fd092-fc84-482d-9e0f-0abcc04313f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:28:50.131341 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.131211    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-dshm" (OuterVolumeSpecName: "dshm") pod "838fd092-fc84-482d-9e0f-0abcc04313f6" (UID: "838fd092-fc84-482d-9e0f-0abcc04313f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:50.230107 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.230068    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7l62\" (UniqueName: \"kubernetes.io/projected/838fd092-fc84-482d-9e0f-0abcc04313f6-kube-api-access-t7l62\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:50.230107 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.230101    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/838fd092-fc84-482d-9e0f-0abcc04313f6-tls-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:50.230107 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.230111    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/838fd092-fc84-482d-9e0f-0abcc04313f6-dshm\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:50.515409 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.515336    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:50.515666 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.515653    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54a38319-1afe-4cde-82fa-876d3bfa0932" containerName="test-curl-7542-139836660666416"
Jul 15 17:28:50.515666 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.515667    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="54a38319-1afe-4cde-82fa-876d3bfa0932" containerName="test-curl-7542-139836660666416"
Jul 15 17:28:50.515754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.515685    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="838fd092-fc84-482d-9e0f-0abcc04313f6" containerName="main"
Jul 15 17:28:50.515754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.515691    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="838fd092-fc84-482d-9e0f-0abcc04313f6" containerName="main"
Jul 15 17:28:50.515754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.515745    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="838fd092-fc84-482d-9e0f-0abcc04313f6" containerName="main"
Jul 15 17:28:50.515754 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.515754    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="54a38319-1afe-4cde-82fa-876d3bfa0932" containerName="test-curl-7542-139836660666416"
Jul 15 17:28:50.518763 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.518743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:50.521067 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.521048    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kmfwn\""
Jul 15 17:28:50.522904 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.522881    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:50.563477 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.563448    2567 generic.go:356] "Generic (PLEG): container finished" podID="838fd092-fc84-482d-9e0f-0abcc04313f6" containerID="e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea" exitCode=0
Jul 15 17:28:50.563641 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.563490    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"
Jul 15 17:28:50.563641 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.563538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz" event={"ID":"838fd092-fc84-482d-9e0f-0abcc04313f6","Type":"ContainerDied","Data":"e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea"}
Jul 15 17:28:50.563641 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.563581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz" event={"ID":"838fd092-fc84-482d-9e0f-0abcc04313f6","Type":"ContainerDied","Data":"dc570d442bd0a4ba732b12f1730e6c35f8cb8026ba31930e20a3fa89ec9c42df"}
Jul 15 17:28:50.563641 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.563602    2567 scope.go:117] "RemoveContainer" containerID="e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea"
Jul 15 17:28:50.572042 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.572026    2567 scope.go:117] "RemoveContainer" containerID="e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea"
Jul 15 17:28:50.572299 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:28:50.572282    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea\": container with ID starting with e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea not found: ID does not exist" containerID="e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea"
Jul 15 17:28:50.572373 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.572310    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea"} err="failed to get container status \"e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea\": rpc error: code = NotFound desc = could not find container \"e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea\": container with ID starting with e9e6b986ac1dc2c21227b067e07884049684448f26850c85af370fdc297f35ea not found: ID does not exist"
Jul 15 17:28:50.578348 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.578326    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"]
Jul 15 17:28:50.581954 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.581936    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/rate-test-model-abaf36-kserve-7997b48c95-97mkz"]
Jul 15 17:28:50.633604 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.633571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg6g8\" (UniqueName: \"kubernetes.io/projected/6a7e35da-c51d-4738-b2dc-184924d71b1e-kube-api-access-lg6g8\") pod \"test-curl-7542-139836660667424\" (UID: \"6a7e35da-c51d-4738-b2dc-184924d71b1e\") " pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:50.734070 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.734024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg6g8\" (UniqueName: \"kubernetes.io/projected/6a7e35da-c51d-4738-b2dc-184924d71b1e-kube-api-access-lg6g8\") pod \"test-curl-7542-139836660667424\" (UID: \"6a7e35da-c51d-4738-b2dc-184924d71b1e\") " pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:50.741975 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.741948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg6g8\" (UniqueName: \"kubernetes.io/projected/6a7e35da-c51d-4738-b2dc-184924d71b1e-kube-api-access-lg6g8\") pod \"test-curl-7542-139836660667424\" (UID: \"6a7e35da-c51d-4738-b2dc-184924d71b1e\") " pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:50.829701 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.829656    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:50.957302 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:50.957278    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:50.959762 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:28:50.959736    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a7e35da_c51d_4738_b2dc_184924d71b1e.slice/crio-bc82f247dfd127134dfb1c4beff200742a727168d71d03ec18d1de07d79a3e6e WatchSource:0}: Error finding container bc82f247dfd127134dfb1c4beff200742a727168d71d03ec18d1de07d79a3e6e: Status 404 returned error can't find the container with id bc82f247dfd127134dfb1c4beff200742a727168d71d03ec18d1de07d79a3e6e
Jul 15 17:28:51.570395 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:51.570301    2567 generic.go:356] "Generic (PLEG): container finished" podID="6a7e35da-c51d-4738-b2dc-184924d71b1e" containerID="8c5536f1f7cafcab5a561301e77191dbe62571d6cdd5abb6325b3950cb47fe94" exitCode=0
Jul 15 17:28:51.570556 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:51.570386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660667424" event={"ID":"6a7e35da-c51d-4738-b2dc-184924d71b1e","Type":"ContainerDied","Data":"8c5536f1f7cafcab5a561301e77191dbe62571d6cdd5abb6325b3950cb47fe94"}
Jul 15 17:28:51.570556 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:51.570426    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660667424" event={"ID":"6a7e35da-c51d-4738-b2dc-184924d71b1e","Type":"ContainerStarted","Data":"bc82f247dfd127134dfb1c4beff200742a727168d71d03ec18d1de07d79a3e6e"}
Jul 15 17:28:52.512501 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.512470    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="838fd092-fc84-482d-9e0f-0abcc04313f6" path="/var/lib/kubelet/pods/838fd092-fc84-482d-9e0f-0abcc04313f6/volumes"
Jul 15 17:28:52.710122 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.710098    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:52.728711 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.728682    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7542-139836660667424_6a7e35da-c51d-4738-b2dc-184924d71b1e/test-curl-7542-139836660667424/0.log"
Jul 15 17:28:52.753737 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.753708    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:52.755481 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.755460    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:52.853588 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.853530    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg6g8\" (UniqueName: \"kubernetes.io/projected/6a7e35da-c51d-4738-b2dc-184924d71b1e-kube-api-access-lg6g8\") pod \"6a7e35da-c51d-4738-b2dc-184924d71b1e\" (UID: \"6a7e35da-c51d-4738-b2dc-184924d71b1e\") "
Jul 15 17:28:52.855639 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.855612    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7e35da-c51d-4738-b2dc-184924d71b1e-kube-api-access-lg6g8" (OuterVolumeSpecName: "kube-api-access-lg6g8") pod "6a7e35da-c51d-4738-b2dc-184924d71b1e" (UID: "6a7e35da-c51d-4738-b2dc-184924d71b1e"). InnerVolumeSpecName "kube-api-access-lg6g8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:52.954822 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:52.954787    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg6g8\" (UniqueName: \"kubernetes.io/projected/6a7e35da-c51d-4738-b2dc-184924d71b1e-kube-api-access-lg6g8\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:28:53.592039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:53.592012    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:53.592039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:53.592025    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc82f247dfd127134dfb1c4beff200742a727168d71d03ec18d1de07d79a3e6e"
Jul 15 17:28:53.601698 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:28:53.601666    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-139836660667424\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="6a7e35da-c51d-4738-b2dc-184924d71b1e" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:54.510728 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:28:54.510679    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-139836660667424\" is forbidden: User \"system:node:ip-10-0-128-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-117.ec2.internal' and this object" podUID="6a7e35da-c51d-4738-b2dc-184924d71b1e" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:54.513535 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:28:54.513512    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a7e35da-c51d-4738-b2dc-184924d71b1e" path="/var/lib/kubelet/pods/6a7e35da-c51d-4738-b2dc-184924d71b1e/volumes"
Jul 15 17:29:06.660701 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:06.660669    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:29:18.689651 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:18.689606    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"]
Jul 15 17:29:18.690289 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:18.689888    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy" containerID="cri-o://8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8" gracePeriod=30
Jul 15 17:29:23.951677 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:23.951648    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:29:24.019258 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019228    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-credential-socket\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019310    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-envoy\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019337    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-podinfo\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019363    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-data\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019401    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istiod-ca-cert\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019450 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019424    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vglgh\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-kube-api-access-vglgh\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019718 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019457    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-certs\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019718 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019502    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-socket\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019718 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019528    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-token\") pod \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\" (UID: \"f72e1f20-9ca2-4e93-bd09-27c995eab01d\") "
Jul 15 17:29:24.019718 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019520    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:24.019921 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019772    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.019921 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019782    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:24.019921 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019796    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:24.019921 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.019845    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:29:24.020503 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.020478    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:24.021660 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.021637    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:24.021766 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.021645    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:29:24.021999 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.021979    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:29:24.022098 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.022008    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-kube-api-access-vglgh" (OuterVolumeSpecName: "kube-api-access-vglgh") pod "f72e1f20-9ca2-4e93-bd09-27c995eab01d" (UID: "f72e1f20-9ca2-4e93-bd09-27c995eab01d"). InnerVolumeSpecName "kube-api-access-vglgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:29:24.120227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120180    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.120227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120221    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.120227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120231    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.120227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120240    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.120227 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120247    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.120535 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120256    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f72e1f20-9ca2-4e93-bd09-27c995eab01d-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.120535 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120264    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vglgh\" (UniqueName: \"kubernetes.io/projected/f72e1f20-9ca2-4e93-bd09-27c995eab01d-kube-api-access-vglgh\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.120535 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.120272    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f72e1f20-9ca2-4e93-bd09-27c995eab01d-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:24.750918 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.750881    2567 generic.go:356] "Generic (PLEG): container finished" podID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerID="8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8" exitCode=0
Jul 15 17:29:24.750918 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.750924    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" event={"ID":"f72e1f20-9ca2-4e93-bd09-27c995eab01d","Type":"ContainerDied","Data":"8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8"}
Jul 15 17:29:24.751125 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.750939    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"
Jul 15 17:29:24.751125 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.750966    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc" event={"ID":"f72e1f20-9ca2-4e93-bd09-27c995eab01d","Type":"ContainerDied","Data":"4c6c4af253f2895edbd76b2b9f2f83b52b99e77e96e56b7acceee45027e5c2c5"}
Jul 15 17:29:24.751125 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.750988    2567 scope.go:117] "RemoveContainer" containerID="8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8"
Jul 15 17:29:24.759723 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.759697    2567 scope.go:117] "RemoveContainer" containerID="ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53"
Jul 15 17:29:24.767724 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.767707    2567 scope.go:117] "RemoveContainer" containerID="8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8"
Jul 15 17:29:24.767990 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:29:24.767972    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8\": container with ID starting with 8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8 not found: ID does not exist" containerID="8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8"
Jul 15 17:29:24.768049 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.768003    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8"} err="failed to get container status \"8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8\": rpc error: code = NotFound desc = could not find container \"8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8\": container with ID starting with 8042225cac3c8d7416517a572271c7b11f276507ad3657175f11b4068d1e36b8 not found: ID does not exist"
Jul 15 17:29:24.768049 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.768021    2567 scope.go:117] "RemoveContainer" containerID="ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53"
Jul 15 17:29:24.768141 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.767979    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"]
Jul 15 17:29:24.768288 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:29:24.768271    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53\": container with ID starting with ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53 not found: ID does not exist" containerID="ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53"
Jul 15 17:29:24.768338 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.768304    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53"} err="failed to get container status \"ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53\": rpc error: code = NotFound desc = could not find container \"ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53\": container with ID starting with ce59f6f38f56e7cfa279cda26749c4c6224553d3ff1c7bec9671b4513f2c3f53 not found: ID does not exist"
Jul 15 17:29:24.771497 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:24.771440    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-abaf36-openshift-default-59685fbb47-sh2vc"]
Jul 15 17:29:26.512196 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:26.512095    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" path="/var/lib/kubelet/pods/f72e1f20-9ca2-4e93-bd09-27c995eab01d/volumes"
Jul 15 17:29:32.458533 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:32.458499    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4qqc5"]
Jul 15 17:29:44.777281 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:44.777245    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"]
Jul 15 17:29:44.777758 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:44.777512    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy" containerID="cri-o://5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca" gracePeriod=30
Jul 15 17:29:50.040781 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.040753    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:29:50.156604 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156510    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-envoy\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156604 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156555    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzkms\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-kube-api-access-vzkms\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156604 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156578    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-podinfo\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156894 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156619    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-certs\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156894 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156636    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istiod-ca-cert\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156894 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156686    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-token\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156894 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156741    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-socket\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156894 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156769    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-credential-socket\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.156894 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156796    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-data\") pod \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\" (UID: \"52c89746-bd48-4eb8-8f56-b07348ae3b0d\") "
Jul 15 17:29:50.157218 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.156967    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:50.157218 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.157043    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:29:50.157218 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.157091    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-certs\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.157382 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.157276    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:50.157382 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.157334    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:50.157967 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.157938    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-data" (OuterVolumeSpecName: "istio-data") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:50.158927 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.158901    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-kube-api-access-vzkms" (OuterVolumeSpecName: "kube-api-access-vzkms") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "kube-api-access-vzkms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:29:50.158927 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.158915    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 17:29:50.158927 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.158921    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:29:50.159088 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.159026    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "52c89746-bd48-4eb8-8f56-b07348ae3b0d" (UID: "52c89746-bd48-4eb8-8f56-b07348ae3b0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:29:50.258468 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258427    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-token\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.258468 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258462    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-workload-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.258468 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258474    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-credential-socket\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.258713 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258484    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-data\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.258713 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258493    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-envoy\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.258713 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258501    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzkms\" (UniqueName: \"kubernetes.io/projected/52c89746-bd48-4eb8-8f56-b07348ae3b0d-kube-api-access-vzkms\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.258713 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258510    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istio-podinfo\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.258713 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.258518    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52c89746-bd48-4eb8-8f56-b07348ae3b0d-istiod-ca-cert\") on node \"ip-10-0-128-117.ec2.internal\" DevicePath \"\""
Jul 15 17:29:50.743331 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.743303    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lpx5x_e0383adb-3496-4d46-9c66-4c70b7e34d54/manager/0.log"
Jul 15 17:29:50.867114 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.867037    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8hbll_e58f5b32-f225-4087-9ad8-c988d68cf33b/manager/0.log"
Jul 15 17:29:50.881574 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.881542    2567 generic.go:356] "Generic (PLEG): container finished" podID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerID="5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca" exitCode=0
Jul 15 17:29:50.881723 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.881590    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"
Jul 15 17:29:50.881723 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.881629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" event={"ID":"52c89746-bd48-4eb8-8f56-b07348ae3b0d","Type":"ContainerDied","Data":"5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca"}
Jul 15 17:29:50.881723 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.881683    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn" event={"ID":"52c89746-bd48-4eb8-8f56-b07348ae3b0d","Type":"ContainerDied","Data":"a1c7fc6b53eabbf2ba5fe30ebc846dfff1d08d802389acd81129c4916d0b58ef"}
Jul 15 17:29:50.881723 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.881708    2567 scope.go:117] "RemoveContainer" containerID="5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca"
Jul 15 17:29:50.890429 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.890412    2567 scope.go:117] "RemoveContainer" containerID="901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1"
Jul 15 17:29:50.898370 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.898343    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"]
Jul 15 17:29:50.898902 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.898779    2567 scope.go:117] "RemoveContainer" containerID="5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca"
Jul 15 17:29:50.899062 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:29:50.899046    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca\": container with ID starting with 5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca not found: ID does not exist" containerID="5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca"
Jul 15 17:29:50.899109 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.899070    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca"} err="failed to get container status \"5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca\": rpc error: code = NotFound desc = could not find container \"5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca\": container with ID starting with 5eaed195cfa025e8f4054ae2a868b58b41705629cdd86ad0825d673b8d8bcbca not found: ID does not exist"
Jul 15 17:29:50.899109 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.899086    2567 scope.go:117] "RemoveContainer" containerID="901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1"
Jul 15 17:29:50.899341 ip-10-0-128-117 kubenswrapper[2567]: E0715 17:29:50.899324    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1\": container with ID starting with 901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1 not found: ID does not exist" containerID="901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1"
Jul 15 17:29:50.899395 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.899345    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1"} err="failed to get container status \"901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1\": rpc error: code = NotFound desc = could not find container \"901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1\": container with ID starting with 901ebade85b02f803f0257e32daa17394826fe347fbdc60642ebff0a200749d1 not found: ID does not exist"
Jul 15 17:29:50.902787 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:50.902767    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1e0e66-openshift-default-6bdfc87b5f-bbztn"]
Jul 15 17:29:51.124520 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:51.124437    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vn8m9_30ad39dc-0f1a-4833-aa56-9b217e8baca3/server/0.log"
Jul 15 17:29:51.253337 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:51.253310    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8rfw9_af3ac226-cd42-48e4-bac9-803eb66fe87d/manager/0.log"
Jul 15 17:29:51.364948 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:51.364922    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-6pszw_be3759e9-51ce-4662-a32d-f781230813de/copy-manifests/0.log"
Jul 15 17:29:51.370927 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:51.370907    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-6pszw_be3759e9-51ce-4662-a32d-f781230813de/manager/0.log"
Jul 15 17:29:52.518987 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:52.518951    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" path="/var/lib/kubelet/pods/52c89746-bd48-4eb8-8f56-b07348ae3b0d/volumes"
Jul 15 17:29:54.439081 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.439054    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs_030c32be-f1df-4d0e-ac61-0672cccb93fc/util/0.log"
Jul 15 17:29:54.445039 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.445018    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs_030c32be-f1df-4d0e-ac61-0672cccb93fc/pull/0.log"
Jul 15 17:29:54.450673 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.450638    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs_030c32be-f1df-4d0e-ac61-0672cccb93fc/extract/0.log"
Jul 15 17:29:54.564994 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.564966    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r_16810751-82c8-4124-8fad-978437de5355/util/0.log"
Jul 15 17:29:54.570857 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.570830    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r_16810751-82c8-4124-8fad-978437de5355/pull/0.log"
Jul 15 17:29:54.576558 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.576522    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r_16810751-82c8-4124-8fad-978437de5355/extract/0.log"
Jul 15 17:29:54.685127 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.685095    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh_0e32799b-129a-45d3-94e2-83da83fa3318/extract/0.log"
Jul 15 17:29:54.691327 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.691254    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh_0e32799b-129a-45d3-94e2-83da83fa3318/util/0.log"
Jul 15 17:29:54.697790 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.697764    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh_0e32799b-129a-45d3-94e2-83da83fa3318/pull/0.log"
Jul 15 17:29:54.808299 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.808256    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs_e9635722-bfcd-4b7e-aefa-c95879a2e9f7/pull/0.log"
Jul 15 17:29:54.814131 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.814114    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs_e9635722-bfcd-4b7e-aefa-c95879a2e9f7/extract/0.log"
Jul 15 17:29:54.819670 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:54.819651    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs_e9635722-bfcd-4b7e-aefa-c95879a2e9f7/util/0.log"
Jul 15 17:29:55.064101 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:55.064063    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kxdk7_0ff688ae-27e4-480e-ad08-ad2be4f38f67/manager/0.log"
Jul 15 17:29:55.405546 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:55.405463    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2fc82_dd7e8f74-e000-41c3-9873-d8eb06dd432d/registry-server/0.log"
Jul 15 17:29:55.655919 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:55.655840    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4qqc5_760bea16-9f05-40af-98ce-3d321620b56d/limitador/0.log"
Jul 15 17:29:55.775769 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:55.775740    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t4wtl_181509e1-d6f0-4f61-a5ed-b40ebf52b222/manager/0.log"
Jul 15 17:29:56.142960 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:56.142932    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vmvbk_0d65a846-e695-46bf-8e23-a21c04951b64/istio-proxy/0.log"
Jul 15 17:29:56.483279 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:56.483198    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-9jnkk_f23f2409-0021-42ad-892b-b7e505340971/kube-auth-proxy/0.log"
Jul 15 17:29:56.599201 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:56.599175    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mzhbs_e4c45937-07d3-4048-9ff0-5adfd1c0b5e7/istio-proxy/1.log"
Jul 15 17:29:57.623222 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:57.623192    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8wqqx_382ec040-7444-442e-afbb-9a70e859dc24/main/0.log"
Jul 15 17:29:57.840663 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:29:57.840634    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-csh97_1105e369-502e-4360-94b6-82419f6f42ce/main/0.log"
Jul 15 17:30:04.630905 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:04.630872    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:30:04.639861 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:04.639840    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:30:06.795267 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:06.795235    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n552f_56388b74-ab17-4c4c-acdb-73c8f622def6/global-pull-secret-syncer/0.log"
Jul 15 17:30:06.903602 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:06.903574    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h642p_6cff1f46-7be5-4a8e-82fd-58a656401570/konnectivity-agent/0.log"
Jul 15 17:30:06.922438 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:06.922407    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-117.ec2.internal_be6ba1ae2b4e46007e8cd92cba1cbdb0/haproxy/0.log"
Jul 15 17:30:11.544755 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.544731    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs_030c32be-f1df-4d0e-ac61-0672cccb93fc/extract/0.log"
Jul 15 17:30:11.564692 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.564668    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs_030c32be-f1df-4d0e-ac61-0672cccb93fc/util/0.log"
Jul 15 17:30:11.586062 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.586035    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759blrbs_030c32be-f1df-4d0e-ac61-0672cccb93fc/pull/0.log"
Jul 15 17:30:11.620767 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.620743    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r_16810751-82c8-4124-8fad-978437de5355/extract/0.log"
Jul 15 17:30:11.641414 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.641388    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r_16810751-82c8-4124-8fad-978437de5355/util/0.log"
Jul 15 17:30:11.658534 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.658506    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rhg9r_16810751-82c8-4124-8fad-978437de5355/pull/0.log"
Jul 15 17:30:11.684575 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.684550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh_0e32799b-129a-45d3-94e2-83da83fa3318/extract/0.log"
Jul 15 17:30:11.704546 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.704524    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh_0e32799b-129a-45d3-94e2-83da83fa3318/util/0.log"
Jul 15 17:30:11.723607 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.723581    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rhwlh_0e32799b-129a-45d3-94e2-83da83fa3318/pull/0.log"
Jul 15 17:30:11.748055 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.748020    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs_e9635722-bfcd-4b7e-aefa-c95879a2e9f7/extract/0.log"
Jul 15 17:30:11.768992 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.768968    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs_e9635722-bfcd-4b7e-aefa-c95879a2e9f7/util/0.log"
Jul 15 17:30:11.787870 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:11.787848    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7wxs_e9635722-bfcd-4b7e-aefa-c95879a2e9f7/pull/0.log"
Jul 15 17:30:12.250932 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:12.250898    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kxdk7_0ff688ae-27e4-480e-ad08-ad2be4f38f67/manager/0.log"
Jul 15 17:30:12.354261 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:12.354222    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2fc82_dd7e8f74-e000-41c3-9873-d8eb06dd432d/registry-server/0.log"
Jul 15 17:30:12.532250 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:12.532222    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4qqc5_760bea16-9f05-40af-98ce-3d321620b56d/limitador/0.log"
Jul 15 17:30:12.593070 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:12.593038    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t4wtl_181509e1-d6f0-4f61-a5ed-b40ebf52b222/manager/0.log"
Jul 15 17:30:14.597963 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:14.597929    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfp9g_449eabd7-6e61-47f7-84ec-c4f952988793/node-exporter/0.log"
Jul 15 17:30:14.622376 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:14.622349    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfp9g_449eabd7-6e61-47f7-84ec-c4f952988793/kube-rbac-proxy/0.log"
Jul 15 17:30:14.646921 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:14.646891    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfp9g_449eabd7-6e61-47f7-84ec-c4f952988793/init-textfile/0.log"
Jul 15 17:30:17.401808 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.401774    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"]
Jul 15 17:30:17.402232 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402142    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy"
Jul 15 17:30:17.402232 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402173    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy"
Jul 15 17:30:17.402232 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402198    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy"
Jul 15 17:30:17.402232 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402206    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy"
Jul 15 17:30:17.402232 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402218    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy"
Jul 15 17:30:17.402232 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402226    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402248    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402257    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402266    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a7e35da-c51d-4738-b2dc-184924d71b1e" containerName="test-curl-7542-139836660667424"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402276    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a7e35da-c51d-4738-b2dc-184924d71b1e" containerName="test-curl-7542-139836660667424"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402362    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402375    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f72e1f20-9ca2-4e93-bd09-27c995eab01d" containerName="istio-proxy"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402385    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402394    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a7e35da-c51d-4738-b2dc-184924d71b1e" containerName="test-curl-7542-139836660667424"
Jul 15 17:30:17.402440 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.402403    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c89746-bd48-4eb8-8f56-b07348ae3b0d" containerName="istio-proxy"
Jul 15 17:30:17.405288 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.405273    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.407533 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.407514    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfgvt\"/\"default-dockercfg-zs575\""
Jul 15 17:30:17.407638 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.407514    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfgvt\"/\"openshift-service-ca.crt\""
Jul 15 17:30:17.408818 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.408798    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfgvt\"/\"kube-root-ca.crt\""
Jul 15 17:30:17.414397 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.414374    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"]
Jul 15 17:30:17.481933 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.481894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-lib-modules\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.481933 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.481933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-proc\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.482188 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.481964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-sys\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.482188 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.482009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkjf\" (UniqueName: \"kubernetes.io/projected/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-kube-api-access-fpkjf\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.482188 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.482093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-podres\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583347 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583306    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-lib-modules\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583347 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-proc\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583565 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-proc\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583565 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583492    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-lib-modules\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583565 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-sys\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583565 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkjf\" (UniqueName: \"kubernetes.io/projected/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-kube-api-access-fpkjf\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583714 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-sys\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583757 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-podres\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.583816 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.583801    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-podres\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.590588 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.590562    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkjf\" (UniqueName: \"kubernetes.io/projected/5ee15f1e-5347-44a1-aa7e-e6e661ac905e-kube-api-access-fpkjf\") pod \"perf-node-gather-daemonset-p2ftp\" (UID: \"5ee15f1e-5347-44a1-aa7e-e6e661ac905e\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.715791 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.715699    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:17.847637 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:17.847611    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"]
Jul 15 17:30:17.849479 ip-10-0-128-117 kubenswrapper[2567]: W0715 17:30:17.849454    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5ee15f1e_5347_44a1_aa7e_e6e661ac905e.slice/crio-3027122c17d9de9070570a970ee937028aa0b95cfa74496d70684a724fb6092a WatchSource:0}: Error finding container 3027122c17d9de9070570a970ee937028aa0b95cfa74496d70684a724fb6092a: Status 404 returned error can't find the container with id 3027122c17d9de9070570a970ee937028aa0b95cfa74496d70684a724fb6092a
Jul 15 17:30:18.019792 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:18.019755    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp" event={"ID":"5ee15f1e-5347-44a1-aa7e-e6e661ac905e","Type":"ContainerStarted","Data":"c0bc8a13c2e6c0ff670924489245ae4c8d520b4178ae9581906e5fb60db2a381"}
Jul 15 17:30:18.019982 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:18.019807    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp" event={"ID":"5ee15f1e-5347-44a1-aa7e-e6e661ac905e","Type":"ContainerStarted","Data":"3027122c17d9de9070570a970ee937028aa0b95cfa74496d70684a724fb6092a"}
Jul 15 17:30:18.019982 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:18.019917    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:18.035835 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:18.035785    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp" podStartSLOduration=1.0357708350000001 podStartE2EDuration="1.035770835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:30:18.034094916 +0000 UTC m=+3014.129033191" watchObservedRunningTime="2026-07-15 17:30:18.035770835 +0000 UTC m=+3014.130709080"
Jul 15 17:30:19.449293 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:19.449261    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gfpv_a8982b58-c491-4f5b-a84b-acdc2fbb5871/dns/0.log"
Jul 15 17:30:19.467283 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:19.467257    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gfpv_a8982b58-c491-4f5b-a84b-acdc2fbb5871/kube-rbac-proxy/0.log"
Jul 15 17:30:19.592739 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:19.592708    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q45nk_d4e1682f-2f0a-4945-b01d-5889222a5e7b/dns-node-resolver/0.log"
Jul 15 17:30:20.165571 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:20.165544    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g4z9q_6c15626e-2185-4ab7-a7a9-93978773b854/node-ca/0.log"
Jul 15 17:30:21.106480 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:21.106455    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vmvbk_0d65a846-e695-46bf-8e23-a21c04951b64/istio-proxy/0.log"
Jul 15 17:30:21.259188 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:21.259144    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-9jnkk_f23f2409-0021-42ad-892b-b7e505340971/kube-auth-proxy/0.log"
Jul 15 17:30:21.284512 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:21.284481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mzhbs_e4c45937-07d3-4048-9ff0-5adfd1c0b5e7/istio-proxy/0.log"
Jul 15 17:30:21.314742 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:21.314710    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mzhbs_e4c45937-07d3-4048-9ff0-5adfd1c0b5e7/istio-proxy/1.log"
Jul 15 17:30:22.074547 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:22.074519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gflqs_f3ef9fac-7a4c-492b-9e54-4da1f2d5cc15/serve-healthcheck-canary/0.log"
Jul 15 17:30:22.644484 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:22.644455    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pgzbs_0d7e2767-985d-4718-af6e-a2833042f62d/kube-rbac-proxy/0.log"
Jul 15 17:30:22.662880 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:22.662855    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pgzbs_0d7e2767-985d-4718-af6e-a2833042f62d/exporter/0.log"
Jul 15 17:30:22.680535 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:22.680513    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pgzbs_0d7e2767-985d-4718-af6e-a2833042f62d/extractor/0.log"
Jul 15 17:30:24.034610 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:24.034584    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-p2ftp"
Jul 15 17:30:24.921031 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:24.921005    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lpx5x_e0383adb-3496-4d46-9c66-4c70b7e34d54/manager/0.log"
Jul 15 17:30:25.043040 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:25.043010    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8hbll_e58f5b32-f225-4087-9ad8-c988d68cf33b/manager/0.log"
Jul 15 17:30:25.161184 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:25.161146    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vn8m9_30ad39dc-0f1a-4833-aa56-9b217e8baca3/server/0.log"
Jul 15 17:30:25.223758 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:25.223679    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8rfw9_af3ac226-cd42-48e4-bac9-803eb66fe87d/manager/0.log"
Jul 15 17:30:25.246888 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:25.246861    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-6pszw_be3759e9-51ce-4662-a32d-f781230813de/manager/0.log"
Jul 15 17:30:25.264816 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:25.264791    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-6pszw_be3759e9-51ce-4662-a32d-f781230813de/copy-manifests/0.log"
Jul 15 17:30:26.778572 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:26.778540    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-s58zd_b066f42f-8e3d-417e-9b00-ad2caa71409f/openshift-lws-operator/0.log"
Jul 15 17:30:28.242617 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:28.242596    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vmvbk_0d65a846-e695-46bf-8e23-a21c04951b64/istio-proxy/0.log"
Jul 15 17:30:28.378216 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:28.378186    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-9jnkk_f23f2409-0021-42ad-892b-b7e505340971/kube-auth-proxy/0.log"
Jul 15 17:30:28.395388 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:28.395363    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mzhbs_e4c45937-07d3-4048-9ff0-5adfd1c0b5e7/istio-proxy/0.log"
Jul 15 17:30:28.424018 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:28.423983    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mzhbs_e4c45937-07d3-4048-9ff0-5adfd1c0b5e7/istio-proxy/1.log"
Jul 15 17:30:29.822363 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:29.822326    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vmvbk_0d65a846-e695-46bf-8e23-a21c04951b64/istio-proxy/0.log"
Jul 15 17:30:29.959419 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:29.959388    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-9jnkk_f23f2409-0021-42ad-892b-b7e505340971/kube-auth-proxy/0.log"
Jul 15 17:30:29.980505 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:29.980467    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mzhbs_e4c45937-07d3-4048-9ff0-5adfd1c0b5e7/istio-proxy/0.log"
Jul 15 17:30:30.014973 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:30.014939    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mzhbs_e4c45937-07d3-4048-9ff0-5adfd1c0b5e7/istio-proxy/1.log"
Jul 15 17:30:33.598078 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.598052    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p89n2_e692baf8-fd87-47de-b13d-a13e658b6036/kube-multus-additional-cni-plugins/0.log"
Jul 15 17:30:33.616117 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.616039    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p89n2_e692baf8-fd87-47de-b13d-a13e658b6036/egress-router-binary-copy/0.log"
Jul 15 17:30:33.634213 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.634187    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p89n2_e692baf8-fd87-47de-b13d-a13e658b6036/cni-plugins/0.log"
Jul 15 17:30:33.651863 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.651837    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p89n2_e692baf8-fd87-47de-b13d-a13e658b6036/bond-cni-plugin/0.log"
Jul 15 17:30:33.674148 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.674126    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p89n2_e692baf8-fd87-47de-b13d-a13e658b6036/routeoverride-cni/0.log"
Jul 15 17:30:33.694298 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.694273    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p89n2_e692baf8-fd87-47de-b13d-a13e658b6036/whereabouts-cni-bincopy/0.log"
Jul 15 17:30:33.713667 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.713644    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p89n2_e692baf8-fd87-47de-b13d-a13e658b6036/whereabouts-cni/0.log"
Jul 15 17:30:33.809383 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.809346    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pqh2w_9d6993f7-f1bb-4688-903b-506daf290787/kube-multus/0.log"
Jul 15 17:30:33.830252 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.830223    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bwrkn_8b96e872-053b-4450-a7e1-78c603d5a916/network-metrics-daemon/0.log"
Jul 15 17:30:33.847389 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:33.847362    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bwrkn_8b96e872-053b-4450-a7e1-78c603d5a916/kube-rbac-proxy/0.log"
Jul 15 17:30:34.922749 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:34.922718    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-controller/0.log"
Jul 15 17:30:34.936899 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:34.936875    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/1.log"
Jul 15 17:30:34.937049 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:34.936901    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovn-acl-logging/0.log"
Jul 15 17:30:34.953843 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:34.953815    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/kube-rbac-proxy-node/0.log"
Jul 15 17:30:34.972836 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:34.972805    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/kube-rbac-proxy-ovn-metrics/0.log"
Jul 15 17:30:34.991397 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:34.991373    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/northd/0.log"
Jul 15 17:30:35.009837 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:35.009815    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/nbdb/0.log"
Jul 15 17:30:35.028291 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:35.028260    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/sbdb/0.log"
Jul 15 17:30:35.079311 ip-10-0-128-117 kubenswrapper[2567]: I0715 17:30:35.079283    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk6ml_53e5ae0f-1553-4e6e-88ec-ce171bd8a423/ovnkube-controller/0.log"