Sep 18 13:42:19.219062 ip-10-0-132-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 13:42:19.219074 ip-10-0-132-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 13:42:19.219083 ip-10-0-132-244 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 13:42:19.219409 ip-10-0-132-244 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 13:42:29.278423 ip-10-0-132-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 13:42:29.278443 ip-10-0-132-244 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4da715a1822a4d0d8788a70ad465fe6c --
Sep 18 13:44:11.198960 ip-10-0-132-244 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 13:44:11.620648 ip-10-0-132-244 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:11.620648 ip-10-0-132-244 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 13:44:11.620648 ip-10-0-132-244 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:11.620648 ip-10-0-132-244 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 13:44:11.620648 ip-10-0-132-244 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 13:44:11.623290 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.623193    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 13:44:11.628209 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628188    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628213    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628217    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628220    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628223    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628226    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628229    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628234    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628238    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628241    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628245    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628248    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628251    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628254    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:11.628252 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628257    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628266    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628269    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628271    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628274    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628278    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628282    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628285    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628287    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628289    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628292    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628295    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628297    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628300    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628302    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628305    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628307    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628309    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628312    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628315    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:11.628584 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628318    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628321    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628323    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628326    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628329    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628331    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628334    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628337    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628339    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628342    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628345    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628348    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628350    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628353    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628356    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628358    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628361    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628363    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628366    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:11.629075 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628368    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628370    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628373    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628376    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628378    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628380    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628383    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628386    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628388    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628391    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628393    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628396    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628398    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628402    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628405    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628407    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628410    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628413    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628415    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628418    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:11.629534 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628420    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628423    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628425    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628428    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628430    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628432    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628435    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628437    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628440    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628442    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628447    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628451    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628455    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628458    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628461    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628463    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628466    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628469    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628472    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:11.630072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628474    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628477    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628480    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628482    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628485    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628487    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.628490    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629263    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629271    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629275    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629278    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629281    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629284    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629287    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629289    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629292    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629295    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629299    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629303    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:11.630648 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629306    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629310    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629313    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629316    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629319    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629321    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629324    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629326    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629329    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629332    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629335    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629337    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629340    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629343    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629346    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629349    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629351    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629354    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629358    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629361    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:11.631149 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629364    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629367    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629371    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629375    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629378    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629381    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629384    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629387    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629390    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629392    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629395    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629397    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629400    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629402    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629405    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629408    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629410    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629412    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629415    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:11.631646 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629417    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629420    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629422    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629425    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629427    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629430    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629433    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629435    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629438    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629441    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629444    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629446    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629449    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629451    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629453    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629456    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629458    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629461    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629463    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629466    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:11.632118 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629469    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629471    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629474    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629476    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629478    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629481    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629483    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629486    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629489    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629491    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629494    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629496    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629498    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629501    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629503    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629506    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629508    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629511    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629518    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:11.632625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629520    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629523    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629525    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629528    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629531    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629533    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629536    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629538    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629541    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629927    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629932    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629935    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629938    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629941    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629944    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629946    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629949    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629952    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629954    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629957    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:11.633093 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629959    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629962    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629965    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629967    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629970    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629974    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629977    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629981    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629983    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629986    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629989    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629993    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629995    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.629998    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630000    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630003    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630005    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630007    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630010    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630012    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:11.633565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630015    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630017    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630020    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630023    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630026    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630028    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630033    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630036    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630039    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630042    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630044    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630047    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630050    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630052    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630054    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630057    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630059    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630062    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630064    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:11.634086 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630066    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630068    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630071    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630074    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630076    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630079    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630082    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630084    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630087    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630089    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630092    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630094    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630096    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630099    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630102    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630104    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630107    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630109    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630111    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:11.634552 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630114    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630117    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630119    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630122    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630124    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630127    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630129    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630131    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630133    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630136    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630138    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630141    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630144    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630147    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630150    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630152    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630155    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630157    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630163    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630166    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:11.635045 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630169    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630171    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630173    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630176    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630178    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630181    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630183    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630185    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630188    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630190    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630274    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630309    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630319    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630323    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630328    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630331    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630335    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630340    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630343    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630346    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630350    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630353    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 13:44:11.635521 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630356    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630359    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630362    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630364    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630367    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630370    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630374    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630377    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630382    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630385    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630388    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630392    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630395    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630398    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630401    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630404    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630407    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630410    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630413    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630416    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630420    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630423    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630425    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630428    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630431    2578 flags.go:64] FLAG: --enable-server="true"
Sep 18 13:44:11.636099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630436    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630441    2578 flags.go:64] FLAG: --event-burst="100"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630444    2578 flags.go:64] FLAG: --event-qps="50"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630447    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630449    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630452    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630456    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630459    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630461    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630464    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630467    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630470    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630473    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630476    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630478    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630483    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630485    2578 flags.go:64] FLAG: --feature-gates=""
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630489    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630492    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630495    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630498    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630501    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630504    2578 flags.go:64] FLAG: --help="false"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630507    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-132-244.ec2.internal"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630510    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 13:44:11.636720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630513    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630516    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630519    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630522    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630525    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630528    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630530    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630534    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630538    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630541    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630544    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630547    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630550    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630552    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630555    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630558    2578 flags.go:64] FLAG: --lock-file=""
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630561    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630564    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630567    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630573    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630576    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630578    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630582    2578 flags.go:64] FLAG: --logging-format="text"
Sep 18 13:44:11.637335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630585    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630588    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630591    2578 flags.go:64] FLAG: --manifest-url=""
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630594    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630601    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630619    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630627    2578 flags.go:64] FLAG: --max-pods="110"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630630    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630633    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630636    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630639    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630642    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630645    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630648    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630656    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630659    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630663    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630666    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630669    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630675    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630677    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630680    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630683    2578 flags.go:64] FLAG: --port="10250"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630686    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 13:44:11.637907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630689    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d735a0c206ca7292"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630693    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630696    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630699    2578 flags.go:64] FLAG: --register-node="true"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630702    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630705    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630708    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630712    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630714    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630718    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630721    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630724    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630727    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630730    2578 flags.go:64] FLAG: --runonce="false"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630733    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630736    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630739    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630742    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630745    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630748    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630750    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630754    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630756    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630759    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630761    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630765    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 13:44:11.638522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630768    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630772    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630775    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630780    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630782    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630785    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630789    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630792    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630794    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630797    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630800    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630803    2578 flags.go:64] FLAG: --v="2"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630807    2578 flags.go:64] FLAG: --version="false"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630811    2578 flags.go:64] FLAG: --vmodule=""
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630815    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.630818    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630933    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630936    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630939    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630941    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630944    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630947    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630950    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:11.639174 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630952    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630955    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630958    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630961    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630964    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630966    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630969    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630972    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630975    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630978    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630980    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630983    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630986    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630989    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630991    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630994    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.630996    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631000    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631004    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631006    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:11.639779 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631009    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631012    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631014    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631017    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631019    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631022    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631026    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631030    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631033    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631035    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631038    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631041    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631044    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631047    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631050    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631052    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631055    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631058    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631061    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:11.640395 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631064    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631068    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631070    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631073    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631076    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631078    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631081    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631084    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631086    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631089    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631092    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631094    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631097    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631099    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631102    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631104    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631107    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631109    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631112    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631114    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:11.640886 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631117    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631119    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631122    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631124    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631126    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631129    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631131    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631134    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631136    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631139    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631141    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631146    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631148    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631152    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631155    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631157    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631160    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631163    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631166    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631169    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:11.641359 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631171    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631174    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631176    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631179    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631181    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631184    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631186    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631190    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631194    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631197    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631200    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631202    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.631205    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.632095    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.639886    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 13:44:11.641867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.639903    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.639923    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.639929    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.639987    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.639991    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.639994    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.639997    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640000    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640002    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640005    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640008    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640011    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640014    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640016    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640019    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640022    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640025    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640027    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640030    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:11.642255 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640033    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640036    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640038    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640041    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640044    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640046    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640049    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640051    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640054    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640056    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640059    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640061    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640064    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640067    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640071    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640074    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640076    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640079    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640082    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640084    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:11.642740 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640086    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640089    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640092    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640094    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640097    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640099    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640102    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640104    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640107    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640111    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640114    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640116    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640120    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640124    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640128    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640132    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640135    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640138    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640140    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640143    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:11.643266 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640145    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640148    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640151    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640154    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640156    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640160    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640162    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640165    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640168    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640170    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640173    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640176    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640178    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640181    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640183    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640186    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640188    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640191    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640193    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640196    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:11.644179 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640198    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640211    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640216    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640218    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640221    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640224    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640227    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640230    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640233    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640236    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640239    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640242    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640244    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640246    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640249    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640252    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640254    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640257    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640260    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:11.644881 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640263    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640265    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640268    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640271    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.640276    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640390    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640394    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640397    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640400    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640403    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640406    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640409    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640411    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640414    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 13:44:11.645351 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640417    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640420    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640424    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640427    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640430    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640432    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640436    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640438    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640441    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640444    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640446    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640449    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640451    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640454    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640456    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640459    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640462    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640465    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640468    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 13:44:11.645743 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640470    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640473    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640475    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640478    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640480    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640483    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640485    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640487    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640490    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640492    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640495    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640497    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640499    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640502    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640504    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640507    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640510    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640512    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640515    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640517    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 13:44:11.646220 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640520    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640522    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640525    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640527    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640530    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640532    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640534    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640537    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640539    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640542    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640544    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640547    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640549    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640552    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640554    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640557    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640559    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640561    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640564    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640566    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 13:44:11.646724 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640569    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640571    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640574    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640576    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640578    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640581    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640583    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640586    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640588    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640591    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640593    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640596    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640599    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640621    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640627    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640629    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640632    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640635    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640638    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640641    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 13:44:11.647201 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640644    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640646    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640649    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640652    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640655    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640657    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640660    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640663    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640666    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640669    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:11.640672    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.640677    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.640794    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.645493    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 13:44:11.647859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.647258    2578 server.go:1019] "Starting client certificate rotation"
Sep 18 13:44:11.648224 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.647360    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:44:11.648224 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.647391    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 13:44:11.650344 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.650331    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:44:11.651568 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.651549    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 13:44:11.660947 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.660927    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 18 13:44:11.663465 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.663450    2578 log.go:25] "Validated CRI v1 image API"
Sep 18 13:44:11.664383 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.664367    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 13:44:11.669989 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.669963    2578 fs.go:135] Filesystem UUIDs: map[25759c11-2182-4854-8db2-4a3f74a22293:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ca2141e3-04ba-4310-afa3-da5bae4a44e8:/dev/nvme0n1p4]
Sep 18 13:44:11.670059 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.669990    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 13:44:11.676402 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.676274    2578 manager.go:216] Machine: {Timestamp:2026-09-18 13:44:11.674884834 +0000 UTC m=+0.366756420 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102276 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f38adc058af17935fdb4eb6fa187 SystemUUID:ec26f38a-dc05-8af1-7935-fdb4eb6fa187 BootID:4da715a1-822a-4d0d-8788-a70ad465fe6c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:f9:ca:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:f9:ca:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:96:53:9b:90:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 13:44:11.676402 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.676398    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 13:44:11.676499 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.676484    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 13:44:11.677570 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.677556    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:44:11.679765 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.679741    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 13:44:11.679933 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.679787    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 13:44:11.680645 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.680635    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 13:44:11.680678 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.680648    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 13:44:11.680678 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.680656    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:44:11.681432 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.681422    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 13:44:11.681507 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.681499    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 13:44:11.686146 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686132    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:44:11.686261 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686252    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 13:44:11.686298 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686290    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 13:44:11.686330 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686309    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 13:44:11.686330 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686323    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 13:44:11.686384 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686333    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 18 13:44:11.686384 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686342    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 13:44:11.686911 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686894    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:44:11.686975 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.686931    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 13:44:11.690735 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.690711    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 13:44:11.693808 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.693792    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 13:44:11.693873 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.693822    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 13:44:11.695302 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695290    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695306    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695311    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695317    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695325    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695330    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695345    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695350    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 13:44:11.695357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695358    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 13:44:11.695577 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695364    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 13:44:11.695577 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695372    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 13:44:11.695577 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.695377    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 13:44:11.696260 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.696249    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 13:44:11.696260 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.696259    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 13:44:11.698458 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.698433    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 13:44:11.698528 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.698439    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 13:44:11.700266 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.700247    2578 server.go:1268] "Started kubelet"
Sep 18 13:44:11.700395 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.700344    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 13:44:11.700468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.700336    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 13:44:11.700571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.700491    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 13:44:11.701102 ip-10-0-132-244 systemd[1]: Started Kubernetes Kubelet.
Sep 18 13:44:11.702038 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.702018    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 13:44:11.702982 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.702963    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 13:44:11.703928 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.703910    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 13:44:11.707666 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.707636    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 13:44:11.711470 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.711455    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 13:44:11.711535 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.711472    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 13:44:11.711587 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.711538    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:11.712199 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.712157    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 13:44:11.712304 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.712247    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 13:44:11.712304 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.712262    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 13:44:11.712401 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.712388    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 13:44:11.712401 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.712398    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 13:44:11.713015 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.712995    2578 factory.go:55] Registering systemd factory
Sep 18 13:44:11.713094 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.713019    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 18 13:44:11.713274 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.713262    2578 factory.go:153] Registering CRI-O factory
Sep 18 13:44:11.713344 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.713277    2578 factory.go:223] Registration of the crio container factory successfully
Sep 18 13:44:11.713344 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.713330    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 13:44:11.713430 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.713352    2578 factory.go:103] Registering Raw factory
Sep 18 13:44:11.713430 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.713369    2578 manager.go:1196] Started watching for new ooms in manager
Sep 18 13:44:11.713793 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.713780    2578 manager.go:349] Starting recovery of all containers
Sep 18 13:44:11.715399 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.715369    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 13:44:11.715509 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.715398    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 13:44:11.717362 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.715426    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-244.ec2.internal.18d66e2f613c75ad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-244.ec2.internal,UID:ip-10-0-132-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-244.ec2.internal,},FirstTimestamp:2026-09-18 13:44:11.700221357 +0000 UTC m=+0.392093185,LastTimestamp:2026-09-18 13:44:11.700221357 +0000 UTC m=+0.392093185,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-244.ec2.internal,}"
Sep 18 13:44:11.725309 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.725082    2578 manager.go:354] Recovery completed
Sep 18 13:44:11.725927 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.725900    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7677w"
Sep 18 13:44:11.728210 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.728180    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 18 13:44:11.731117 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.731100    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:11.733385 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.733369    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7677w"
Sep 18 13:44:11.734067 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.734048    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:11.734126 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.734074    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:11.734126 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.734086    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:11.734709 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.734696    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 13:44:11.734779 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.734709    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:11.734779 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.734709    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 13:44:11.734779 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.734752    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 13:44:11.736066 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.735999    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-244.ec2.internal.18d66e2f6340dd41  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-244.ec2.internal,UID:ip-10-0-132-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-244.ec2.internal,},FirstTimestamp:2026-09-18 13:44:11.734064449 +0000 UTC m=+0.425936038,LastTimestamp:2026-09-18 13:44:11.734064449 +0000 UTC m=+0.425936038,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-244.ec2.internal,}"
Sep 18 13:44:11.736467 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.736444    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:11.736516 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.736486    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:11.736516 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.736501    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:11.737408 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.737397    2578 policy_none.go:49] "None policy: Start"
Sep 18 13:44:11.737449 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.737413    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 13:44:11.737449 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.737423    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 13:44:11.739915 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.739904    2578 policy_none.go:47] "Start"
Sep 18 13:44:11.781275 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.781256    2578 manager.go:337] "Starting Device Plugin manager"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.781306    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.781321    2578 server.go:87] "Starting device plugin registration server"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.781735    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.781747    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.781865    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.781998    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.782008    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.782499    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 13:44:11.792656 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.782542    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:11.842559 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.842518    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 13:44:11.843908 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.843887    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 13:44:11.844036 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.843944    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 13:44:11.844036 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.843969    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 13:44:11.844036 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.844018    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 13:44:11.845957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.845936    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:11.882660 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.882527    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:11.883590 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.883572    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:11.883724 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.883622    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:11.883724 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.883637    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:11.883724 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.883667    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-244.ec2.internal"
Sep 18 13:44:11.894634 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.894600    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-244.ec2.internal"
Sep 18 13:44:11.894730 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.894640    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-244.ec2.internal\": node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:11.920016 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.919980    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:11.944128 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.944101    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"]
Sep 18 13:44:11.944211 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.944181    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:11.945250 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.945236    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:11.945309 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.945262    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:11.945309 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.945272    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:11.947525 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.947512    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:11.947663 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.947645    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:11.947714 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.947676    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:11.948371 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.948349    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:11.948468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.948385    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:11.948468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.948397    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:11.948468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.948403    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:11.948468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.948425    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:11.948468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.948438    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:11.950663 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.950649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:11.950706 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.950674    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 13:44:11.951429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.951414    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 13:44:11.951516 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.951451    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 13:44:11.951516 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:11.951480    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeHasSufficientPID"
Sep 18 13:44:11.967280 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.967252    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-244.ec2.internal\" not found" node="ip-10-0-132-244.ec2.internal"
Sep 18 13:44:11.971435 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:11.971416    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-244.ec2.internal\" not found" node="ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.014385 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.014356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/056999e09c625976fc7f047d9c5d5ece-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"056999e09c625976fc7f047d9c5d5ece\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.014491 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.014388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/056999e09c625976fc7f047d9c5d5ece-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"056999e09c625976fc7f047d9c5d5ece\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.014491 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.014405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ceb76050e700c0166a29d2417c811e7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-244.ec2.internal\" (UID: \"1ceb76050e700c0166a29d2417c811e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.020470 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.020449    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.114938 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.114906    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/056999e09c625976fc7f047d9c5d5ece-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"056999e09c625976fc7f047d9c5d5ece\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.115030 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.114860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/056999e09c625976fc7f047d9c5d5ece-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"056999e09c625976fc7f047d9c5d5ece\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.115030 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.114982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/056999e09c625976fc7f047d9c5d5ece-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"056999e09c625976fc7f047d9c5d5ece\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.115030 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.114998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/056999e09c625976fc7f047d9c5d5ece-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal\" (UID: \"056999e09c625976fc7f047d9c5d5ece\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.115136 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.115034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ceb76050e700c0166a29d2417c811e7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-244.ec2.internal\" (UID: \"1ceb76050e700c0166a29d2417c811e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.115136 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.115054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ceb76050e700c0166a29d2417c811e7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-244.ec2.internal\" (UID: \"1ceb76050e700c0166a29d2417c811e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.121030 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.120992    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.221785 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.221754    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.269934 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.269908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.275176 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.274975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:12.322363 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.322330    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.422896 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.422847    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.523523 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.523454    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.623978 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.623948    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.646129 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.646102    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 13:44:12.646271 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.646254    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 13:44:12.724318 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.724287    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.740354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.740320    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 13:39:12 +0000 UTC" deadline="2028-04-20 00:11:15.437272773 +0000 UTC"
Sep 18 13:44:12.740354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.740348    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13906h27m2.696927896s"
Sep 18 13:44:12.825051 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.824983    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:12.883625 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:12.883579    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056999e09c625976fc7f047d9c5d5ece.slice/crio-b21fc053caf94f3184fb805535c1c5008cecbcb1cfb8c3f4bf3db2d1e72b9269 WatchSource:0}: Error finding container b21fc053caf94f3184fb805535c1c5008cecbcb1cfb8c3f4bf3db2d1e72b9269: Status 404 returned error can't find the container with id b21fc053caf94f3184fb805535c1c5008cecbcb1cfb8c3f4bf3db2d1e72b9269
Sep 18 13:44:12.883900 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:12.883877    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ceb76050e700c0166a29d2417c811e7.slice/crio-3b15b35cea2e25d2d7c934832fe7b35ab43391571270a3ff2c3d48dc89e7f63b WatchSource:0}: Error finding container 3b15b35cea2e25d2d7c934832fe7b35ab43391571270a3ff2c3d48dc89e7f63b: Status 404 returned error can't find the container with id 3b15b35cea2e25d2d7c934832fe7b35ab43391571270a3ff2c3d48dc89e7f63b
Sep 18 13:44:12.890238 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.890219    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:44:12.895874 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:12.895856    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:12.925468 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:12.925438    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:13.026513 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.026468    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:13.078750 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.078683    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:13.127558 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.127521    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:13.228436 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.228391    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-244.ec2.internal\" not found"
Sep 18 13:44:13.276154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.276126    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:13.312205 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.312171    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:13.329389 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.329324    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:44:13.330381 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.330361    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal"
Sep 18 13:44:13.341121 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.341101    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 13:44:13.688758 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.688481    2578 apiserver.go:52] "Watching apiserver"
Sep 18 13:44:13.706803 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.706764    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 13:44:13.707715 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.707288    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6","openshift-dns/node-resolver-v9fxf","openshift-image-registry/node-ca-wsffq","openshift-multus/multus-additional-cni-plugins-wrlr2","openshift-network-diagnostics/network-check-target-f5x4t","openshift-network-operator/iptables-alerter-bdsdx","kube-system/global-pull-secret-syncer-9dpx9","kube-system/konnectivity-agent-5hdp7","openshift-cluster-node-tuning-operator/tuned-g9qvh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal","openshift-multus/multus-9pxzr","openshift-multus/network-metrics-daemon-hqn26","openshift-ovn-kubernetes/ovnkube-node-kbs2g"]
Sep 18 13:44:13.711030 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.710029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.713553    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.713671    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbhgz\""
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.713836    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.713554    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.714336    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.715130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.715220    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:13.716492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.715453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.719256 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.718678    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 13:44:13.719256 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.718992    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 13:44:13.719256 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.718997    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7h7h4\""
Sep 18 13:44:13.721082 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.720317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.722607 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.722462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-schv5\" (UniqueName: \"kubernetes.io/projected/149df732-93b3-4c2a-bcc8-320bbc510572-kube-api-access-schv5\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6da04e18-92bd-4437-a852-fa667bdd230b-hosts-file\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6da04e18-92bd-4437-a852-fa667bdd230b-tmp-dir\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r4tj\" (UniqueName: \"kubernetes.io/projected/6da04e18-92bd-4437-a852-fa667bdd230b-kube-api-access-4r4tj\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-iptables-alerter-script\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-host-slash\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.723771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjxl\" (UniqueName: \"kubernetes.io/projected/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-kube-api-access-lmjxl\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.725408    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.725479    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.727567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.729909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731310    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v6m4q\""
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731551    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731627    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731630    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sf5lw\""
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731739    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731746    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 13:44:13.732106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.731887    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 13:44:13.733186 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.732442    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.733292 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.733273    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jbg5b\""
Sep 18 13:44:13.733358 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.733310    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 13:44:13.733991 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.733506    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 13:44:13.733991 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.733535    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 13:44:13.733991 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.733678    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 13:44:13.733991 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.733881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 13:44:13.734288 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.734269    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 13:44:13.734701 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.734403    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.735057    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.735248    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.735522    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-msttp\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.735778    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.736301    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.736585    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.736814    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wp5dc\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.737254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.737828    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.738215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.738292    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:13.738835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.738530    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 13:44:13.740941 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.740323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.740941 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.740494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:44:13.742039 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.741632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 13:44:13.742039 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.741878    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9zpqq\""
Sep 18 13:44:13.742601 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.742578    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 13:44:13.743789 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.743692    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 13:44:13.744711 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.744690    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6fj4k\""
Sep 18 13:44:13.760548 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.760485    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8gk6"
Sep 18 13:44:13.770772 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.770747    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8gk6"
Sep 18 13:44:13.814029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.813953    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 13:44:13.824375 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-device-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.824518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s695z\" (UniqueName: \"kubernetes.io/projected/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-kube-api-access-s695z\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.824518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-run\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.824518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-hostroot\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.824518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cnibin\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.824518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-etc-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r4tj\" (UniqueName: \"kubernetes.io/projected/6da04e18-92bd-4437-a852-fa667bdd230b-kube-api-access-4r4tj\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-modprobe-d\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-systemd\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-host\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.824737    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:13.824823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-kubelet\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.824844    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:14.324805499 +0000 UTC m=+3.016677092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjxl\" (UniqueName: \"kubernetes.io/projected/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-kube-api-access-lmjxl\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-host\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-cni-multus\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.824998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-cni-bin\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-kubelet-config\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-sys-fs\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysconfig\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysctl-conf\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-var-lib-kubelet\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-netns\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.825411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-env-overrides\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-registration-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-cni-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-cni-bin\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qm8g\" (UniqueName: \"kubernetes.io/projected/28f8aa45-76ac-4625-a583-5111b67b742b-kube-api-access-5qm8g\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovnkube-script-lib\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83c00562-ea79-41f9-98c1-38ce3d04572f-konnectivity-ca\") pod \"konnectivity-agent-5hdp7\" (UID: \"83c00562-ea79-41f9-98c1-38ce3d04572f\") " pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-socket-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-kubernetes\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysctl-d\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a201a692-59ee-4e7c-9082-50913c791740-tmp\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-conf-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7qzr\" (UniqueName: \"kubernetes.io/projected/51edadfa-9802-46ec-bfe7-f7b588ddbe27-kube-api-access-k7qzr\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-systemd\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-cni-netd\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.826255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6da04e18-92bd-4437-a852-fa667bdd230b-hosts-file\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gbf7\" (UniqueName: \"kubernetes.io/projected/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-kube-api-access-5gbf7\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-schv5\" (UniqueName: \"kubernetes.io/projected/149df732-93b3-4c2a-bcc8-320bbc510572-kube-api-access-schv5\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-system-cni-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-etc-kubernetes\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-systemd-units\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-host-slash\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbdb2\" (UniqueName: \"kubernetes.io/projected/a201a692-59ee-4e7c-9082-50913c791740-kube-api-access-rbdb2\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-serviceca\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-run-netns\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-node-log\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-dbus\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6da04e18-92bd-4437-a852-fa667bdd230b-tmp-dir\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-lib-modules\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a201a692-59ee-4e7c-9082-50913c791740-etc-tuned\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.827024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28f8aa45-76ac-4625-a583-5111b67b742b-cni-binary-copy\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.825999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-ovn\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovnkube-config\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzz9l\" (UniqueName: \"kubernetes.io/projected/b51bc9c1-b835-434e-ae0d-97705015dc5d-kube-api-access-rzz9l\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-cnibin\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-socket-dir-parent\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6da04e18-92bd-4437-a852-fa667bdd230b-hosts-file\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-var-lib-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovn-node-metrics-cert\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83c00562-ea79-41f9-98c1-38ce3d04572f-agent-certs\") pod \"konnectivity-agent-5hdp7\" (UID: \"83c00562-ea79-41f9-98c1-38ce3d04572f\") " pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-sys\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-system-cni-dir\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-slash\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-iptables-alerter-script\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.827962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-k8s-cni-cncf-io\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-kubelet\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28f8aa45-76ac-4625-a583-5111b67b742b-multus-daemon-config\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-multus-certs\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-log-socket\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6da04e18-92bd-4437-a852-fa667bdd230b-tmp-dir\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.826984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-host-slash\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.828710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.827470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-iptables-alerter-script\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.836854 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.836825    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 13:44:13.843093 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.843071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r4tj\" (UniqueName: \"kubernetes.io/projected/6da04e18-92bd-4437-a852-fa667bdd230b-kube-api-access-4r4tj\") pod \"node-resolver-v9fxf\" (UID: \"6da04e18-92bd-4437-a852-fa667bdd230b\") " pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:13.843202 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.843163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjxl\" (UniqueName: \"kubernetes.io/projected/2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2-kube-api-access-lmjxl\") pod \"iptables-alerter-bdsdx\" (UID: \"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2\") " pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:13.843243 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.843222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-schv5\" (UniqueName: \"kubernetes.io/projected/149df732-93b3-4c2a-bcc8-320bbc510572-kube-api-access-schv5\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:13.849058 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.849011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" event={"ID":"1ceb76050e700c0166a29d2417c811e7","Type":"ContainerStarted","Data":"3b15b35cea2e25d2d7c934832fe7b35ab43391571270a3ff2c3d48dc89e7f63b"}
Sep 18 13:44:13.850286 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.850258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" event={"ID":"056999e09c625976fc7f047d9c5d5ece","Type":"ContainerStarted","Data":"b21fc053caf94f3184fb805535c1c5008cecbcb1cfb8c3f4bf3db2d1e72b9269"}
Sep 18 13:44:13.927828 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.927786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a201a692-59ee-4e7c-9082-50913c791740-etc-tuned\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.928031 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.927834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28f8aa45-76ac-4625-a583-5111b67b742b-cni-binary-copy\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928031 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.927931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.928031 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.927971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-ovn\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928185 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-ovn\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928185 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovnkube-config\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928185 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzz9l\" (UniqueName: \"kubernetes.io/projected/b51bc9c1-b835-434e-ae0d-97705015dc5d-kube-api-access-rzz9l\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.928361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-cnibin\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-socket-dir-parent\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.928361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-var-lib-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovn-node-metrics-cert\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83c00562-ea79-41f9-98c1-38ce3d04572f-agent-certs\") pod \"konnectivity-agent-5hdp7\" (UID: \"83c00562-ea79-41f9-98c1-38ce3d04572f\") " pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-cnibin\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-sys\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-system-cni-dir\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-slash\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-var-lib-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28f8aa45-76ac-4625-a583-5111b67b742b-cni-binary-copy\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-k8s-cni-cncf-io\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-kubelet\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-k8s-cni-cncf-io\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28f8aa45-76ac-4625-a583-5111b67b742b-multus-daemon-config\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-multus-certs\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-log-socket\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.928625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-device-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-socket-dir-parent\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-kubelet\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-system-cni-dir\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-multus-certs\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s695z\" (UniqueName: \"kubernetes.io/projected/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-kube-api-access-s695z\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-device-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-run\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-hostroot\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cnibin\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-etc-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovnkube-config\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.928967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-modprobe-d\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-systemd\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-host\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-hostroot\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-systemd\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.929503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-run\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-modprobe-d\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-log-socket\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-host\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-kubelet\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-host\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-etc-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-cni-multus\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-sys\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-cni-multus\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-cni-bin\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-kubelet-config\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.930396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-slash\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cnibin\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-host\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-cni-bin\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929902    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-kubelet-config\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.929971    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28f8aa45-76ac-4625-a583-5111b67b742b-multus-daemon-config\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.929995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-kubelet\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.930274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-sys-fs\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.930373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.930483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-sys-fs\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.930524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.930313    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret podName:b80e0bea-a2e6-4a2f-aca7-695a10be7fd6 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:14.430290792 +0000 UTC m=+3.122162370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret") pod "global-pull-secret-syncer-9dpx9" (UID: "b80e0bea-a2e6-4a2f-aca7-695a10be7fd6") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.930941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysconfig\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.930975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysctl-conf\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.931317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-var-lib-kubelet\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-netns\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-env-overrides\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-registration-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-cni-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-cni-bin\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qm8g\" (UniqueName: \"kubernetes.io/projected/28f8aa45-76ac-4625-a583-5111b67b742b-kube-api-access-5qm8g\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovnkube-script-lib\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83c00562-ea79-41f9-98c1-38ce3d04572f-konnectivity-ca\") pod \"konnectivity-agent-5hdp7\" (UID: \"83c00562-ea79-41f9-98c1-38ce3d04572f\") " pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-socket-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-kubernetes\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysctl-d\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a201a692-59ee-4e7c-9082-50913c791740-tmp\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-conf-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7qzr\" (UniqueName: \"kubernetes.io/projected/51edadfa-9802-46ec-bfe7-f7b588ddbe27-kube-api-access-k7qzr\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-systemd\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-cni-netd\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysconfig\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931597    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-var-lib-cni-bin\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysctl-conf\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-var-lib-kubelet\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-host-run-netns\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-openvswitch\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-env-overrides\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-registration-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovnkube-script-lib\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gbf7\" (UniqueName: \"kubernetes.io/projected/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-kube-api-access-5gbf7\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-system-cni-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-etc-kubernetes\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83c00562-ea79-41f9-98c1-38ce3d04572f-agent-certs\") pod \"konnectivity-agent-5hdp7\" (UID: \"83c00562-ea79-41f9-98c1-38ce3d04572f\") " pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-systemd-units\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.932961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-systemd-units\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbdb2\" (UniqueName: \"kubernetes.io/projected/a201a692-59ee-4e7c-9082-50913c791740-kube-api-access-rbdb2\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-serviceca\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-system-cni-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-run-netns\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-etc-kubernetes\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-node-log\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-dbus\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-lib-modules\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-socket-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-lib-modules\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932851    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-kubernetes\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83c00562-ea79-41f9-98c1-38ce3d04572f-konnectivity-ca\") pod \"konnectivity-agent-5hdp7\" (UID: \"83c00562-ea79-41f9-98c1-38ce3d04572f\") " pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a201a692-59ee-4e7c-9082-50913c791740-etc-sysctl-d\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.932948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-run-systemd\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.931431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-cni-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-cni-netd\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51edadfa-9802-46ec-bfe7-f7b588ddbe27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.933589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-node-log\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.934415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b51bc9c1-b835-434e-ae0d-97705015dc5d-host-run-netns\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.934415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-dbus\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:13.934415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.934415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-serviceca\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.934415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28f8aa45-76ac-4625-a583-5111b67b742b-multus-conf-dir\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:13.934415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.933935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b51bc9c1-b835-434e-ae0d-97705015dc5d-ovn-node-metrics-cert\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.935289 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.935267    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a201a692-59ee-4e7c-9082-50913c791740-tmp\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.937166 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.937143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a201a692-59ee-4e7c-9082-50913c791740-etc-tuned\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.954256 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.954188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzz9l\" (UniqueName: \"kubernetes.io/projected/b51bc9c1-b835-434e-ae0d-97705015dc5d-kube-api-access-rzz9l\") pod \"ovnkube-node-kbs2g\" (UID: \"b51bc9c1-b835-434e-ae0d-97705015dc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:13.954445 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.954425    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:13.954491 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.954451    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:13.954491 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.954461    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2b4nb for pod openshift-network-diagnostics/network-check-target-f5x4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:13.954570 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:13.954515    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb podName:13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:14.454498616 +0000 UTC m=+3.146370209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2b4nb" (UniqueName: "kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb") pod "network-check-target-f5x4t" (UID: "13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:13.957260 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.957232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gbf7\" (UniqueName: \"kubernetes.io/projected/1cc9d4a5-7c7b-44d8-96d8-807e5250fc65-kube-api-access-5gbf7\") pod \"node-ca-wsffq\" (UID: \"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65\") " pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:13.957557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.957538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s695z\" (UniqueName: \"kubernetes.io/projected/68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b-kube-api-access-s695z\") pod \"aws-ebs-csi-driver-node-p7dm6\" (UID: \"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:13.957623 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.957568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbdb2\" (UniqueName: \"kubernetes.io/projected/a201a692-59ee-4e7c-9082-50913c791740-kube-api-access-rbdb2\") pod \"tuned-g9qvh\" (UID: \"a201a692-59ee-4e7c-9082-50913c791740\") " pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:13.958153 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.958132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7qzr\" (UniqueName: \"kubernetes.io/projected/51edadfa-9802-46ec-bfe7-f7b588ddbe27-kube-api-access-k7qzr\") pod \"multus-additional-cni-plugins-wrlr2\" (UID: \"51edadfa-9802-46ec-bfe7-f7b588ddbe27\") " pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:13.958863 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:13.958845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qm8g\" (UniqueName: \"kubernetes.io/projected/28f8aa45-76ac-4625-a583-5111b67b742b-kube-api-access-5qm8g\") pod \"multus-9pxzr\" (UID: \"28f8aa45-76ac-4625-a583-5111b67b742b\") " pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:14.038946 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.038907    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bdsdx"
Sep 18 13:44:14.048410 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.048389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9fxf"
Sep 18 13:44:14.057327 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.057307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wsffq"
Sep 18 13:44:14.064230 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.064209    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrlr2"
Sep 18 13:44:14.073176 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.073151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:14.081177 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.081157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:14.089190 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.089170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6"
Sep 18 13:44:14.097862 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.097840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9qvh"
Sep 18 13:44:14.105737 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.105707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9pxzr"
Sep 18 13:44:14.335958 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.335876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:14.336100 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.336059    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:14.336151 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.336131    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:15.336115515 +0000 UTC m=+4.027987094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:14.437187 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.437148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:14.437389 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.437304    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:14.437389 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.437385    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret podName:b80e0bea-a2e6-4a2f-aca7-695a10be7fd6 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:15.437365222 +0000 UTC m=+4.129236813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret") pod "global-pull-secret-syncer-9dpx9" (UID: "b80e0bea-a2e6-4a2f-aca7-695a10be7fd6") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:14.537954 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.537912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:14.538142 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.538116    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:14.538199 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.538165    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:14.538199 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.538176    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2b4nb for pod openshift-network-diagnostics/network-check-target-f5x4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:14.538300 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.538240    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb podName:13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:15.538224656 +0000 UTC m=+4.230096230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b4nb" (UniqueName: "kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb") pod "network-check-target-f5x4t" (UID: "13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:14.774467 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.774418    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:39:14 +0000 UTC" deadline="2028-03-31 17:14:27.672386138 +0000 UTC"
Sep 18 13:44:14.774467 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.774461    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13443h30m12.897930691s"
Sep 18 13:44:14.844448 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:14.844418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:14.844662 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:14.844558    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:15.084867 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:15.084702    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda201a692_59ee_4e7c_9082_50913c791740.slice/crio-5b8bbf5ed6808bbb53b3371a03738c7d5cdbcd69e8207a0612da29a81b4e57ae WatchSource:0}: Error finding container 5b8bbf5ed6808bbb53b3371a03738c7d5cdbcd69e8207a0612da29a81b4e57ae: Status 404 returned error can't find the container with id 5b8bbf5ed6808bbb53b3371a03738c7d5cdbcd69e8207a0612da29a81b4e57ae
Sep 18 13:44:15.087859 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:15.087768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc9d4a5_7c7b_44d8_96d8_807e5250fc65.slice/crio-f45e95fc0a9c4ac1e7dd51f0d6d248a2988cc60c12e9858e4b6b1686a5aaa15b WatchSource:0}: Error finding container f45e95fc0a9c4ac1e7dd51f0d6d248a2988cc60c12e9858e4b6b1686a5aaa15b: Status 404 returned error can't find the container with id f45e95fc0a9c4ac1e7dd51f0d6d248a2988cc60c12e9858e4b6b1686a5aaa15b
Sep 18 13:44:15.100865 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:15.100845    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2162ec05_2af7_4e4d_9f3b_c0b8b497b3b2.slice/crio-a6c6790ab5b7f76283bb63bc671fe66be46aa454abd8c2248240ba007d430013 WatchSource:0}: Error finding container a6c6790ab5b7f76283bb63bc671fe66be46aa454abd8c2248240ba007d430013: Status 404 returned error can't find the container with id a6c6790ab5b7f76283bb63bc671fe66be46aa454abd8c2248240ba007d430013
Sep 18 13:44:15.101913 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:15.101890    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ec9be6_5bd1_4fc0_b02e_8147cf9dd64b.slice/crio-6dd0f0c1b8df8999b7b7be88e23e18d9c457a1095aaf49ea68aa791b6d099674 WatchSource:0}: Error finding container 6dd0f0c1b8df8999b7b7be88e23e18d9c457a1095aaf49ea68aa791b6d099674: Status 404 returned error can't find the container with id 6dd0f0c1b8df8999b7b7be88e23e18d9c457a1095aaf49ea68aa791b6d099674
Sep 18 13:44:15.103638 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:15.103590    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51edadfa_9802_46ec_bfe7_f7b588ddbe27.slice/crio-2a43cd1a848141ba1afe79de8e70cefaadc39b086ef1a25747ec1df28abe0e45 WatchSource:0}: Error finding container 2a43cd1a848141ba1afe79de8e70cefaadc39b086ef1a25747ec1df28abe0e45: Status 404 returned error can't find the container with id 2a43cd1a848141ba1afe79de8e70cefaadc39b086ef1a25747ec1df28abe0e45
Sep 18 13:44:15.108690 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:15.108664    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51bc9c1_b835_434e_ae0d_97705015dc5d.slice/crio-aabba9ab680c9915efe5fd1833014922a62263e7baeaf42d469c558cfa61848f WatchSource:0}: Error finding container aabba9ab680c9915efe5fd1833014922a62263e7baeaf42d469c558cfa61848f: Status 404 returned error can't find the container with id aabba9ab680c9915efe5fd1833014922a62263e7baeaf42d469c558cfa61848f
Sep 18 13:44:15.131734 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:15.131707    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da04e18_92bd_4437_a852_fa667bdd230b.slice/crio-6842e655a0b428f234c1afbbe5d07302361d5108d7e2ba9e7b4a4c7d84c905a2 WatchSource:0}: Error finding container 6842e655a0b428f234c1afbbe5d07302361d5108d7e2ba9e7b4a4c7d84c905a2: Status 404 returned error can't find the container with id 6842e655a0b428f234c1afbbe5d07302361d5108d7e2ba9e7b4a4c7d84c905a2
Sep 18 13:44:15.344086 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.343987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:15.344240 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.344164    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:15.344240 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.344234    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:17.344219185 +0000 UTC m=+6.036090764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:15.445085 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.445054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:15.445338 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.445216    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:15.445338 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.445286    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret podName:b80e0bea-a2e6-4a2f-aca7-695a10be7fd6 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:17.445265896 +0000 UTC m=+6.137137477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret") pod "global-pull-secret-syncer-9dpx9" (UID: "b80e0bea-a2e6-4a2f-aca7-695a10be7fd6") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:15.545805 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.545759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:15.545993 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.545958    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:15.545993 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.545978    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:15.545993 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.545993    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2b4nb for pod openshift-network-diagnostics/network-check-target-f5x4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:15.546109 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.546056    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb podName:13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:17.546036517 +0000 UTC m=+6.237908097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b4nb" (UniqueName: "kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb") pod "network-check-target-f5x4t" (UID: "13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:15.774768 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.774687    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 13:39:14 +0000 UTC" deadline="2028-04-24 13:35:30.139271114 +0000 UTC"
Sep 18 13:44:15.774768 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.774768    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14015h51m14.36450942s"
Sep 18 13:44:15.847034 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.846996    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:15.847227 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.847146    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:15.847305 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.847246    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:15.847360 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:15.847331    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:15.869077 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.869037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" event={"ID":"1ceb76050e700c0166a29d2417c811e7","Type":"ContainerStarted","Data":"09e0efd5a3cc6ab5b01503b98a2e979c53b8156a789da4c3edf288711cf455c4"}
Sep 18 13:44:15.884771 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.884726    2578 generic.go:356] "Generic (PLEG): container finished" podID="056999e09c625976fc7f047d9c5d5ece" containerID="f9435f8fa439dbe6d9af12e27cf27106becaf745fec163028633955c6b97fd2c" exitCode=0
Sep 18 13:44:15.884948 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.884842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" event={"ID":"056999e09c625976fc7f047d9c5d5ece","Type":"ContainerDied","Data":"f9435f8fa439dbe6d9af12e27cf27106becaf745fec163028633955c6b97fd2c"}
Sep 18 13:44:15.909041 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.907936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9fxf" event={"ID":"6da04e18-92bd-4437-a852-fa667bdd230b","Type":"ContainerStarted","Data":"6842e655a0b428f234c1afbbe5d07302361d5108d7e2ba9e7b4a4c7d84c905a2"}
Sep 18 13:44:15.909823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.909736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-244.ec2.internal" podStartSLOduration=2.90971376 podStartE2EDuration="2.90971376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:15.888643299 +0000 UTC m=+4.580514901" watchObservedRunningTime="2026-09-18 13:44:15.90971376 +0000 UTC m=+4.601585359"
Sep 18 13:44:15.914184 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.913844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"aabba9ab680c9915efe5fd1833014922a62263e7baeaf42d469c558cfa61848f"}
Sep 18 13:44:15.924362 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.924330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerStarted","Data":"2a43cd1a848141ba1afe79de8e70cefaadc39b086ef1a25747ec1df28abe0e45"}
Sep 18 13:44:15.928850 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.928822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6" event={"ID":"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b","Type":"ContainerStarted","Data":"6dd0f0c1b8df8999b7b7be88e23e18d9c457a1095aaf49ea68aa791b6d099674"}
Sep 18 13:44:15.945070 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.944997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdsdx" event={"ID":"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2","Type":"ContainerStarted","Data":"a6c6790ab5b7f76283bb63bc671fe66be46aa454abd8c2248240ba007d430013"}
Sep 18 13:44:15.960264 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.960230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5hdp7" event={"ID":"83c00562-ea79-41f9-98c1-38ce3d04572f","Type":"ContainerStarted","Data":"ee586c760c69801bd26c89b02b4e3d968035fc51813c4aebad38855fd79530e0"}
Sep 18 13:44:15.968753 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.968718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9pxzr" event={"ID":"28f8aa45-76ac-4625-a583-5111b67b742b","Type":"ContainerStarted","Data":"3f6cea9970fc84656870083037ce91bfb5e8c3b74ad4659ae633f1daf7500cfb"}
Sep 18 13:44:15.981108 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:15.981051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsffq" event={"ID":"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65","Type":"ContainerStarted","Data":"f45e95fc0a9c4ac1e7dd51f0d6d248a2988cc60c12e9858e4b6b1686a5aaa15b"}
Sep 18 13:44:16.007304 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:16.007269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9qvh" event={"ID":"a201a692-59ee-4e7c-9082-50913c791740","Type":"ContainerStarted","Data":"5b8bbf5ed6808bbb53b3371a03738c7d5cdbcd69e8207a0612da29a81b4e57ae"}
Sep 18 13:44:16.845274 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:16.845234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:16.845780 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:16.845384    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:17.027503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:17.027464    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" event={"ID":"056999e09c625976fc7f047d9c5d5ece","Type":"ContainerStarted","Data":"ae556f582fe8e1ae5230df814df79015fd5f39e0c9e76a97c36868edd7ab25b0"}
Sep 18 13:44:17.361767 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:17.361059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:17.361767 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.361304    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:17.361767 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.361381    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:21.361359214 +0000 UTC m=+10.053230790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:17.462742 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:17.462086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:17.462742 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.462282    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:17.462742 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.462351    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret podName:b80e0bea-a2e6-4a2f-aca7-695a10be7fd6 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:21.462330553 +0000 UTC m=+10.154202133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret") pod "global-pull-secret-syncer-9dpx9" (UID: "b80e0bea-a2e6-4a2f-aca7-695a10be7fd6") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:17.562579 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:17.562536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:17.562780 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.562739    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:17.562780 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.562768    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:17.562780 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.562782    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2b4nb for pod openshift-network-diagnostics/network-check-target-f5x4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:17.563024 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.562852    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb podName:13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:21.56283161 +0000 UTC m=+10.254703209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b4nb" (UniqueName: "kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb") pod "network-check-target-f5x4t" (UID: "13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:17.846727 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:17.846665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:17.847371 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.846834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:17.847371 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:17.847224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:17.847371 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:17.847328    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:18.844725 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:18.844682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:18.844927 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:18.844825    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:19.846540 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:19.845771    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:19.846540 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:19.845936    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:19.846540 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:19.846369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:19.846540 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:19.846470    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:20.845440 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:20.844990    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:20.845440 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:20.845101    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:21.403350 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:21.398841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:21.407110 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.405976    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:21.407110 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.406084    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:29.406052888 +0000 UTC m=+18.097924464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:21.500169 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:21.500102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:21.500342 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.500298    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:21.500426 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.500381    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret podName:b80e0bea-a2e6-4a2f-aca7-695a10be7fd6 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:29.50036081 +0000 UTC m=+18.192232386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret") pod "global-pull-secret-syncer-9dpx9" (UID: "b80e0bea-a2e6-4a2f-aca7-695a10be7fd6") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:21.601510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:21.601468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:21.601727 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.601659    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:21.601727 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.601687    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:21.601727 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.601702    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2b4nb for pod openshift-network-diagnostics/network-check-target-f5x4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:21.601883 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.601764    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb podName:13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:29.601749541 +0000 UTC m=+18.293621118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b4nb" (UniqueName: "kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb") pod "network-check-target-f5x4t" (UID: "13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:21.845404 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:21.845134    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:21.845587 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.845491    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:21.845936 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:21.845917    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:21.846073 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:21.846027    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:22.844462 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:22.844391    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:22.844964 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:22.844558    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:23.847099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:23.846453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:23.847099 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:23.846592    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:23.847099 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:23.846960    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:23.847099 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:23.847045    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:24.844742 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:24.844710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:24.844939 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:24.844824    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:25.844373 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:25.844335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:25.844803 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:25.844457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:25.844803 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:25.844507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:25.844803 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:25.844647    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:26.845023 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:26.844985    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:26.845494 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:26.845136    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:27.844519 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:27.844480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:27.844740 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:27.844642    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:27.844740 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:27.844672    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:27.844853 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:27.844778    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:28.844492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:28.844453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:28.844995 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:28.844589    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:29.463849 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:29.463812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:29.464111 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.464002    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:29.464111 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.464085    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:45.464062731 +0000 UTC m=+34.155934304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:29.564397 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:29.564359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:29.564632 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.564497    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:29.564632 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.564563    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret podName:b80e0bea-a2e6-4a2f-aca7-695a10be7fd6 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:45.564545211 +0000 UTC m=+34.256416799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret") pod "global-pull-secret-syncer-9dpx9" (UID: "b80e0bea-a2e6-4a2f-aca7-695a10be7fd6") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:29.665227 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:29.665190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:29.665405 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.665387    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:29.665458 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.665410    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:29.665458 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.665421    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2b4nb for pod openshift-network-diagnostics/network-check-target-f5x4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:29.665543 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.665475    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb podName:13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:45.665461138 +0000 UTC m=+34.357332711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b4nb" (UniqueName: "kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb") pod "network-check-target-f5x4t" (UID: "13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:29.845181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:29.845087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:29.845181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:29.845142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:29.845689 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.845241    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:29.845689 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:29.845341    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:30.844683 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:30.844649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:30.844867 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:30.844760    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:31.848056 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:31.848020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:31.848459 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:31.848158    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:31.848459 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:31.848214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:31.848459 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:31.848315    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:32.844766 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:32.844729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:32.844966 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:32.844844    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:33.848019 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:33.847783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:33.848735 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:33.847817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:33.848735 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:33.848137    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:33.848735 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:33.848228    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:34.066809 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.066746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9qvh" event={"ID":"a201a692-59ee-4e7c-9082-50913c791740","Type":"ContainerStarted","Data":"8517de4edef6a616ee3f8c6df470b78cbefbeb8221e02662e38cd1f578080683"}
Sep 18 13:44:34.068222 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.068198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9fxf" event={"ID":"6da04e18-92bd-4437-a852-fa667bdd230b","Type":"ContainerStarted","Data":"4a9297adc99f79768f56191d98de4dffa3499faf4d9fd017d1de46754a054455"}
Sep 18 13:44:34.072370 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.072344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"f2dd657794f6ff5a394a28945aa164178c5b616734213483ffe3f8b89e80bd18"}
Sep 18 13:44:34.072468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.072421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"ddf7b71da5658d88f1bf21e1e1698df6c13dbd94ba094252bdf0fbae468515b3"}
Sep 18 13:44:34.072468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.072461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"a9e93a9a66b2c950aa5110c5748175ea649ff1ae6160c0eb7c2dd0a59f47dd35"}
Sep 18 13:44:34.072565 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.072500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"7c9eb81ac454d8d855632eb463939315cecad8c3a917965349f7fad6f3b01be7"}
Sep 18 13:44:34.072565 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.072547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"83cef4e2f32a387ea5aa25480dca6943cf5be53759b87c73347ae9d0f6980bb3"}
Sep 18 13:44:34.073963 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.073938    2578 generic.go:356] "Generic (PLEG): container finished" podID="51edadfa-9802-46ec-bfe7-f7b588ddbe27" containerID="74b133503ea494ef84355ca81e0f2dc0b01bbffa3b9672fa528d8750bcc3587f" exitCode=0
Sep 18 13:44:34.074050 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.074012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerDied","Data":"74b133503ea494ef84355ca81e0f2dc0b01bbffa3b9672fa528d8750bcc3587f"}
Sep 18 13:44:34.075596 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.075579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6" event={"ID":"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b","Type":"ContainerStarted","Data":"86c87f4778ebd50844727cfb43ce0b97a334a57f7d8d2a4192472751bc97c798"}
Sep 18 13:44:34.077122 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.077093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5hdp7" event={"ID":"83c00562-ea79-41f9-98c1-38ce3d04572f","Type":"ContainerStarted","Data":"8a88d27bc2233045c64cf8ffdb38ba78a1cdde23d47479d76cbf4364a679b143"}
Sep 18 13:44:34.078649 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.078628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9pxzr" event={"ID":"28f8aa45-76ac-4625-a583-5111b67b742b","Type":"ContainerStarted","Data":"dcc831488a55fce88277302b42c194f337e4e02e91a254639d0d1561a6026107"}
Sep 18 13:44:34.080318 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.080296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wsffq" event={"ID":"1cc9d4a5-7c7b-44d8-96d8-807e5250fc65","Type":"ContainerStarted","Data":"12a037d1758fdcf4f4c46ed38a698af184ac20742f84a729b8583e80e528cac8"}
Sep 18 13:44:34.088021 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.087983    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g9qvh" podStartSLOduration=3.613935623 podStartE2EDuration="22.087972567s" totalImagesPullingTime="18.474036944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:34.087825483 +0000 UTC m=+22.779697077" watchObservedRunningTime="2026-09-18 13:44:34.087972567 +0000 UTC m=+22.779844162"
Sep 18 13:44:34.088109 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.088076    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-244.ec2.internal" podStartSLOduration=21.088070789 podStartE2EDuration="21.088070789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:17.048608418 +0000 UTC m=+5.740480020" watchObservedRunningTime="2026-09-18 13:44:34.088070789 +0000 UTC m=+22.779942384"
Sep 18 13:44:34.103365 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.103327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wsffq" podStartSLOduration=3.634527177 podStartE2EDuration="22.103313139s" totalImagesPullingTime="18.468785962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:34.103059049 +0000 UTC m=+22.794930667" watchObservedRunningTime="2026-09-18 13:44:34.103313139 +0000 UTC m=+22.795184733"
Sep 18 13:44:34.156782 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.156731    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9pxzr" podStartSLOduration=3.670969425 podStartE2EDuration="22.156713286s" totalImagesPullingTime="18.485743861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:34.156509822 +0000 UTC m=+22.848381401" watchObservedRunningTime="2026-09-18 13:44:34.156713286 +0000 UTC m=+22.848584881"
Sep 18 13:44:34.174297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.174253    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5hdp7" podStartSLOduration=3.7083683880000002 podStartE2EDuration="22.174239526s" totalImagesPullingTime="18.465871138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:34.173954609 +0000 UTC m=+22.865826203" watchObservedRunningTime="2026-09-18 13:44:34.174239526 +0000 UTC m=+22.866111118"
Sep 18 13:44:34.189709 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.189666    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v9fxf" podStartSLOduration=3.75946238 podStartE2EDuration="22.18965081s" totalImagesPullingTime="18.43018843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:34.189299567 +0000 UTC m=+22.881171162" watchObservedRunningTime="2026-09-18 13:44:34.18965081 +0000 UTC m=+22.881522404"
Sep 18 13:44:34.844760 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:34.844577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:34.844760 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:34.844714    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:35.087006 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.086965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"4ca302e7192e9d6e68f85d2ae95d83e6294db84ff671b86e083adbeb383ed9fc"}
Sep 18 13:44:35.088638 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.088588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bdsdx" event={"ID":"2162ec05-2af7-4e4d-9f3b-c0b8b497b3b2","Type":"ContainerStarted","Data":"e063e13845ec9510561daa74fea810e2d5fd7fc27a87b06411edc75eaf165731"}
Sep 18 13:44:35.104442 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.104395    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bdsdx" podStartSLOduration=4.645581766 podStartE2EDuration="23.104378053s" totalImagesPullingTime="18.458796287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:35.10411552 +0000 UTC m=+23.795987117" watchObservedRunningTime="2026-09-18 13:44:35.104378053 +0000 UTC m=+23.796249648"
Sep 18 13:44:35.375204 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.374985    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 13:44:35.795582 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.795443    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T13:44:35.375198824Z","UUID":"656b3d01-36e7-42ce-a572-3d97354eb4c0","Handler":null,"Name":"","Endpoint":""}
Sep 18 13:44:35.797202 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.797173    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 13:44:35.797399 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.797214    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 13:44:35.848877 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.848847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:35.849057 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:35.848975    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:35.849057 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:35.848986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:35.849169 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:35.849112    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:36.094869 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:36.094732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6" event={"ID":"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b","Type":"ContainerStarted","Data":"cbc109a9e1ad445a6099bebf4c8efba4e581f783f9b87dfea15864a29fa5d436"}
Sep 18 13:44:36.844627 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:36.844571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:36.844810 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:36.844726    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:37.100004 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:37.099963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6" event={"ID":"68ec9be6-5bd1-4fc0-b02e-8147cf9dd64b","Type":"ContainerStarted","Data":"ddddf8de278338e67335b882f0bae473f623263ba9b01ef35fd25f6aabd13275"}
Sep 18 13:44:37.104367 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:37.104330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"290603e170d89f01f5e0bbaf5e322f0a5fcbab8b1ea677437007c13b45251d6a"}
Sep 18 13:44:37.121703 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:37.121638    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7dm6" podStartSLOduration=4.01760463 podStartE2EDuration="25.121601386s" totalImagesPullingTime="21.103996756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:37.121020898 +0000 UTC m=+25.812892493" watchObservedRunningTime="2026-09-18 13:44:37.121601386 +0000 UTC m=+25.813473037"
Sep 18 13:44:37.179565 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:37.179528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:37.180118 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:37.180098    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:37.844434 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:37.844338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:37.844434 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:37.844378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:37.845031 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:37.844462    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:37.845031 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:37.844560    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:38.844994 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:38.844809    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:38.845352 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:38.845073    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:39.112249 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.112156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" event={"ID":"b51bc9c1-b835-434e-ae0d-97705015dc5d","Type":"ContainerStarted","Data":"ecc7364c7353b5c62e25da7b2981fdeebf0b94e4975f0c2bce1a9a181ce00d16"}
Sep 18 13:44:39.112426 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.112391    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:39.114266 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.114237    2578 generic.go:356] "Generic (PLEG): container finished" podID="51edadfa-9802-46ec-bfe7-f7b588ddbe27" containerID="7cff282179bb23b51a1e9f7269785bbeb7a95676208f6daf143e4b818ed53974" exitCode=0
Sep 18 13:44:39.114404 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.114291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerDied","Data":"7cff282179bb23b51a1e9f7269785bbeb7a95676208f6daf143e4b818ed53974"}
Sep 18 13:44:39.129126 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.129101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:39.145311 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.145268    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g" podStartSLOduration=8.639699507 podStartE2EDuration="27.145254286s" totalImagesPullingTime="18.505554779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:39.144755846 +0000 UTC m=+27.836627441" watchObservedRunningTime="2026-09-18 13:44:39.145254286 +0000 UTC m=+27.837125908"
Sep 18 13:44:39.844763 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.844724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:39.845080 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:39.844855    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:39.845503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:39.845359    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:39.845503 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:39.845486    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:40.117413 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.117381    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:40.117557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.117470    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:40.137726 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.137702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:44:40.446577 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.446541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9dpx9"]
Sep 18 13:44:40.446736 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.446690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:40.446800 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:40.446780    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:40.460681 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.460655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f5x4t"]
Sep 18 13:44:40.460830 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.460760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:40.460893 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:40.460870    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:40.462308 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.462277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hqn26"]
Sep 18 13:44:40.462455 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:40.462370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:40.462514 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:40.462456    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:41.121795 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.121756    2578 generic.go:356] "Generic (PLEG): container finished" podID="51edadfa-9802-46ec-bfe7-f7b588ddbe27" containerID="30eb07b8c1394c3e34865892d6b0b92a54a73d9a55117b30492397acefc1c214" exitCode=0
Sep 18 13:44:41.122477 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.121803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerDied","Data":"30eb07b8c1394c3e34865892d6b0b92a54a73d9a55117b30492397acefc1c214"}
Sep 18 13:44:41.845108 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.845075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:41.845290 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:41.845168    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:41.845290 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.845278    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:41.845421 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:41.845398    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:41.845456 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.845438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:41.845527 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:41.845511    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:41.906131 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.906038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:41.906286 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.906163    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 13:44:41.906753 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:41.906733    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5hdp7"
Sep 18 13:44:42.126916 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:42.126885    2578 generic.go:356] "Generic (PLEG): container finished" podID="51edadfa-9802-46ec-bfe7-f7b588ddbe27" containerID="84af5e31b2a10bb3c9924a84aca0feb318eb35dc5a63fad8302ad45c7a796ec4" exitCode=0
Sep 18 13:44:42.127444 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:42.126970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerDied","Data":"84af5e31b2a10bb3c9924a84aca0feb318eb35dc5a63fad8302ad45c7a796ec4"}
Sep 18 13:44:43.844483 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:43.844250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:43.844934 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:43.844590    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:43.844934 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:43.844258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:43.844934 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:43.844692    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:43.844934 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:43.844250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:43.844934 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:43.844748    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:45.484522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:45.484491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:45.485077 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.484677    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:45.485077 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.484754    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:17.484732537 +0000 UTC m=+66.176604113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 13:44:45.585810 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:45.585774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:45.585999 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.585906    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:45.585999 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.585965    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret podName:b80e0bea-a2e6-4a2f-aca7-695a10be7fd6 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:17.585947383 +0000 UTC m=+66.277818958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret") pod "global-pull-secret-syncer-9dpx9" (UID: "b80e0bea-a2e6-4a2f-aca7-695a10be7fd6") : object "kube-system"/"original-pull-secret" not registered
Sep 18 13:44:45.686457 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:45.686426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:45.686667 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.686633    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 13:44:45.686667 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.686657    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 13:44:45.686794 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.686670    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2b4nb for pod openshift-network-diagnostics/network-check-target-f5x4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:45.686794 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.686732    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb podName:13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:17.686714091 +0000 UTC m=+66.378585667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b4nb" (UniqueName: "kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb") pod "network-check-target-f5x4t" (UID: "13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 13:44:45.845009 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:45.844920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:45.845175 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:45.844922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:45.845175 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.845071    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqn26" podUID="149df732-93b3-4c2a-bcc8-320bbc510572"
Sep 18 13:44:45.845303 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:45.844922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:45.845303 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.845184    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dpx9" podUID="b80e0bea-a2e6-4a2f-aca7-695a10be7fd6"
Sep 18 13:44:45.845303 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:45.845293    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f5x4t" podUID="13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8"
Sep 18 13:44:46.590765 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.590735    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-244.ec2.internal" event="NodeReady"
Sep 18 13:44:46.591203 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.590908    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 13:44:46.632134 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.632105    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d6859d99f-5vh4b"]
Sep 18 13:44:46.650335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.650305    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.653854 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.653458    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 13:44:46.653854 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.653464    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 13:44:46.655254 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.655232    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bfsnj"]
Sep 18 13:44:46.660731 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.660705    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zf5xv\""
Sep 18 13:44:46.660877 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.660860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 13:44:46.669286 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.669265    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 13:44:46.678861 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.678840    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6859d99f-5vh4b"]
Sep 18 13:44:46.678961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.678872    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c68zt"]
Sep 18 13:44:46.679028 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.679011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.683283 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.683260    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlrx5\""
Sep 18 13:44:46.683416 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.683401    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 13:44:46.683594 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.683566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 13:44:46.694844 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.694820    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c68zt"]
Sep 18 13:44:46.694936 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.694857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfsnj"]
Sep 18 13:44:46.695010 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.694947    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:46.697819 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.697798    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p62gx\""
Sep 18 13:44:46.697910 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.697824    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 13:44:46.697910 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.697798    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 13:44:46.697910 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.697848    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 13:44:46.794778 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.794737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnr6b\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-kube-api-access-qnr6b\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.794778 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.794777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtmt\" (UniqueName: \"kubernetes.io/projected/b76b3927-aa11-4333-8579-fa0edc1ec92c-kube-api-access-fqtmt\") pod \"ingress-canary-c68zt\" (UID: \"b76b3927-aa11-4333-8579-fa0edc1ec92c\") " pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:46.795029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.794828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8a26de-e991-45e2-bf80-9a9e1a24f310-config-volume\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.795029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.794844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.795029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.794860    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8a26de-e991-45e2-bf80-9a9e1a24f310-tmp-dir\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.795029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.794961    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-image-registry-private-configuration\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.795029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pnj\" (UniqueName: \"kubernetes.io/projected/4e8a26de-e991-45e2-bf80-9a9e1a24f310-kube-api-access-l5pnj\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.795029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76b3927-aa11-4333-8579-fa0edc1ec92c-cert\") pod \"ingress-canary-c68zt\" (UID: \"b76b3927-aa11-4333-8579-fa0edc1ec92c\") " pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:46.795265 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-trusted-ca\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.795265 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.795265 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-certificates\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.795265 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-bound-sa-token\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.795265 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b895b092-1b6c-4253-8571-8d572a3f1c7c-ca-trust-extracted\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.795265 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.795239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-installation-pull-secrets\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.843472 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.843440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:46.896122 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896122 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-certificates\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896122 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-bound-sa-token\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896122 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b895b092-1b6c-4253-8571-8d572a3f1c7c-ca-trust-extracted\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:46.896190    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:46.896209    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6859d99f-5vh4b: secret "image-registry-tls" not found
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-installation-pull-secrets\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:46.896268    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls podName:b895b092-1b6c-4253-8571-8d572a3f1c7c nodeName:}" failed. No retries permitted until 2026-09-18 13:44:47.396253471 +0000 UTC m=+36.088125044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls") pod "image-registry-5d6859d99f-5vh4b" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c") : secret "image-registry-tls" not found
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnr6b\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-kube-api-access-qnr6b\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtmt\" (UniqueName: \"kubernetes.io/projected/b76b3927-aa11-4333-8579-fa0edc1ec92c-kube-api-access-fqtmt\") pod \"ingress-canary-c68zt\" (UID: \"b76b3927-aa11-4333-8579-fa0edc1ec92c\") " pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8a26de-e991-45e2-bf80-9a9e1a24f310-config-volume\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.896429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8a26de-e991-45e2-bf80-9a9e1a24f310-tmp-dir\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-image-registry-private-configuration\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b895b092-1b6c-4253-8571-8d572a3f1c7c-ca-trust-extracted\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pnj\" (UniqueName: \"kubernetes.io/projected/4e8a26de-e991-45e2-bf80-9a9e1a24f310-kube-api-access-l5pnj\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76b3927-aa11-4333-8579-fa0edc1ec92c-cert\") pod \"ingress-canary-c68zt\" (UID: \"b76b3927-aa11-4333-8579-fa0edc1ec92c\") " pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:46.896530    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-trusted-ca\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:46.896572    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls podName:4e8a26de-e991-45e2-bf80-9a9e1a24f310 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:47.396558268 +0000 UTC m=+36.088429841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls") pod "dns-default-bfsnj" (UID: "4e8a26de-e991-45e2-bf80-9a9e1a24f310") : secret "dns-default-metrics-tls" not found
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-certificates\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.896882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.896879    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8a26de-e991-45e2-bf80-9a9e1a24f310-tmp-dir\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.897315 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.897055    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8a26de-e991-45e2-bf80-9a9e1a24f310-config-volume\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.897367 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.897315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-trusted-ca\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.900645 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.900625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-image-registry-private-configuration\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.900752 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.900660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-installation-pull-secrets\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.900752 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.900691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76b3927-aa11-4333-8579-fa0edc1ec92c-cert\") pod \"ingress-canary-c68zt\" (UID: \"b76b3927-aa11-4333-8579-fa0edc1ec92c\") " pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:46.906350 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.906321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtmt\" (UniqueName: \"kubernetes.io/projected/b76b3927-aa11-4333-8579-fa0edc1ec92c-kube-api-access-fqtmt\") pod \"ingress-canary-c68zt\" (UID: \"b76b3927-aa11-4333-8579-fa0edc1ec92c\") " pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:46.906474 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.906460    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnr6b\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-kube-api-access-qnr6b\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.907054 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.907038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-bound-sa-token\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:46.907949 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.907929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pnj\" (UniqueName: \"kubernetes.io/projected/4e8a26de-e991-45e2-bf80-9a9e1a24f310-kube-api-access-l5pnj\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:46.937029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:46.937001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:47.003318 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.003285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c68zt"
Sep 18 13:44:47.142888 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.142712    2578 generic.go:356] "Generic (PLEG): container finished" podID="51edadfa-9802-46ec-bfe7-f7b588ddbe27" containerID="7216f9a62644e534d7c8a3333576d123b42b559a22ecece08bc438d84370df27" exitCode=0
Sep 18 13:44:47.142888 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.142789    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerDied","Data":"7216f9a62644e534d7c8a3333576d123b42b559a22ecece08bc438d84370df27"}
Sep 18 13:44:47.326155 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.326122    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c68zt"]
Sep 18 13:44:47.355517 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:44:47.355478    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76b3927_aa11_4333_8579_fa0edc1ec92c.slice/crio-252fcc495c571f8e82843962e31bee52608ba13dd6dca52676fa7cb1ddb919ee WatchSource:0}: Error finding container 252fcc495c571f8e82843962e31bee52608ba13dd6dca52676fa7cb1ddb919ee: Status 404 returned error can't find the container with id 252fcc495c571f8e82843962e31bee52608ba13dd6dca52676fa7cb1ddb919ee
Sep 18 13:44:47.400323 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.400293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:47.400471 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.400336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:47.400471 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:47.400431    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:44:47.400471 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:47.400444    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:44:47.400471 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:47.400468    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6859d99f-5vh4b: secret "image-registry-tls" not found
Sep 18 13:44:47.400598 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:47.400478    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls podName:4e8a26de-e991-45e2-bf80-9a9e1a24f310 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:48.400466232 +0000 UTC m=+37.092337805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls") pod "dns-default-bfsnj" (UID: "4e8a26de-e991-45e2-bf80-9a9e1a24f310") : secret "dns-default-metrics-tls" not found
Sep 18 13:44:47.400598 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:47.400518    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls podName:b895b092-1b6c-4253-8571-8d572a3f1c7c nodeName:}" failed. No retries permitted until 2026-09-18 13:44:48.40050147 +0000 UTC m=+37.092373044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls") pod "image-registry-5d6859d99f-5vh4b" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c") : secret "image-registry-tls" not found
Sep 18 13:44:47.470518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.470490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:47.570837 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.570808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:47.848545 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.848459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:44:47.848545 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.848495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:44:47.849173 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.848466    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:44:47.851436 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.851417    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:44:47.852876 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.852627    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:44:47.852876 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.852695    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:44:47.852876 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.852644    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:44:47.852876 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.852646    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7x5xj\""
Sep 18 13:44:47.852876 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:47.852646    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cttxw\""
Sep 18 13:44:48.147172 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:48.147089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c68zt" event={"ID":"b76b3927-aa11-4333-8579-fa0edc1ec92c","Type":"ContainerStarted","Data":"252fcc495c571f8e82843962e31bee52608ba13dd6dca52676fa7cb1ddb919ee"}
Sep 18 13:44:48.150905 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:48.150867    2578 generic.go:356] "Generic (PLEG): container finished" podID="51edadfa-9802-46ec-bfe7-f7b588ddbe27" containerID="33ccde643d2ddad59ed5bad756b9f8b5f6f3c766ed02f9681fe0d98df7a45577" exitCode=0
Sep 18 13:44:48.151035 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:48.150933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerDied","Data":"33ccde643d2ddad59ed5bad756b9f8b5f6f3c766ed02f9681fe0d98df7a45577"}
Sep 18 13:44:48.410512 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:48.410414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:48.410512 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:48.410466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:48.410787 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:48.410572    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:44:48.410787 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:48.410589    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6859d99f-5vh4b: secret "image-registry-tls" not found
Sep 18 13:44:48.410787 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:48.410593    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:44:48.410787 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:48.410671    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls podName:b895b092-1b6c-4253-8571-8d572a3f1c7c nodeName:}" failed. No retries permitted until 2026-09-18 13:44:50.410653026 +0000 UTC m=+39.102524599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls") pod "image-registry-5d6859d99f-5vh4b" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c") : secret "image-registry-tls" not found
Sep 18 13:44:48.410787 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:48.410692    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls podName:4e8a26de-e991-45e2-bf80-9a9e1a24f310 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:50.41068394 +0000 UTC m=+39.102555514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls") pod "dns-default-bfsnj" (UID: "4e8a26de-e991-45e2-bf80-9a9e1a24f310") : secret "dns-default-metrics-tls" not found
Sep 18 13:44:48.465233 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:48.465179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:48.566240 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:48.566206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:49.158973 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:49.158937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" event={"ID":"51edadfa-9802-46ec-bfe7-f7b588ddbe27","Type":"ContainerStarted","Data":"acc76a52a554b0631f8efa736fe1d748ed76a3167d39a60d4f9f522f2977c930"}
Sep 18 13:44:49.187591 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:49.187537    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wrlr2" podStartSLOduration=8.441726601 podStartE2EDuration="37.187513644s" totalImagesPullingTime="28.745787043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:49.18614781 +0000 UTC m=+37.878019407" watchObservedRunningTime="2026-09-18 13:44:49.187513644 +0000 UTC m=+37.879385239"
Sep 18 13:44:49.316951 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:49.316920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:49.418680 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:49.418566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:50.165686 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:50.165586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c68zt" event={"ID":"b76b3927-aa11-4333-8579-fa0edc1ec92c","Type":"ContainerStarted","Data":"dd435c72bc312fabac3beb4d642726080bb0b5add1219fcd1c02257331c407b4"}
Sep 18 13:44:50.182433 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:50.182382    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c68zt" podStartSLOduration=1.699381555 podStartE2EDuration="4.182366575s" totalImagesPullingTime="2.48298502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:44:50.181274972 +0000 UTC m=+38.873146566" watchObservedRunningTime="2026-09-18 13:44:50.182366575 +0000 UTC m=+38.874238169"
Sep 18 13:44:50.409320 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:50.409284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:50.426461 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:50.426394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:50.426461 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:50.426435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:50.426637 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:50.426533    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:44:50.426637 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:50.426540    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:44:50.426637 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:50.426550    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6859d99f-5vh4b: secret "image-registry-tls" not found
Sep 18 13:44:50.426637 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:50.426599    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls podName:4e8a26de-e991-45e2-bf80-9a9e1a24f310 nodeName:}" failed. No retries permitted until 2026-09-18 13:44:54.426585241 +0000 UTC m=+43.118456814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls") pod "dns-default-bfsnj" (UID: "4e8a26de-e991-45e2-bf80-9a9e1a24f310") : secret "dns-default-metrics-tls" not found
Sep 18 13:44:50.426637 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:50.426636    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls podName:b895b092-1b6c-4253-8571-8d572a3f1c7c nodeName:}" failed. No retries permitted until 2026-09-18 13:44:54.426625448 +0000 UTC m=+43.118497024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls") pod "image-registry-5d6859d99f-5vh4b" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c") : secret "image-registry-tls" not found
Sep 18 13:44:51.789958 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:51.789918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:51.868240 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:51.868205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:51.961126 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:51.961089    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:52.046628 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:52.046517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:52.119034 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:52.119004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:52.189159 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:52.189130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:52.759136 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:52.759105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:52.827729 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:52.827697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:53.158934 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:53.158845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:53.223869 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:53.223838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:54.456366 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:54.456324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:44:54.456829 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:54.456376    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:44:54.456829 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:54.456486    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:44:54.456829 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:54.456500    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6859d99f-5vh4b: secret "image-registry-tls" not found
Sep 18 13:44:54.456829 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:54.456542    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:44:54.456829 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:54.456551    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls podName:b895b092-1b6c-4253-8571-8d572a3f1c7c nodeName:}" failed. No retries permitted until 2026-09-18 13:45:02.456537835 +0000 UTC m=+51.148409407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls") pod "image-registry-5d6859d99f-5vh4b" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c") : secret "image-registry-tls" not found
Sep 18 13:44:54.456829 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:44:54.456601    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls podName:4e8a26de-e991-45e2-bf80-9a9e1a24f310 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:02.456586948 +0000 UTC m=+51.148458521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls") pod "dns-default-bfsnj" (UID: "4e8a26de-e991-45e2-bf80-9a9e1a24f310") : secret "dns-default-metrics-tls" not found
Sep 18 13:44:56.887800 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:56.887770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:44:56.986691 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:44:56.986657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:00.358081 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:00.358042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:00.449525 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:00.449496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:01.560131 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:01.560099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:01.661888 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:01.661856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:02.513184 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:02.513134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:45:02.513406 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:02.513247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:45:02.513406 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:02.513321    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:45:02.513406 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:02.513352    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:45:02.513406 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:02.513364    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6859d99f-5vh4b: secret "image-registry-tls" not found
Sep 18 13:45:02.513648 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:02.513418    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls podName:4e8a26de-e991-45e2-bf80-9a9e1a24f310 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:18.513394787 +0000 UTC m=+67.205266362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls") pod "dns-default-bfsnj" (UID: "4e8a26de-e991-45e2-bf80-9a9e1a24f310") : secret "dns-default-metrics-tls" not found
Sep 18 13:45:02.513648 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:02.513437    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls podName:b895b092-1b6c-4253-8571-8d572a3f1c7c nodeName:}" failed. No retries permitted until 2026-09-18 13:45:18.513428254 +0000 UTC m=+67.205299828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls") pod "image-registry-5d6859d99f-5vh4b" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c") : secret "image-registry-tls" not found
Sep 18 13:45:12.138348 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:12.138319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kbs2g"
Sep 18 13:45:12.304087 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:12.304052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:12.405788 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:12.405717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:12.991228 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:12.991184    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:13.086594 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:13.086551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:13.152040 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:13.152007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:13.823595 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:13.823563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:13.925239 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:13.925206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:14.025301 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.025271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:14.770943 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.770909    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"]
Sep 18 13:45:14.773334 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.773316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:14.778655 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.778634    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:45:14.779685 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.779290    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 18 13:45:14.779685 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.779304    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 18 13:45:14.779966 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.779952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lw6nn\""
Sep 18 13:45:14.798733 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.798684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzth\" (UniqueName: \"kubernetes.io/projected/e55d931f-ed5b-40f4-aab2-0414459fae21-kube-api-access-nzzth\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:14.798884 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.798815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:14.807477 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.807449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"]
Sep 18 13:45:14.847834 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.847793    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"]
Sep 18 13:45:14.849871 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.849844    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-gxvq5"]
Sep 18 13:45:14.849994 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.849962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:14.851378 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.851361    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"]
Sep 18 13:45:14.851512 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.851495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:14.852842 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.852827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:14.853200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.853186    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 18 13:45:14.853284 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.853268    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 18 13:45:14.853518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.853498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 18 13:45:14.853647 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.853591    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:45:14.857403 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857383    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 13:45:14.857532 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857507    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 18 13:45:14.857632 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857544    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 18 13:45:14.857632 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857470    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 13:45:14.857753 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857447    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 18 13:45:14.857753 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857657    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 18 13:45:14.857753 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857516    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qncng\""
Sep 18 13:45:14.857753 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.857435    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lfrr2\""
Sep 18 13:45:14.858507 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.858484    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8xj9m\""
Sep 18 13:45:14.862255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.862237    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"]
Sep 18 13:45:14.863623 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.863575    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 18 13:45:14.867548 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.867528    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"]
Sep 18 13:45:14.870733 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.870713    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-gxvq5"]
Sep 18 13:45:14.899291 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:14.899430 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvklw\" (UniqueName: \"kubernetes.io/projected/b04fd5d5-8518-4854-8cdb-a029e7375848-kube-api-access-fvklw\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:14.899430 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:14.899430 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b04fd5d5-8518-4854-8cdb-a029e7375848-config\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:14.899430 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzth\" (UniqueName: \"kubernetes.io/projected/e55d931f-ed5b-40f4-aab2-0414459fae21-kube-api-access-nzzth\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:14.899430 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:14.899385    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 13:45:14.899599 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:14.899451    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls podName:e55d931f-ed5b-40f4-aab2-0414459fae21 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:15.399437321 +0000 UTC m=+64.091308895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-6jmw5" (UID: "e55d931f-ed5b-40f4-aab2-0414459fae21") : secret "samples-operator-tls" not found
Sep 18 13:45:14.899599 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-snapshots\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:14.899599 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b04fd5d5-8518-4854-8cdb-a029e7375848-serving-cert\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:14.899599 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:14.899800 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:14.899800 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-tmp\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:14.899800 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9brc\" (UniqueName: \"kubernetes.io/projected/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-kube-api-access-k9brc\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:14.899800 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82ab6358-26a3-4c07-8562-3a196b22852f-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:14.899800 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.899749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-serving-cert\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:14.909589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:14.909566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzth\" (UniqueName: \"kubernetes.io/projected/e55d931f-ed5b-40f4-aab2-0414459fae21-kube-api-access-nzzth\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:15.000880 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.000830    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-serving-cert\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.000880 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.000889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvklw\" (UniqueName: \"kubernetes.io/projected/b04fd5d5-8518-4854-8cdb-a029e7375848-kube-api-access-fvklw\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:15.001097 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.001097 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b04fd5d5-8518-4854-8cdb-a029e7375848-config\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:15.001197 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-snapshots\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.001197 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b04fd5d5-8518-4854-8cdb-a029e7375848-serving-cert\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:15.001197 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:15.001336 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.001336 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-tmp\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.001336 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9brc\" (UniqueName: \"kubernetes.io/projected/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-kube-api-access-k9brc\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.001336 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:15.001303    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:45:15.001526 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:15.001406    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert podName:82ab6358-26a3-4c07-8562-3a196b22852f nodeName:}" failed. No retries permitted until 2026-09-18 13:45:15.501382376 +0000 UTC m=+64.193253964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-8bmdp" (UID: "82ab6358-26a3-4c07-8562-3a196b22852f") : secret "networking-console-plugin-cert" not found
Sep 18 13:45:15.001699 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001674    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82ab6358-26a3-4c07-8562-3a196b22852f-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:15.001921 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b04fd5d5-8518-4854-8cdb-a029e7375848-config\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:15.002102 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-tmp\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.002227 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001934    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.002227 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.001941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-snapshots\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.002306 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.002293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82ab6358-26a3-4c07-8562-3a196b22852f-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:15.002908 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.002884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.003758 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.003738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b04fd5d5-8518-4854-8cdb-a029e7375848-serving-cert\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:15.004009 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.003995    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-serving-cert\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.010315 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.010292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvklw\" (UniqueName: \"kubernetes.io/projected/b04fd5d5-8518-4854-8cdb-a029e7375848-kube-api-access-fvklw\") pod \"service-ca-operator-57cdc4b768-tgj9t\" (UID: \"b04fd5d5-8518-4854-8cdb-a029e7375848\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:15.010419 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.010323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9brc\" (UniqueName: \"kubernetes.io/projected/0bd27ddc-ed3e-4986-8c83-a9bc5f90c977-kube-api-access-k9brc\") pod \"insights-operator-6f9c644dd9-gxvq5\" (UID: \"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977\") " pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.079925 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.079839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.160126 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.160092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"
Sep 18 13:45:15.166753 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.166736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5"
Sep 18 13:45:15.179942 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.179918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.405634 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.405519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:15.405794 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:15.405697    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 13:45:15.405794 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:15.405763    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls podName:e55d931f-ed5b-40f4-aab2-0414459fae21 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:16.40574751 +0000 UTC m=+65.097619084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-6jmw5" (UID: "e55d931f-ed5b-40f4-aab2-0414459fae21") : secret "samples-operator-tls" not found
Sep 18 13:45:15.432325 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.432298    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t"]
Sep 18 13:45:15.436777 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:15.436749    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04fd5d5_8518_4854_8cdb_a029e7375848.slice/crio-98bd254cbafd560adf9d16a1fe3b592651c10960e369b80f9c8d86a890173951 WatchSource:0}: Error finding container 98bd254cbafd560adf9d16a1fe3b592651c10960e369b80f9c8d86a890173951: Status 404 returned error can't find the container with id 98bd254cbafd560adf9d16a1fe3b592651c10960e369b80f9c8d86a890173951
Sep 18 13:45:15.437471 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.437449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-gxvq5"]
Sep 18 13:45:15.440804 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:15.440782    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd27ddc_ed3e_4986_8c83_a9bc5f90c977.slice/crio-7c869dc4fddfc372c4312c163be0a241d19dd7cc17d9857ae02118f162c85531 WatchSource:0}: Error finding container 7c869dc4fddfc372c4312c163be0a241d19dd7cc17d9857ae02118f162c85531: Status 404 returned error can't find the container with id 7c869dc4fddfc372c4312c163be0a241d19dd7cc17d9857ae02118f162c85531
Sep 18 13:45:15.456014 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.455989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.506051 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.506017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:15.506175 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:15.506121    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:45:15.506175 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:15.506169    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert podName:82ab6358-26a3-4c07-8562-3a196b22852f nodeName:}" failed. No retries permitted until 2026-09-18 13:45:16.506156321 +0000 UTC m=+65.198027894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-8bmdp" (UID: "82ab6358-26a3-4c07-8562-3a196b22852f") : secret "networking-console-plugin-cert" not found
Sep 18 13:45:15.856176 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.856124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:15.913805 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:15.913770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:16.228455 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:16.228419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5" event={"ID":"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977","Type":"ContainerStarted","Data":"7c869dc4fddfc372c4312c163be0a241d19dd7cc17d9857ae02118f162c85531"}
Sep 18 13:45:16.229793 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:16.229767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t" event={"ID":"b04fd5d5-8518-4854-8cdb-a029e7375848","Type":"ContainerStarted","Data":"98bd254cbafd560adf9d16a1fe3b592651c10960e369b80f9c8d86a890173951"}
Sep 18 13:45:16.413480 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:16.413436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:16.413685 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:16.413648    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 13:45:16.413735 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:16.413723    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls podName:e55d931f-ed5b-40f4-aab2-0414459fae21 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:18.413701272 +0000 UTC m=+67.105572857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-6jmw5" (UID: "e55d931f-ed5b-40f4-aab2-0414459fae21") : secret "samples-operator-tls" not found
Sep 18 13:45:16.514575 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:16.514492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:16.514745 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:16.514670    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:45:16.514801 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:16.514757    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert podName:82ab6358-26a3-4c07-8562-3a196b22852f nodeName:}" failed. No retries permitted until 2026-09-18 13:45:18.514735943 +0000 UTC m=+67.206607530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-8bmdp" (UID: "82ab6358-26a3-4c07-8562-3a196b22852f") : secret "networking-console-plugin-cert" not found
Sep 18 13:45:17.523654 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.523589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:45:17.526846 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.526819    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 13:45:17.534501 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:17.534481    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 13:45:17.534640 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:17.534548    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs podName:149df732-93b3-4c2a-bcc8-320bbc510572 nodeName:}" failed. No retries permitted until 2026-09-18 13:46:21.534525366 +0000 UTC m=+130.226396956 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs") pod "network-metrics-daemon-hqn26" (UID: "149df732-93b3-4c2a-bcc8-320bbc510572") : secret "metrics-daemon-secret" not found
Sep 18 13:45:17.624931 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.624889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:45:17.627991 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.627964    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 13:45:17.638391 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.638369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b80e0bea-a2e6-4a2f-aca7-695a10be7fd6-original-pull-secret\") pod \"global-pull-secret-syncer-9dpx9\" (UID: \"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6\") " pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:45:17.726234 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.726191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:45:17.729226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.729198    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 13:45:17.740015 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.739988    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 13:45:17.750251 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.750224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4nb\" (UniqueName: \"kubernetes.io/projected/13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8-kube-api-access-2b4nb\") pod \"network-check-target-f5x4t\" (UID: \"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8\") " pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:45:17.863736 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.863664    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7x5xj\""
Sep 18 13:45:17.868836 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.868815    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dpx9"
Sep 18 13:45:17.870963 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:17.870946    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:45:18.432710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:18.432670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:18.432884 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.432849    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 13:45:18.432947 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.432934    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls podName:e55d931f-ed5b-40f4-aab2-0414459fae21 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:22.432912882 +0000 UTC m=+71.124784461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-6jmw5" (UID: "e55d931f-ed5b-40f4-aab2-0414459fae21") : secret "samples-operator-tls" not found
Sep 18 13:45:18.533376 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:18.533295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:45:18.533376 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:18.533332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:18.533376 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:18.533374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:45:18.533856 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.533450    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 13:45:18.533856 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.533456    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 13:45:18.533856 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.533468    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6859d99f-5vh4b: secret "image-registry-tls" not found
Sep 18 13:45:18.533856 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.533526    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:45:18.533856 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.533541    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls podName:b895b092-1b6c-4253-8571-8d572a3f1c7c nodeName:}" failed. No retries permitted until 2026-09-18 13:45:50.533525885 +0000 UTC m=+99.225397458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls") pod "image-registry-5d6859d99f-5vh4b" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c") : secret "image-registry-tls" not found
Sep 18 13:45:18.533856 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.533556    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls podName:4e8a26de-e991-45e2-bf80-9a9e1a24f310 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:50.533550413 +0000 UTC m=+99.225421985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls") pod "dns-default-bfsnj" (UID: "4e8a26de-e991-45e2-bf80-9a9e1a24f310") : secret "dns-default-metrics-tls" not found
Sep 18 13:45:18.533856 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:18.533591    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert podName:82ab6358-26a3-4c07-8562-3a196b22852f nodeName:}" failed. No retries permitted until 2026-09-18 13:45:22.533573143 +0000 UTC m=+71.225444721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-8bmdp" (UID: "82ab6358-26a3-4c07-8562-3a196b22852f") : secret "networking-console-plugin-cert" not found
Sep 18 13:45:18.544331 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:18.544305    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9dpx9"]
Sep 18 13:45:18.548183 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:18.548153    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80e0bea_a2e6_4a2f_aca7_695a10be7fd6.slice/crio-6d01a8346b0ba7add309c5d39dcd876a9cd1bcb7486deb976cbf91e72446d500 WatchSource:0}: Error finding container 6d01a8346b0ba7add309c5d39dcd876a9cd1bcb7486deb976cbf91e72446d500: Status 404 returned error can't find the container with id 6d01a8346b0ba7add309c5d39dcd876a9cd1bcb7486deb976cbf91e72446d500
Sep 18 13:45:18.548791 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:18.548638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f5x4t"]
Sep 18 13:45:18.551692 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:18.551662    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d3f464_bad6_4ca0_aa1f_c50aaa2a51a8.slice/crio-0d770c990035ae4ecd273710e8e4d3a96952e55b23da25c1f98fa16d47c1a355 WatchSource:0}: Error finding container 0d770c990035ae4ecd273710e8e4d3a96952e55b23da25c1f98fa16d47c1a355: Status 404 returned error can't find the container with id 0d770c990035ae4ecd273710e8e4d3a96952e55b23da25c1f98fa16d47c1a355
Sep 18 13:45:19.240175 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.240103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f5x4t" event={"ID":"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8","Type":"ContainerStarted","Data":"0d770c990035ae4ecd273710e8e4d3a96952e55b23da25c1f98fa16d47c1a355"}
Sep 18 13:45:19.241864 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.241830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5" event={"ID":"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977","Type":"ContainerStarted","Data":"fd58b8d913ad0687b7720d95eabee8c72484abbe15974eb3094fae4a36aa32c8"}
Sep 18 13:45:19.244490 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.244437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t" event={"ID":"b04fd5d5-8518-4854-8cdb-a029e7375848","Type":"ContainerStarted","Data":"638e064f9ff74942ee28694898efc5faf412c9e76a6dedf4099bcb0d9b6da48a"}
Sep 18 13:45:19.246069 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.246041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9dpx9" event={"ID":"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6","Type":"ContainerStarted","Data":"6d01a8346b0ba7add309c5d39dcd876a9cd1bcb7486deb976cbf91e72446d500"}
Sep 18 13:45:19.297757 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.295132    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5" podStartSLOduration=2.467510338 podStartE2EDuration="5.295107787s" totalImagesPullingTime="2.827597449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:19.276574549 +0000 UTC m=+67.968446144" watchObservedRunningTime="2026-09-18 13:45:19.295107787 +0000 UTC m=+67.986979384"
Sep 18 13:45:19.297757 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.295679    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t" podStartSLOduration=2.468031415 podStartE2EDuration="5.295666094s" totalImagesPullingTime="2.827634679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:19.294628711 +0000 UTC m=+67.986500299" watchObservedRunningTime="2026-09-18 13:45:19.295666094 +0000 UTC m=+67.987537693"
Sep 18 13:45:19.608181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.608095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:19.672957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.672919    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kflk6"]
Sep 18 13:45:19.676177 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.676148    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.680967 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.680876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8k78s\""
Sep 18 13:45:19.680967 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.680882    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 13:45:19.681346 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.681283    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 13:45:19.689646 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.689620    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kflk6"]
Sep 18 13:45:19.714856 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.714810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:19.745693 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.745654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06373ef4-cef7-475e-99aa-9c3004af9903-data-volume\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.745939 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.745752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06373ef4-cef7-475e-99aa-9c3004af9903-crio-socket\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.745939 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.745880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb7xk\" (UniqueName: \"kubernetes.io/projected/06373ef4-cef7-475e-99aa-9c3004af9903-kube-api-access-sb7xk\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.745939 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.745927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.746073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.745952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.847771 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.847738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb7xk\" (UniqueName: \"kubernetes.io/projected/06373ef4-cef7-475e-99aa-9c3004af9903-kube-api-access-sb7xk\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.847957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.847784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.847957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.847821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.847957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.847860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06373ef4-cef7-475e-99aa-9c3004af9903-data-volume\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.847957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.847944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06373ef4-cef7-475e-99aa-9c3004af9903-crio-socket\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.848188 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:19.847970    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:19.848188 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:19.848033    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:20.348017575 +0000 UTC m=+69.039889148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:19.848188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.848070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06373ef4-cef7-475e-99aa-9c3004af9903-crio-socket\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.848188 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:19.848140    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:45:19.848370 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:19.848195    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:20.34817961 +0000 UTC m=+69.040051187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : configmap "kube-rbac-proxy" not found
Sep 18 13:45:19.848468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.848447    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06373ef4-cef7-475e-99aa-9c3004af9903-data-volume\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.860837 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.860764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb7xk\" (UniqueName: \"kubernetes.io/projected/06373ef4-cef7-475e-99aa-9c3004af9903-kube-api-access-sb7xk\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:19.989113 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:19.989069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:20.089391 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.089348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:20.189474 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.189440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:20.305001 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.304962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:20.354197 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.353550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:20.354197 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.353636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:20.354197 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:20.353739    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:20.354197 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:20.353745    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:45:20.354197 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:20.353809    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:21.353787887 +0000 UTC m=+70.045659460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : configmap "kube-rbac-proxy" not found
Sep 18 13:45:20.354197 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:20.353827    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:21.353818575 +0000 UTC m=+70.045690148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:20.406660 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.406627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:20.476620 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.476518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:20.979703 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.979655    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"]
Sep 18 13:45:20.984685 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.984660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"
Sep 18 13:45:20.987764 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.987737    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 18 13:45:20.987871 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.987799    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 18 13:45:20.988945 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.988918    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-82qx9\""
Sep 18 13:45:20.993416 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:20.993388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"]
Sep 18 13:45:21.031475 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.031443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:21.059519 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.059473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9z58\" (UniqueName: \"kubernetes.io/projected/414f8052-e7f2-4ec8-b140-689caeb7d853-kube-api-access-q9z58\") pod \"migrator-76794cbd6c-z899w\" (UID: \"414f8052-e7f2-4ec8-b140-689caeb7d853\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"
Sep 18 13:45:21.093933 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.093875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:21.160577 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.160531    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9z58\" (UniqueName: \"kubernetes.io/projected/414f8052-e7f2-4ec8-b140-689caeb7d853-kube-api-access-q9z58\") pod \"migrator-76794cbd6c-z899w\" (UID: \"414f8052-e7f2-4ec8-b140-689caeb7d853\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"
Sep 18 13:45:21.170406 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.170373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9z58\" (UniqueName: \"kubernetes.io/projected/414f8052-e7f2-4ec8-b140-689caeb7d853-kube-api-access-q9z58\") pod \"migrator-76794cbd6c-z899w\" (UID: \"414f8052-e7f2-4ec8-b140-689caeb7d853\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"
Sep 18 13:45:21.300200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.300106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"
Sep 18 13:45:21.362696 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.362654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:21.362865 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.362709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:21.362922 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:21.362856    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:21.362922 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:21.362868    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:45:21.363037 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:21.362931    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:23.362913785 +0000 UTC m=+72.054785358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:21.363037 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:21.362950    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:23.362942581 +0000 UTC m=+72.054814155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : configmap "kube-rbac-proxy" not found
Sep 18 13:45:21.421566 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.421530    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9fxf_6da04e18-92bd-4437-a852-fa667bdd230b/dns-node-resolver/0.log"
Sep 18 13:45:21.904708 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.904673    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-zhzl7"]
Sep 18 13:45:21.908053 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.908027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:21.910759 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.910735    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rfztg\""
Sep 18 13:45:21.910879 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.910825    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 18 13:45:21.911907 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.911888    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 18 13:45:21.912017 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.911989    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 18 13:45:21.912017 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.911996    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 18 13:45:21.919360 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.919339    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-zhzl7"]
Sep 18 13:45:21.954575 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.954516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:21.968515 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.968487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f6efd25-ba24-41fc-9568-93d267bdaced-signing-key\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:21.968698 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.968623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f6efd25-ba24-41fc-9568-93d267bdaced-signing-cabundle\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:21.968698 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:21.968676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf62b\" (UniqueName: \"kubernetes.io/projected/4f6efd25-ba24-41fc-9568-93d267bdaced-kube-api-access-rf62b\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.008635 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.008560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:22.069893 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.069862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f6efd25-ba24-41fc-9568-93d267bdaced-signing-cabundle\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.070059 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.069908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf62b\" (UniqueName: \"kubernetes.io/projected/4f6efd25-ba24-41fc-9568-93d267bdaced-kube-api-access-rf62b\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.070059 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.069971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f6efd25-ba24-41fc-9568-93d267bdaced-signing-key\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.070635 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.070594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f6efd25-ba24-41fc-9568-93d267bdaced-signing-cabundle\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.072793 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.072764    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f6efd25-ba24-41fc-9568-93d267bdaced-signing-key\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.082797 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.082775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf62b\" (UniqueName: \"kubernetes.io/projected/4f6efd25-ba24-41fc-9568-93d267bdaced-kube-api-access-rf62b\") pod \"service-ca-55f6fc7b86-zhzl7\" (UID: \"4f6efd25-ba24-41fc-9568-93d267bdaced\") " pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.218483 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.218454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7"
Sep 18 13:45:22.422045 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.422011    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsffq_1cc9d4a5-7c7b-44d8-96d8-807e5250fc65/node-ca/0.log"
Sep 18 13:45:22.474425 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.474332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:22.474571 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:22.474493    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 13:45:22.474571 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:22.474565    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls podName:e55d931f-ed5b-40f4-aab2-0414459fae21 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:30.474544098 +0000 UTC m=+79.166415676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-6jmw5" (UID: "e55d931f-ed5b-40f4-aab2-0414459fae21") : secret "samples-operator-tls" not found
Sep 18 13:45:22.575077 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.575031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:22.575292 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:22.575193    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:45:22.575292 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:22.575287    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert podName:82ab6358-26a3-4c07-8562-3a196b22852f nodeName:}" failed. No retries permitted until 2026-09-18 13:45:30.575267661 +0000 UTC m=+79.267139234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-8bmdp" (UID: "82ab6358-26a3-4c07-8562-3a196b22852f") : secret "networking-console-plugin-cert" not found
Sep 18 13:45:22.825351 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:22.825275    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c68zt_b76b3927-aa11-4333-8579-fa0edc1ec92c/serve-healthcheck-canary/0.log"
Sep 18 13:45:23.093544 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:23.093456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:23.380971 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:23.380949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:23.381098 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:23.380981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:23.381098 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:23.381060    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:45:23.381204 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:23.381102    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:27.381088883 +0000 UTC m=+76.072960456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : configmap "kube-rbac-proxy" not found
Sep 18 13:45:23.381204 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:23.381106    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:23.381204 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:23.381164    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:27.38114679 +0000 UTC m=+76.073018383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:23.551976 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:23.551939    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-zhzl7"]
Sep 18 13:45:23.552834 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:23.552813    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w"]
Sep 18 13:45:23.554983 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:23.554961    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6efd25_ba24_41fc_9568_93d267bdaced.slice/crio-f493c85e8c6016680deadd847e93e05851319560b7ed5e7c00fccee7bd7d53bf WatchSource:0}: Error finding container f493c85e8c6016680deadd847e93e05851319560b7ed5e7c00fccee7bd7d53bf: Status 404 returned error can't find the container with id f493c85e8c6016680deadd847e93e05851319560b7ed5e7c00fccee7bd7d53bf
Sep 18 13:45:23.556371 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:23.556346    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414f8052_e7f2_4ec8_b140_689caeb7d853.slice/crio-566533fd52e16c8969784914d8307c823a103198f59144bd4e9d36c33ec1b513 WatchSource:0}: Error finding container 566533fd52e16c8969784914d8307c823a103198f59144bd4e9d36c33ec1b513: Status 404 returned error can't find the container with id 566533fd52e16c8969784914d8307c823a103198f59144bd4e9d36c33ec1b513
Sep 18 13:45:24.268696 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.268654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f5x4t" event={"ID":"13d3f464-bad6-4ca0-aa1f-c50aaa2a51a8","Type":"ContainerStarted","Data":"e256b825cbd9b02e7cbf3317ecd51bf60941df4be3310c10235b405c1e3e6e40"}
Sep 18 13:45:24.269103 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.268752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:45:24.271315 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.270985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9dpx9" event={"ID":"b80e0bea-a2e6-4a2f-aca7-695a10be7fd6","Type":"ContainerStarted","Data":"99fa2099dd5b12c1706280a43864ae1e686d2ccf94c87132577ae0beed5e2b4f"}
Sep 18 13:45:24.273151 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.273123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7" event={"ID":"4f6efd25-ba24-41fc-9568-93d267bdaced","Type":"ContainerStarted","Data":"91375345b61dfbc85ebb8725cbf924ed12542ae5f74eacfaf536ce004ddbf295"}
Sep 18 13:45:24.273273 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.273168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7" event={"ID":"4f6efd25-ba24-41fc-9568-93d267bdaced","Type":"ContainerStarted","Data":"f493c85e8c6016680deadd847e93e05851319560b7ed5e7c00fccee7bd7d53bf"}
Sep 18 13:45:24.274498 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.274475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w" event={"ID":"414f8052-e7f2-4ec8-b140-689caeb7d853","Type":"ContainerStarted","Data":"566533fd52e16c8969784914d8307c823a103198f59144bd4e9d36c33ec1b513"}
Sep 18 13:45:24.287830 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.287709    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f5x4t" podStartSLOduration=67.569962837 podStartE2EDuration="1m12.287691012s" totalImagesPullingTime="4.717728175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:24.287428725 +0000 UTC m=+72.979300321" watchObservedRunningTime="2026-09-18 13:45:24.287691012 +0000 UTC m=+72.979562614"
Sep 18 13:45:24.304684 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.304628    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9dpx9" podStartSLOduration=67.569004918 podStartE2EDuration="1m12.304600404s" totalImagesPullingTime="4.735595486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:24.304185295 +0000 UTC m=+72.996056891" watchObservedRunningTime="2026-09-18 13:45:24.304600404 +0000 UTC m=+72.996472001"
Sep 18 13:45:24.323163 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.323114    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-zhzl7" podStartSLOduration=3.323095722 podStartE2EDuration="3.323095722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:24.321925175 +0000 UTC m=+73.013796774" watchObservedRunningTime="2026-09-18 13:45:24.323095722 +0000 UTC m=+73.014967317"
Sep 18 13:45:24.784357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.784320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:24.885896 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:24.885867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:25.017286 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:25.017211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:25.274683 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:25.274647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:25.280646 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:25.280455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w" event={"ID":"414f8052-e7f2-4ec8-b140-689caeb7d853","Type":"ContainerStarted","Data":"0cefb9eb15e060599dd71ef4f6f4a077ba6644f8ff6f68db28a650e7e8907cbb"}
Sep 18 13:45:25.280646 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:25.280510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w" event={"ID":"414f8052-e7f2-4ec8-b140-689caeb7d853","Type":"ContainerStarted","Data":"94069eaf7186e2b04cf13ce317e03e7ae3ef468dcdffd8adc8a9e46fb5386f72"}
Sep 18 13:45:25.305201 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:25.305147    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-z899w" podStartSLOduration=3.976172038 podStartE2EDuration="5.305126614s" totalImagesPullingTime="1.328954576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:25.304646212 +0000 UTC m=+73.996517805" watchObservedRunningTime="2026-09-18 13:45:25.305126614 +0000 UTC m=+73.996998211"
Sep 18 13:45:25.376237 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:25.376207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:25.494241 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:25.494203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:26.481245 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:26.481183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:26.889318 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:26.889201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:27.024724 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:27.024690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:27.104191 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:27.104157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:27.292051 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:27.292015    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:27.420642 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:27.420587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:27.420831 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:27.420650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:27.420831 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:27.420746    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 13:45:27.420831 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:27.420757    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:27.420831 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:27.420832    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:35.420816173 +0000 UTC m=+84.112687746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : secret "insights-runtime-extractor-tls" not found
Sep 18 13:45:27.420994 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:27.420849    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm podName:06373ef4-cef7-475e-99aa-9c3004af9903 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:35.420841617 +0000 UTC m=+84.112713190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kflk6" (UID: "06373ef4-cef7-475e-99aa-9c3004af9903") : configmap "kube-rbac-proxy" not found
Sep 18 13:45:27.478756 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:27.478723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:28.473705 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:28.473669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:28.575185 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:28.575158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:28.642880 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:28.642847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:28.889126 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:28.889043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:29.074904 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:29.074874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:29.287046 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:29.287010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:29.361097 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:29.361054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:29.714143 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:29.714103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:29.804375 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:29.804346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:30.117405 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:30.117328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:30.550442 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:30.550409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:30.553091 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:30.553058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d931f-ed5b-40f4-aab2-0414459fae21-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-6jmw5\" (UID: \"e55d931f-ed5b-40f4-aab2-0414459fae21\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:30.651201 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:30.651165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:30.651384 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:30.651341    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 13:45:30.651456 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:30.651424    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert podName:82ab6358-26a3-4c07-8562-3a196b22852f nodeName:}" failed. No retries permitted until 2026-09-18 13:45:46.651403348 +0000 UTC m=+95.343274938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-8bmdp" (UID: "82ab6358-26a3-4c07-8562-3a196b22852f") : secret "networking-console-plugin-cert" not found
Sep 18 13:45:30.681863 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:30.681837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"
Sep 18 13:45:30.876560 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:30.876469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:30.951531 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:30.951497    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5"]
Sep 18 13:45:31.077424 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:31.077383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:31.278252 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:31.278216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:31.306963 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:31.306932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5" event={"ID":"e55d931f-ed5b-40f4-aab2-0414459fae21","Type":"ContainerStarted","Data":"4bda5cf0667550696916cb888c60d30000f32e906ebfa1db1508160bdff96da2"}
Sep 18 13:45:31.481012 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:31.480979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:31.681583 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:31.681475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:32.080901 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:32.080867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:32.681720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:32.681554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:32.841728 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:32.841695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:33.275061 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:33.274975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:33.315895 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:33.315861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5" event={"ID":"e55d931f-ed5b-40f4-aab2-0414459fae21","Type":"ContainerStarted","Data":"02641c6f58d7041f1d11cdb28d1cb2b0494f49702e885efba4e435b2519e5e65"}
Sep 18 13:45:33.316060 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:33.315961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5" event={"ID":"e55d931f-ed5b-40f4-aab2-0414459fae21","Type":"ContainerStarted","Data":"8e5ad351b340b17e24c78c168092ad1596df8e62e2eb918e2ad2f49497f38dbc"}
Sep 18 13:45:33.336625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:33.336561    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-6jmw5" podStartSLOduration=17.40876676 podStartE2EDuration="19.336545422s" totalImagesPullingTime="1.927778662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:33.335394924 +0000 UTC m=+82.027266518" watchObservedRunningTime="2026-09-18 13:45:33.336545422 +0000 UTC m=+82.028417011"
Sep 18 13:45:33.477911 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:33.477876    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:33.682382 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:33.682354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:34.093658 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:34.093553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:34.680147 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:34.680068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:35.077152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.077120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:35.276493 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.276458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:35.474416 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.474386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:35.501673 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.501636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:35.501868 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.501686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:35.502197 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.502177    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06373ef4-cef7-475e-99aa-9c3004af9903-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:35.504203 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.504183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06373ef4-cef7-475e-99aa-9c3004af9903-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kflk6\" (UID: \"06373ef4-cef7-475e-99aa-9c3004af9903\") " pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:35.589811 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.589755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kflk6"
Sep 18 13:45:35.864038 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:35.863954    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kflk6"]
Sep 18 13:45:35.867150 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:35.867119    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06373ef4_cef7_475e_99aa_9c3004af9903.slice/crio-37fbb2941d2a16dfecc2870a33ad106dc22773a8371c88fd6c371abb5ea76830 WatchSource:0}: Error finding container 37fbb2941d2a16dfecc2870a33ad106dc22773a8371c88fd6c371abb5ea76830: Status 404 returned error can't find the container with id 37fbb2941d2a16dfecc2870a33ad106dc22773a8371c88fd6c371abb5ea76830
Sep 18 13:45:36.329015 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:36.328974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflk6" event={"ID":"06373ef4-cef7-475e-99aa-9c3004af9903","Type":"ContainerStarted","Data":"e5e53d1ead70b320f98f273dca9427853e65e2f353ef6f8278547f6ab28301ae"}
Sep 18 13:45:36.329217 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:36.329035    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflk6" event={"ID":"06373ef4-cef7-475e-99aa-9c3004af9903","Type":"ContainerStarted","Data":"37fbb2941d2a16dfecc2870a33ad106dc22773a8371c88fd6c371abb5ea76830"}
Sep 18 13:45:37.334502 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:37.334453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflk6" event={"ID":"06373ef4-cef7-475e-99aa-9c3004af9903","Type":"ContainerStarted","Data":"2fd5b076e06d52c0292320f74635131610c47dcad09f2a51c58e91c38ae8b1d3"}
Sep 18 13:45:38.339157 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:38.339120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kflk6" event={"ID":"06373ef4-cef7-475e-99aa-9c3004af9903","Type":"ContainerStarted","Data":"194da3602bdea241791c79e112eda93e894a2ed7ed55fe907c0166735c54f2ff"}
Sep 18 13:45:38.361696 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:38.361643    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kflk6" podStartSLOduration=17.541300756 podStartE2EDuration="19.361625589s" totalImagesPullingTime="1.820324833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 13:45:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:38.359918548 +0000 UTC m=+87.051790146" watchObservedRunningTime="2026-09-18 13:45:38.361625589 +0000 UTC m=+87.053497198"
Sep 18 13:45:41.880571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:41.880538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:41.939899 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:41.939843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:44.500745 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.500706    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"]
Sep 18 13:45:44.504025 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.504002    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"]
Sep 18 13:45:44.504155 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.504137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.507195 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.507175    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.508155 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.508139    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 13:45:44.508867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.508846    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6dzvs\""
Sep 18 13:45:44.508867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.508864    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 13:45:44.509023 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.508846    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 13:45:44.514735 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.514718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 18 13:45:44.515203 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.515187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 18 13:45:44.515400 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.515388    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 18 13:45:44.515513 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.515498    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 18 13:45:44.515762 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.515747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 18 13:45:44.523222 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.523202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"]
Sep 18 13:45:44.524818 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.524799    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"]
Sep 18 13:45:44.594870 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.594837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:44.672410 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqb8\" (UniqueName: \"kubernetes.io/projected/90eb89f7-5d9d-40b2-b955-f28d6e014578-kube-api-access-8fqb8\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.672410 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.672675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzzr\" (UniqueName: \"kubernetes.io/projected/29a7056b-16b4-4c3d-99ec-e253bb655bfd-kube-api-access-xhzzr\") pod \"managed-serviceaccount-addon-agent-6f499694b6-4xg7l\" (UID: \"29a7056b-16b4-4c3d-99ec-e253bb655bfd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.672675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-ca\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.672675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.672675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb89f7-5d9d-40b2-b955-f28d6e014578-additional-service-ca\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.672675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a7056b-16b4-4c3d-99ec-e253bb655bfd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f499694b6-4xg7l\" (UID: \"29a7056b-16b4-4c3d-99ec-e253bb655bfd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.672675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.672671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-hub\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.687249 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.687219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:44.773118 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.773118 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzzr\" (UniqueName: \"kubernetes.io/projected/29a7056b-16b4-4c3d-99ec-e253bb655bfd-kube-api-access-xhzzr\") pod \"managed-serviceaccount-addon-agent-6f499694b6-4xg7l\" (UID: \"29a7056b-16b4-4c3d-99ec-e253bb655bfd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.773333 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-ca\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.773333 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.773333 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb89f7-5d9d-40b2-b955-f28d6e014578-additional-service-ca\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.773333 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a7056b-16b4-4c3d-99ec-e253bb655bfd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f499694b6-4xg7l\" (UID: \"29a7056b-16b4-4c3d-99ec-e253bb655bfd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.773333 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-hub\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.773333 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.773271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqb8\" (UniqueName: \"kubernetes.io/projected/90eb89f7-5d9d-40b2-b955-f28d6e014578-kube-api-access-8fqb8\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.774300 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.774270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/90eb89f7-5d9d-40b2-b955-f28d6e014578-additional-service-ca\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.776354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.776330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.776583 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.776335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-ca\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.776583 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.776375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.776583 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.776372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29a7056b-16b4-4c3d-99ec-e253bb655bfd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f499694b6-4xg7l\" (UID: \"29a7056b-16b4-4c3d-99ec-e253bb655bfd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.776583 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.776423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/90eb89f7-5d9d-40b2-b955-f28d6e014578-hub\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.782818 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.782778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqb8\" (UniqueName: \"kubernetes.io/projected/90eb89f7-5d9d-40b2-b955-f28d6e014578-kube-api-access-8fqb8\") pod \"cluster-proxy-proxy-agent-567db46b-84ktk\" (UID: \"90eb89f7-5d9d-40b2-b955-f28d6e014578\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.785092 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.785075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzzr\" (UniqueName: \"kubernetes.io/projected/29a7056b-16b4-4c3d-99ec-e253bb655bfd-kube-api-access-xhzzr\") pod \"managed-serviceaccount-addon-agent-6f499694b6-4xg7l\" (UID: \"29a7056b-16b4-4c3d-99ec-e253bb655bfd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.789592 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.789554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:44.826627 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.826591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"
Sep 18 13:45:44.832661 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.832637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"
Sep 18 13:45:44.889844 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.889679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:44.992745 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:44.992710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:45.125570 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.125503    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l"]
Sep 18 13:45:45.127095 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.127072    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk"]
Sep 18 13:45:45.128041 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:45.128008    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29a7056b_16b4_4c3d_99ec_e253bb655bfd.slice/crio-541de908060280c358260b0068fada8f5d3c42dd27d6f1cc02b996201a766b41 WatchSource:0}: Error finding container 541de908060280c358260b0068fada8f5d3c42dd27d6f1cc02b996201a766b41: Status 404 returned error can't find the container with id 541de908060280c358260b0068fada8f5d3c42dd27d6f1cc02b996201a766b41
Sep 18 13:45:45.129106 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:45.129036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90eb89f7_5d9d_40b2_b955_f28d6e014578.slice/crio-2c006b15bc9a647f04dbc18929f39096552ec05452ed2939e40243395b2f59bc WatchSource:0}: Error finding container 2c006b15bc9a647f04dbc18929f39096552ec05452ed2939e40243395b2f59bc: Status 404 returned error can't find the container with id 2c006b15bc9a647f04dbc18929f39096552ec05452ed2939e40243395b2f59bc
Sep 18 13:45:45.157616 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.157580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:45.233127 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.233100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:45.303657 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.303631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:45.364435 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.364398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk" event={"ID":"90eb89f7-5d9d-40b2-b955-f28d6e014578","Type":"ContainerStarted","Data":"2c006b15bc9a647f04dbc18929f39096552ec05452ed2939e40243395b2f59bc"}
Sep 18 13:45:45.365591 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.365561    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l" event={"ID":"29a7056b-16b4-4c3d-99ec-e253bb655bfd","Type":"ContainerStarted","Data":"541de908060280c358260b0068fada8f5d3c42dd27d6f1cc02b996201a766b41"}
Sep 18 13:45:45.679312 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.679261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:45.806335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.806298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:45.909667 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:45.909586    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:46.101968 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:46.101892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:46.186076 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:46.186003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:46.676133 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:46.676085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:46.692018 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:46.691981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:46.696231 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:46.696203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82ab6358-26a3-4c07-8562-3a196b22852f-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-8bmdp\" (UID: \"82ab6358-26a3-4c07-8562-3a196b22852f\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:46.873094 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:46.873040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:46.973582 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:46.973547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"
Sep 18 13:45:47.088683 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:47.088642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:47.246834 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:47.246744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:47.886445 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:47.886411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:47.990311 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:47.990245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:49.300586 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.300506    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp"]
Sep 18 13:45:49.303727 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:49.303696    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ab6358_26a3_4c07_8562_3a196b22852f.slice/crio-55b1cbb4ef623c529c0845cd812ed2ac527148f645d7dd0745a0a94956c0c681 WatchSource:0}: Error finding container 55b1cbb4ef623c529c0845cd812ed2ac527148f645d7dd0745a0a94956c0c681: Status 404 returned error can't find the container with id 55b1cbb4ef623c529c0845cd812ed2ac527148f645d7dd0745a0a94956c0c681
Sep 18 13:45:49.390140 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.390102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp" event={"ID":"82ab6358-26a3-4c07-8562-3a196b22852f","Type":"ContainerStarted","Data":"55b1cbb4ef623c529c0845cd812ed2ac527148f645d7dd0745a0a94956c0c681"}
Sep 18 13:45:49.392273 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.392243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk" event={"ID":"90eb89f7-5d9d-40b2-b955-f28d6e014578","Type":"ContainerStarted","Data":"4871e32be601c5c8c27c4bbcc7d22a6d364ea844c0adc904f15371222a4e11c0"}
Sep 18 13:45:49.392407 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.392291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk" event={"ID":"90eb89f7-5d9d-40b2-b955-f28d6e014578","Type":"ContainerStarted","Data":"66889d9f3dbf9c5cfd0e8dbe86e414e74396a84ac6b80a8dd1ed99471a197044"}
Sep 18 13:45:49.392407 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.392312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk" event={"ID":"90eb89f7-5d9d-40b2-b955-f28d6e014578","Type":"ContainerStarted","Data":"f99dfe74799338faf2d71d5aa2116c796a3def0c76aef83ac304550a41cfa369"}
Sep 18 13:45:49.393759 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.393738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l" event={"ID":"29a7056b-16b4-4c3d-99ec-e253bb655bfd","Type":"ContainerStarted","Data":"421718861ef2599d40cb88c0caaf95dbea4f6f8c1a7fc6045e8079130b07080e"}
Sep 18 13:45:49.418435 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.418386    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-567db46b-84ktk" podStartSLOduration=1.5040221599999999 podStartE2EDuration="5.418369408s" totalImagesPullingTime="3.914347248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:49.416502015 +0000 UTC m=+98.108373639" watchObservedRunningTime="2026-09-18 13:45:49.418369408 +0000 UTC m=+98.110241033"
Sep 18 13:45:49.439499 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:49.439442    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f499694b6-4xg7l" podStartSLOduration=1.534059086 podStartE2EDuration="5.439424416s" totalImagesPullingTime="3.90536533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:49.438035579 +0000 UTC m=+98.129907174" watchObservedRunningTime="2026-09-18 13:45:49.439424416 +0000 UTC m=+98.131296011"
Sep 18 13:45:50.629953 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.629925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:45:50.630276 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.629980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:45:50.632795 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.632766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8a26de-e991-45e2-bf80-9a9e1a24f310-metrics-tls\") pod \"dns-default-bfsnj\" (UID: \"4e8a26de-e991-45e2-bf80-9a9e1a24f310\") " pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:45:50.632884 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.632827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"image-registry-5d6859d99f-5vh4b\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") " pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:45:50.862829 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.862740    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zf5xv\""
Sep 18 13:45:50.870400 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.870378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:45:50.896144 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.896114    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlrx5\""
Sep 18 13:45:50.900132 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.900105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:45:50.982771 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:50.982743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:51.138561 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.138471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:51.195472 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.195372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6859d99f-5vh4b"]
Sep 18 13:45:51.197353 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.197292    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfsnj"]
Sep 18 13:45:51.200446 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:51.200419    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8a26de_e991_45e2_bf80_9a9e1a24f310.slice/crio-435a8240788f4791c070e134142d4877ec01db6f40e7597ab3201b205f5ae92d WatchSource:0}: Error finding container 435a8240788f4791c070e134142d4877ec01db6f40e7597ab3201b205f5ae92d: Status 404 returned error can't find the container with id 435a8240788f4791c070e134142d4877ec01db6f40e7597ab3201b205f5ae92d
Sep 18 13:45:51.267543 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.267512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:51.403261 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.403157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b" event={"ID":"b895b092-1b6c-4253-8571-8d572a3f1c7c","Type":"ContainerStarted","Data":"6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50"}
Sep 18 13:45:51.403261 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.403215    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b" event={"ID":"b895b092-1b6c-4253-8571-8d572a3f1c7c","Type":"ContainerStarted","Data":"e56dd07d6d4a9b09c69814b927c5232c661e44eac0db487134025f9882325741"}
Sep 18 13:45:51.403487 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.403296    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:45:51.404793 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.404753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp" event={"ID":"82ab6358-26a3-4c07-8562-3a196b22852f","Type":"ContainerStarted","Data":"251ef13c2b5d2d0679c1b187178bc407be5663949aa0a01e071707a263f2c0b2"}
Sep 18 13:45:51.406092 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.406073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfsnj" event={"ID":"4e8a26de-e991-45e2-bf80-9a9e1a24f310","Type":"ContainerStarted","Data":"435a8240788f4791c070e134142d4877ec01db6f40e7597ab3201b205f5ae92d"}
Sep 18 13:45:51.447473 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.447409    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b" podStartSLOduration=99.447384463 podStartE2EDuration="1m39.447384463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:51.446121934 +0000 UTC m=+100.137993531" watchObservedRunningTime="2026-09-18 13:45:51.447384463 +0000 UTC m=+100.139256060"
Sep 18 13:45:51.476483 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.476428    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-8bmdp" podStartSLOduration=36.201024088 podStartE2EDuration="37.476409655s" totalImagesPullingTime="1.275385567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:51.475702325 +0000 UTC m=+100.167573921" watchObservedRunningTime="2026-09-18 13:45:51.476409655 +0000 UTC m=+100.168281285"
Sep 18 13:45:51.488555 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.488526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:51.613416 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.613379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:51.722507 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:51.722396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:53.280302 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:53.280255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:53.348847 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:53.348812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:53.415768 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:53.415732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfsnj" event={"ID":"4e8a26de-e991-45e2-bf80-9a9e1a24f310","Type":"ContainerStarted","Data":"e809f418be560812bede0eae42db794c9aacd27abaaa9cea6472ac84dff618f0"}
Sep 18 13:45:53.415973 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:53.415781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfsnj" event={"ID":"4e8a26de-e991-45e2-bf80-9a9e1a24f310","Type":"ContainerStarted","Data":"fa083cbfde5962b8d4ed9a3b264d3638e022c5c4d199eceb1c490d382092b293"}
Sep 18 13:45:53.415973 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:53.415871    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:45:53.428183 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:53.428156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:53.435732 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:53.435684    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bfsnj" podStartSLOduration=65.941100578 podStartE2EDuration="1m7.435669212s" totalImagesPullingTime="1.494568634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:45:53.434897467 +0000 UTC m=+102.126769061" watchObservedRunningTime="2026-09-18 13:45:53.435669212 +0000 UTC m=+102.127540806"
Sep 18 13:45:54.673066 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:54.673033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:54.735431 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:54.735401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:55.259168 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:55.259133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:55.283080 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:55.283059    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f5x4t"
Sep 18 13:45:56.329400 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:56.329360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:56.446670 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:56.446638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:57.431116 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.431059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:57.652700 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.652665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:57.685188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.685157    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cl42t"]
Sep 18 13:45:57.708069 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.708038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.714457 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.714430    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 13:45:57.714953 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.714473    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 13:45:57.714953 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.714503    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 13:45:57.714953 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.714923    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h4fd4\""
Sep 18 13:45:57.715493 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.714923    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 13:45:57.717755 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.717738    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 13:45:57.718834 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.718814    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 13:45:57.750537 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.750506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:57.781480 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-metrics-client-ca\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781480 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781487    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-root\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781744 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-accelerators-collector-config\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781744 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-tls\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781744 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntzmd\" (UniqueName: \"kubernetes.io/projected/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-kube-api-access-ntzmd\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781744 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-sys\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781944 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781944 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-wtmp\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.781944 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.781844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-textfile\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.860065 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.860033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:57.882386 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-metrics-client-ca\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-root\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-root\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-accelerators-collector-config\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882769 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-tls\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882769 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntzmd\" (UniqueName: \"kubernetes.io/projected/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-kube-api-access-ntzmd\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882769 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-sys\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882769 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.882769 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:57.882733    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 13:45:57.882769 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-wtmp\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.883049 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.882789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-textfile\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.883049 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:45:57.882811    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-tls podName:e8cc6d70-8691-4104-82d8-a6d3ba2d8e51 nodeName:}" failed. No retries permitted until 2026-09-18 13:45:58.382788736 +0000 UTC m=+107.074660311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-tls") pod "node-exporter-cl42t" (UID: "e8cc6d70-8691-4104-82d8-a6d3ba2d8e51") : secret "node-exporter-tls" not found
Sep 18 13:45:57.883049 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.883043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-wtmp\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.883201 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.883051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-metrics-client-ca\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.883201 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.883122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-accelerators-collector-config\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.883201 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.883152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-textfile\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.883341 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.883239    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-sys\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.885252 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.885230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.894896 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.894870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntzmd\" (UniqueName: \"kubernetes.io/projected/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-kube-api-access-ntzmd\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:57.939185 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:57.939095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:58.006497 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.006462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:58.132841 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.132807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:58.387240 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.387140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-tls\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:58.389618 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.389589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8cc6d70-8691-4104-82d8-a6d3ba2d8e51-node-exporter-tls\") pod \"node-exporter-cl42t\" (UID: \"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51\") " pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:58.493506 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.493469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:58.596455 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.596421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:58.618427 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.618399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cl42t"
Sep 18 13:45:58.654102 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:45:58.654065    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cc6d70_8691_4104_82d8_a6d3ba2d8e51.slice/crio-a9e0a4efbb00f67fa1457886d4b62ce650e0572c390bf7fadf36616e9f778dd1 WatchSource:0}: Error finding container a9e0a4efbb00f67fa1457886d4b62ce650e0572c390bf7fadf36616e9f778dd1: Status 404 returned error can't find the container with id a9e0a4efbb00f67fa1457886d4b62ce650e0572c390bf7fadf36616e9f778dd1
Sep 18 13:45:58.694473 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.694442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:58.787725 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.787688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:58.916297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:58.916213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:45:59.438620 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:45:59.438568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl42t" event={"ID":"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51","Type":"ContainerStarted","Data":"a9e0a4efbb00f67fa1457886d4b62ce650e0572c390bf7fadf36616e9f778dd1"}
Sep 18 13:46:00.444226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:00.444194    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8cc6d70-8691-4104-82d8-a6d3ba2d8e51" containerID="f0b115238f6e9694b1608bfa22a44bb19612c2564d66f638b662b693b03911aa" exitCode=0
Sep 18 13:46:00.444732 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:00.444284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl42t" event={"ID":"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51","Type":"ContainerDied","Data":"f0b115238f6e9694b1608bfa22a44bb19612c2564d66f638b662b693b03911aa"}
Sep 18 13:46:00.690095 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:00.690061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:00.811755 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:00.811664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:00.892751 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:00.892721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:01.131571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:01.131487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:01.227460 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:01.227423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:01.450849 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:01.450812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl42t" event={"ID":"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51","Type":"ContainerStarted","Data":"8a1cdb77db3e75a65399ff5528f3d2fabd42b2f751798a4ebc40bc9c21dead0f"}
Sep 18 13:46:01.451229 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:01.450912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl42t" event={"ID":"e8cc6d70-8691-4104-82d8-a6d3ba2d8e51","Type":"ContainerStarted","Data":"66ae97d4192d9c9ce71b0147d73191cc5a4a1e28687b0273dbd3ad73fc21d1a1"}
Sep 18 13:46:01.474171 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:01.474108    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cl42t" podStartSLOduration=3.247568175 podStartE2EDuration="4.474090795s" totalImagesPullingTime="1.152540931s" totalInitContainerRuntime="73.981689ms" isStatefulPod=true podCreationTimestamp="2026-09-18 13:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:01.472484015 +0000 UTC m=+110.164355648" watchObservedRunningTime="2026-09-18 13:46:01.474090795 +0000 UTC m=+110.165962389"
Sep 18 13:46:02.450017 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:02.449982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:02.553108 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:02.553066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:02.779916 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:02.779826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:03.422001 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:03.421964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bfsnj"
Sep 18 13:46:03.719238 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:03.719202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:04.041986 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:04.041907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:05.469389 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:05.469339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:05.559199 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:05.559154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:06.632820 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:06.632788    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d6859d99f-5vh4b"]
Sep 18 13:46:06.637164 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:06.637137    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:46:06.719573 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:06.719541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:06.819663 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:06.819637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:07.896304 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:07.896265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:07.997415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:07.997382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:08.499430 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:08.499389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:09.075603 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:09.075568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:11.875810 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:11.875774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:11.976391 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:11.976360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:16.894595 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:16.894556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:16.996549 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:16.996513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:17.078396 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:17.078357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:18.068931 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:18.068894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:19.170557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:19.170517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:19.272952 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:19.272922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:21.319734 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:21.319698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:21.419100 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:21.419065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:21.486191 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:21.486162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:21.568631 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:21.568566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:46:21.571137 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:21.571074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/149df732-93b3-4c2a-bcc8-320bbc510572-metrics-certs\") pod \"network-metrics-daemon-hqn26\" (UID: \"149df732-93b3-4c2a-bcc8-320bbc510572\") " pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:46:21.777469 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:21.777435    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cttxw\""
Sep 18 13:46:21.784773 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:21.784750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqn26"
Sep 18 13:46:22.106713 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:22.106597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hqn26"]
Sep 18 13:46:22.109719 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:46:22.109687    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149df732_93b3_4c2a_bcc8_320bbc510572.slice/crio-eecc2a891b11c10a71792758755315433747d8c819f61674376afbbd1946b19c WatchSource:0}: Error finding container eecc2a891b11c10a71792758755315433747d8c819f61674376afbbd1946b19c: Status 404 returned error can't find the container with id eecc2a891b11c10a71792758755315433747d8c819f61674376afbbd1946b19c
Sep 18 13:46:22.525029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:22.524989    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hqn26" event={"ID":"149df732-93b3-4c2a-bcc8-320bbc510572","Type":"ContainerStarted","Data":"eecc2a891b11c10a71792758755315433747d8c819f61674376afbbd1946b19c"}
Sep 18 13:46:24.533639 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:24.533583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hqn26" event={"ID":"149df732-93b3-4c2a-bcc8-320bbc510572","Type":"ContainerStarted","Data":"f8496cca1bf78c2fac63f1c7e912a22dd5168dc37935b673d724c6e57eb8dc76"}
Sep 18 13:46:24.534042 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:24.533663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hqn26" event={"ID":"149df732-93b3-4c2a-bcc8-320bbc510572","Type":"ContainerStarted","Data":"25fedbf83782b0242ae12283e1664a22f7f9b6914a3001082bd9e3d5cea91649"}
Sep 18 13:46:24.554072 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:24.554021    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hqn26" podStartSLOduration=131.160498745 podStartE2EDuration="2m12.554004501s" totalImagesPullingTime="1.393505756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:46:24.553211157 +0000 UTC m=+133.245082751" watchObservedRunningTime="2026-09-18 13:46:24.554004501 +0000 UTC m=+133.245876096"
Sep 18 13:46:24.631115 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:24.631085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:24.733840 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:24.733803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:24.833252 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:24.833139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:26.873377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:26.873344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:26.943932 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:26.943891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:29.553308 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:29.553277    2578 generic.go:356] "Generic (PLEG): container finished" podID="0bd27ddc-ed3e-4986-8c83-a9bc5f90c977" containerID="fd58b8d913ad0687b7720d95eabee8c72484abbe15974eb3094fae4a36aa32c8" exitCode=0
Sep 18 13:46:29.553809 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:29.553361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5" event={"ID":"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977","Type":"ContainerDied","Data":"fd58b8d913ad0687b7720d95eabee8c72484abbe15974eb3094fae4a36aa32c8"}
Sep 18 13:46:29.553880 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:29.553835    2578 scope.go:117] "RemoveContainer" containerID="fd58b8d913ad0687b7720d95eabee8c72484abbe15974eb3094fae4a36aa32c8"
Sep 18 13:46:30.260230 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:30.260196    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c68zt_b76b3927-aa11-4333-8579-fa0edc1ec92c/serve-healthcheck-canary/0.log"
Sep 18 13:46:30.559240 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:30.559155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-gxvq5" event={"ID":"0bd27ddc-ed3e-4986-8c83-a9bc5f90c977","Type":"ContainerStarted","Data":"849b2f2b0e7690c06379eca0ddfdf4b0dfbaff21b33c97b04a4be2246e46e027"}
Sep 18 13:46:31.652166 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:31.652120    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b" podUID="b895b092-1b6c-4253-8571-8d572a3f1c7c" containerName="registry" containerID="cri-o://6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50" gracePeriod=30
Sep 18 13:46:31.897404 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:31.897379    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:46:32.046174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046138    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-bound-sa-token\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.046174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046178    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-image-registry-private-configuration\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.046408 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046211    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-installation-pull-secrets\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.046408 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnr6b\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-kube-api-access-qnr6b\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.046408 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046284    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-certificates\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.046408 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.046408 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046338    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b895b092-1b6c-4253-8571-8d572a3f1c7c-ca-trust-extracted\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.046672 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.046493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-trusted-ca\") pod \"b895b092-1b6c-4253-8571-8d572a3f1c7c\" (UID: \"b895b092-1b6c-4253-8571-8d572a3f1c7c\") "
Sep 18 13:46:32.047369 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.047285    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:32.047504 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.047436    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:46:32.049004 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.048973    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:32.049131 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.049063    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:32.049199 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.049142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:32.049291 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.049267    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:46:32.049427 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.049406    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-kube-api-access-qnr6b" (OuterVolumeSpecName: "kube-api-access-qnr6b") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "kube-api-access-qnr6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:46:32.055386 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.055364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b895b092-1b6c-4253-8571-8d572a3f1c7c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b895b092-1b6c-4253-8571-8d572a3f1c7c" (UID: "b895b092-1b6c-4253-8571-8d572a3f1c7c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:46:32.147297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147263    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-bound-sa-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.147297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147291    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-image-registry-private-configuration\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.147297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147302    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b895b092-1b6c-4253-8571-8d572a3f1c7c-installation-pull-secrets\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.147511 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147312    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnr6b\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-kube-api-access-qnr6b\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.147511 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147320    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-certificates\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.147511 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147328    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b895b092-1b6c-4253-8571-8d572a3f1c7c-registry-tls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.147511 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147336    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b895b092-1b6c-4253-8571-8d572a3f1c7c-ca-trust-extracted\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.147511 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.147344    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b895b092-1b6c-4253-8571-8d572a3f1c7c-trusted-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:46:32.568154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.568113    2578 generic.go:356] "Generic (PLEG): container finished" podID="b895b092-1b6c-4253-8571-8d572a3f1c7c" containerID="6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50" exitCode=0
Sep 18 13:46:32.568325 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.568209    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b"
Sep 18 13:46:32.568325 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.568203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b" event={"ID":"b895b092-1b6c-4253-8571-8d572a3f1c7c","Type":"ContainerDied","Data":"6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50"}
Sep 18 13:46:32.568325 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.568287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6859d99f-5vh4b" event={"ID":"b895b092-1b6c-4253-8571-8d572a3f1c7c","Type":"ContainerDied","Data":"e56dd07d6d4a9b09c69814b927c5232c661e44eac0db487134025f9882325741"}
Sep 18 13:46:32.568325 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.568309    2578 scope.go:117] "RemoveContainer" containerID="6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50"
Sep 18 13:46:32.577078 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.577062    2578 scope.go:117] "RemoveContainer" containerID="6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50"
Sep 18 13:46:32.577353 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:46:32.577337    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50\": container with ID starting with 6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50 not found: ID does not exist" containerID="6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50"
Sep 18 13:46:32.577411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.577360    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50"} err="failed to get container status \"6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50\": rpc error: code = NotFound desc = could not find container \"6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50\": container with ID starting with 6aa539b61186abe412fa7a391e2034f85aae5d0e876bc827d71521dd72e5ee50 not found: ID does not exist"
Sep 18 13:46:32.590671 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.590645    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d6859d99f-5vh4b"]
Sep 18 13:46:32.593770 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:32.593748    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d6859d99f-5vh4b"]
Sep 18 13:46:33.849565 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:33.849531    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b895b092-1b6c-4253-8571-8d572a3f1c7c" path="/var/lib/kubelet/pods/b895b092-1b6c-4253-8571-8d572a3f1c7c/volumes"
Sep 18 13:46:38.929044 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:38.929007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:39.025086 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:39.025038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:39.594060 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:39.594027    2578 generic.go:356] "Generic (PLEG): container finished" podID="b04fd5d5-8518-4854-8cdb-a029e7375848" containerID="638e064f9ff74942ee28694898efc5faf412c9e76a6dedf4099bcb0d9b6da48a" exitCode=0
Sep 18 13:46:39.594237 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:39.594071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t" event={"ID":"b04fd5d5-8518-4854-8cdb-a029e7375848","Type":"ContainerDied","Data":"638e064f9ff74942ee28694898efc5faf412c9e76a6dedf4099bcb0d9b6da48a"}
Sep 18 13:46:39.594440 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:39.594421    2578 scope.go:117] "RemoveContainer" containerID="638e064f9ff74942ee28694898efc5faf412c9e76a6dedf4099bcb0d9b6da48a"
Sep 18 13:46:40.600550 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:40.600516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-tgj9t" event={"ID":"b04fd5d5-8518-4854-8cdb-a029e7375848","Type":"ContainerStarted","Data":"468d4c6a9990a990df1b61925a5849e5577e7c54565e8b1250f8180bf29833e9"}
Sep 18 13:46:41.874043 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:41.873996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:41.931377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:41.931346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:49.504282 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:49.504245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:49.605018 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:49.604987    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:46:49.678234 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:46:49.678197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:17.033987 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:17.033947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:17.158533 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:17.158499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:24.825720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:24.825686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:26.148102 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:26.148069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:26.210101 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:26.210074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:37.183010 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:37.182981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:37.245857 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:37.245828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:37.304010 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:37.303975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:47:55.856998 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:47:55.856964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:00.303223 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:00.303192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:00.404916 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:00.404885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:14.106397 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:14.106361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:32.288196 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:32.288156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:32.343352 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:32.343317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:33.618754 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:33.618721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:44.300293 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:44.300257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:44.413735 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:44.413703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:45.096169 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:45.096131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:45.197460 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:45.197419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:56.472867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:56.472800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:56.531234 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:56.531198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:56.598953 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:56.598900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:56.884738 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:56.884653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:48:56.983194 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:48:56.983162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:11.730869 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:11.730845    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 13:49:26.784200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:26.784160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:26.892193 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:26.892157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:48.795486 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:48.795439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:49.957929 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:49.957888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:52.400390 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:52.400353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:52.500397 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:52.500365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:53.867138 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:53.867100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:54.014588 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:54.014561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:54.158001 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:54.157896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:56.288200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:56.288168    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:56.494024 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:56.493983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:59.202732 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:59.202698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:49:59.304107 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:49:59.304073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:03.567623 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:03.567534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:06.813716 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:06.813677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:06.913225 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:06.913183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:08.150405 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.150372    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"]
Sep 18 13:50:08.150784 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.150630    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b895b092-1b6c-4253-8571-8d572a3f1c7c" containerName="registry"
Sep 18 13:50:08.150784 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.150642    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b895b092-1b6c-4253-8571-8d572a3f1c7c" containerName="registry"
Sep 18 13:50:08.150784 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.150723    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b895b092-1b6c-4253-8571-8d572a3f1c7c" containerName="registry"
Sep 18 13:50:08.153444 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.153428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.156510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.156480    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 18 13:50:08.157764 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.157741    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ghrlc\""
Sep 18 13:50:08.157878 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.157796    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 18 13:50:08.165217 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.165194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"]
Sep 18 13:50:08.236501 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.236471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb22m\" (UniqueName: \"kubernetes.io/projected/665f0e56-56dd-4273-bb38-642d8322b755-kube-api-access-jb22m\") pod \"openshift-lws-operator-fd8ccff4c-krgrw\" (UID: \"665f0e56-56dd-4273-bb38-642d8322b755\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.236702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.236513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665f0e56-56dd-4273-bb38-642d8322b755-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krgrw\" (UID: \"665f0e56-56dd-4273-bb38-642d8322b755\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.337423 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.337390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb22m\" (UniqueName: \"kubernetes.io/projected/665f0e56-56dd-4273-bb38-642d8322b755-kube-api-access-jb22m\") pod \"openshift-lws-operator-fd8ccff4c-krgrw\" (UID: \"665f0e56-56dd-4273-bb38-642d8322b755\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.337533 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.337445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665f0e56-56dd-4273-bb38-642d8322b755-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krgrw\" (UID: \"665f0e56-56dd-4273-bb38-642d8322b755\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.337781 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.337753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665f0e56-56dd-4273-bb38-642d8322b755-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krgrw\" (UID: \"665f0e56-56dd-4273-bb38-642d8322b755\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.347595 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.347570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb22m\" (UniqueName: \"kubernetes.io/projected/665f0e56-56dd-4273-bb38-642d8322b755-kube-api-access-jb22m\") pod \"openshift-lws-operator-fd8ccff4c-krgrw\" (UID: \"665f0e56-56dd-4273-bb38-642d8322b755\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.462018 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.461980    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"
Sep 18 13:50:08.755940 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.755865    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw"]
Sep 18 13:50:08.758081 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:50:08.758057    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod665f0e56_56dd_4273_bb38_642d8322b755.slice/crio-4843dfc2ba0f02093a8b3acadf582f25a5f752361e8bf5f941c3ee0a0d4a2dbc WatchSource:0}: Error finding container 4843dfc2ba0f02093a8b3acadf582f25a5f752361e8bf5f941c3ee0a0d4a2dbc: Status 404 returned error can't find the container with id 4843dfc2ba0f02093a8b3acadf582f25a5f752361e8bf5f941c3ee0a0d4a2dbc
Sep 18 13:50:08.759812 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:08.759788    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:50:09.349701 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:09.349665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw" event={"ID":"665f0e56-56dd-4273-bb38-642d8322b755","Type":"ContainerStarted","Data":"4843dfc2ba0f02093a8b3acadf582f25a5f752361e8bf5f941c3ee0a0d4a2dbc"}
Sep 18 13:50:16.377434 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:16.377395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw" event={"ID":"665f0e56-56dd-4273-bb38-642d8322b755","Type":"ContainerStarted","Data":"352a27dc63e0d8600974472e90d26b0969e78520d7ceaed1e7f6846947d420aa"}
Sep 18 13:50:16.398974 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:16.398636    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krgrw" podStartSLOduration=1.7262375909999998 podStartE2EDuration="8.398590249s" totalImagesPullingTime="6.672352658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:16.398075583 +0000 UTC m=+365.089947175" watchObservedRunningTime="2026-09-18 13:50:16.398590249 +0000 UTC m=+365.090461845"
Sep 18 13:50:17.101192 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:17.101155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:17.210436 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:17.210385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:18.710651 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:18.710589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:18.811563 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:18.811511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:19.150660 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:19.150526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:33.636221 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:33.636171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:33.737602 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:33.737562    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:34.247896 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.247858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:34.513879 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.513766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:34.623831 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.623791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:34.704817 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.704783    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"]
Sep 18 13:50:34.707970 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.707954    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.711189 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.711168    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 13:50:34.711381 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.711363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g9q4g\""
Sep 18 13:50:34.711735 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.711717    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 13:50:34.711956 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.711941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 13:50:34.712269 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.712255    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 13:50:34.763006 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.762971    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"]
Sep 18 13:50:34.835198 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.835093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.835198 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.835179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r97qr\" (UniqueName: \"kubernetes.io/projected/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-kube-api-access-r97qr\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.835420 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.835237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-manifests\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.835420 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.835355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-tmp\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.835420 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.835390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.893896 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.893868    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:34.936188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.936164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-tmp\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.936334 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.936199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.936334 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.936250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.936438 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.936416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r97qr\" (UniqueName: \"kubernetes.io/projected/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-kube-api-access-r97qr\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.936490 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.936478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-manifests\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.936834 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.936805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-manifests\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.938931 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.938907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.939174 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.939153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-tmp\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.939277 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.939260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.948622 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.948580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r97qr\" (UniqueName: \"kubernetes.io/projected/ae4dda9d-a5b5-4a75-9e45-746ca1a181c3-kube-api-access-r97qr\") pod \"opendatahub-operator-controller-manager-64b7fcb4fd-drz9c\" (UID: \"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3\") " pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:34.994819 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:34.994790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:35.018019 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:35.017983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:35.097469 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:35.097396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:35.196354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:35.196323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:35.259173 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:35.259138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:35.298871 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:35.298828    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"]
Sep 18 13:50:35.302170 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:50:35.302138    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4dda9d_a5b5_4a75_9e45_746ca1a181c3.slice/crio-91c12253de9626f8bba6deeef50f6b72155adc7a2a36b951ca9f8f929bdb32ff WatchSource:0}: Error finding container 91c12253de9626f8bba6deeef50f6b72155adc7a2a36b951ca9f8f929bdb32ff: Status 404 returned error can't find the container with id 91c12253de9626f8bba6deeef50f6b72155adc7a2a36b951ca9f8f929bdb32ff
Sep 18 13:50:35.338226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:35.338190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:35.449120 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:35.449088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c" event={"ID":"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3","Type":"ContainerStarted","Data":"91c12253de9626f8bba6deeef50f6b72155adc7a2a36b951ca9f8f929bdb32ff"}
Sep 18 13:50:38.462251 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:38.462215    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c" event={"ID":"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3","Type":"ContainerStarted","Data":"ce91fd026d79896e0a1c06cdcc1bc01d05a0f243e31373f5f074f8e70ce510e8"}
Sep 18 13:50:39.467567 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:39.467523    2578 generic.go:356] "Generic (PLEG): container finished" podID="ae4dda9d-a5b5-4a75-9e45-746ca1a181c3" containerID="ce91fd026d79896e0a1c06cdcc1bc01d05a0f243e31373f5f074f8e70ce510e8" exitCode=0
Sep 18 13:50:39.467986 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:39.467632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c" event={"ID":"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3","Type":"ContainerDied","Data":"ce91fd026d79896e0a1c06cdcc1bc01d05a0f243e31373f5f074f8e70ce510e8"}
Sep 18 13:50:40.474102 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:40.474069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c" event={"ID":"ae4dda9d-a5b5-4a75-9e45-746ca1a181c3","Type":"ContainerStarted","Data":"8ce452e3ea897e2a155d30aea6f0aec260028448e19374f3f1071468af3ac00a"}
Sep 18 13:50:40.474520 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:40.474222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:40.515026 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:40.514972    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c" podStartSLOduration=2.242432307 podStartE2EDuration="6.514955282s" totalImagesPullingTime="3.211914454s" totalInitContainerRuntime="1.060608521s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:40.512136609 +0000 UTC m=+389.204008203" watchObservedRunningTime="2026-09-18 13:50:40.514955282 +0000 UTC m=+389.206826877"
Sep 18 13:50:40.657443 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:40.657405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:40.763285 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:40.763200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:51.480966 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:51.480928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64b7fcb4fd-drz9c"
Sep 18 13:50:53.486619 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.486580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:53.697149 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.697111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:53.838566 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.838486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:53.982780 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.982742    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"]
Sep 18 13:50:53.989926 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.989900    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:53.993288 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.993264    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 13:50:53.993449 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.993264    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 18 13:50:53.993710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.993691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 18 13:50:53.994558 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.994539    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lcqdm\""
Sep 18 13:50:53.994701 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:53.994671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 13:50:54.006284 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.006251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"]
Sep 18 13:50:54.091313 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.091221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fb32a63-e36a-42cb-b277-cbaaa765efbe-tmp\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.091313 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.091265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbf5\" (UniqueName: \"kubernetes.io/projected/6fb32a63-e36a-42cb-b277-cbaaa765efbe-kube-api-access-7tbf5\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.091313 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.091309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fb32a63-e36a-42cb-b277-cbaaa765efbe-tls-certs\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.192283 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.192243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fb32a63-e36a-42cb-b277-cbaaa765efbe-tmp\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.192283 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.192282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbf5\" (UniqueName: \"kubernetes.io/projected/6fb32a63-e36a-42cb-b277-cbaaa765efbe-kube-api-access-7tbf5\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.192541 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.192311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fb32a63-e36a-42cb-b277-cbaaa765efbe-tls-certs\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.194844 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.194812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6fb32a63-e36a-42cb-b277-cbaaa765efbe-tmp\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.194964 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.194881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fb32a63-e36a-42cb-b277-cbaaa765efbe-tls-certs\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.212303 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.212267    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbf5\" (UniqueName: \"kubernetes.io/projected/6fb32a63-e36a-42cb-b277-cbaaa765efbe-kube-api-access-7tbf5\") pod \"kube-auth-proxy-849fd8447d-jw84c\" (UID: \"6fb32a63-e36a-42cb-b277-cbaaa765efbe\") " pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.257137 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.257100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:54.300107 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.300071    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"
Sep 18 13:50:54.582831 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:54.582774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-849fd8447d-jw84c"]
Sep 18 13:50:54.585072 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:50:54.585039    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb32a63_e36a_42cb_b277_cbaaa765efbe.slice/crio-3b69b32c0ced985d49d0c825f106c2531597d4f90455ae703d09875c99106472 WatchSource:0}: Error finding container 3b69b32c0ced985d49d0c825f106c2531597d4f90455ae703d09875c99106472: Status 404 returned error can't find the container with id 3b69b32c0ced985d49d0c825f106c2531597d4f90455ae703d09875c99106472
Sep 18 13:50:55.533498 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:55.533453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c" event={"ID":"6fb32a63-e36a-42cb-b277-cbaaa765efbe","Type":"ContainerStarted","Data":"3b69b32c0ced985d49d0c825f106c2531597d4f90455ae703d09875c99106472"}
Sep 18 13:50:55.741281 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:55.741245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:55.896783 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:55.896668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:57.088879 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:57.088840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:57.543515 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:57.543476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c" event={"ID":"6fb32a63-e36a-42cb-b277-cbaaa765efbe","Type":"ContainerStarted","Data":"9e7e3a829e9afa26b58b7d79503f4097160999ed72d459993a1628c056bfcd17"}
Sep 18 13:50:57.562976 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:57.562912    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-849fd8447d-jw84c" podStartSLOduration=1.854665213 podStartE2EDuration="4.562893383s" totalImagesPullingTime="2.70822817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:50:57.561677381 +0000 UTC m=+406.253548976" watchObservedRunningTime="2026-09-18 13:50:57.562893383 +0000 UTC m=+406.254764978"
Sep 18 13:50:59.600714 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:59.600678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:59.668469 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:59.668421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:50:59.739584 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:50:59.739544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:00.037071 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.037036    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:00.131372 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.131339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:00.361854 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.361756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:00.463553 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.463514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:00.797164 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.797132    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"]
Sep 18 13:51:00.799275 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.799252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.802140 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.802111    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pw265\""
Sep 18 13:51:00.802140 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.802111    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 13:51:00.815482 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.815443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"]
Sep 18 13:51:00.824931 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.824907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:00.949288 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949288 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70fdf34-3709-460c-9560-831da7dd8618-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqjg4\" (UniqueName: \"kubernetes.io/projected/d70fdf34-3709-460c-9560-831da7dd8618-kube-api-access-tqjg4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70fdf34-3709-460c-9560-831da7dd8618-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70fdf34-3709-460c-9560-831da7dd8618-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:00.949489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:00.949466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050409 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050409 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050409 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70fdf34-3709-460c-9560-831da7dd8618-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqjg4\" (UniqueName: \"kubernetes.io/projected/d70fdf34-3709-460c-9560-831da7dd8618-kube-api-access-tqjg4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70fdf34-3709-460c-9560-831da7dd8618-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.050702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70fdf34-3709-460c-9560-831da7dd8618-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.051134 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.051134 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.051134 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.050932    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.051134 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.051126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.051528 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.051507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70fdf34-3709-460c-9560-831da7dd8618-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.052969 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.052946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70fdf34-3709-460c-9560-831da7dd8618-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.053237 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.053218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70fdf34-3709-460c-9560-831da7dd8618-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.061357 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.061310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70fdf34-3709-460c-9560-831da7dd8618-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.061488 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.061438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqjg4\" (UniqueName: \"kubernetes.io/projected/d70fdf34-3709-460c-9560-831da7dd8618-kube-api-access-tqjg4\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6\" (UID: \"d70fdf34-3709-460c-9560-831da7dd8618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.062076 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.062048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:01.109957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.109915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:01.321427 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.321343    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:01.385793 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.385752    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"]
Sep 18 13:51:01.390024 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:51:01.389999    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70fdf34_3709_460c_9560_831da7dd8618.slice/crio-ad4f5d716e30f3a7b69d50bfc9e2ba7bb830f6aa20e90c374484b88829037428 WatchSource:0}: Error finding container ad4f5d716e30f3a7b69d50bfc9e2ba7bb830f6aa20e90c374484b88829037428: Status 404 returned error can't find the container with id ad4f5d716e30f3a7b69d50bfc9e2ba7bb830f6aa20e90c374484b88829037428
Sep 18 13:51:01.564539 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:01.564504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6" event={"ID":"d70fdf34-3709-460c-9560-831da7dd8618","Type":"ContainerStarted","Data":"ad4f5d716e30f3a7b69d50bfc9e2ba7bb830f6aa20e90c374484b88829037428"}
Sep 18 13:51:04.724170 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:04.724131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:04.827072 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:04.826994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:04.924225 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:04.924192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:05.219548 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.219517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:05.257520 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.257475    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5klnx"]
Sep 18 13:51:05.261477 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.261453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:05.264319 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.264292    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 18 13:51:05.271395 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.271317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5klnx"]
Sep 18 13:51:05.293998 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.293965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:05.385324 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.385281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d77a8b92-6a16-4f5f-9027-1c8187486761-tls-certs\") pod \"model-serving-api-54d89bd5fc-5klnx\" (UID: \"d77a8b92-6a16-4f5f-9027-1c8187486761\") " pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:05.385518 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.385335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kdlz\" (UniqueName: \"kubernetes.io/projected/d77a8b92-6a16-4f5f-9027-1c8187486761-kube-api-access-9kdlz\") pod \"model-serving-api-54d89bd5fc-5klnx\" (UID: \"d77a8b92-6a16-4f5f-9027-1c8187486761\") " pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:05.485864 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.485771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kdlz\" (UniqueName: \"kubernetes.io/projected/d77a8b92-6a16-4f5f-9027-1c8187486761-kube-api-access-9kdlz\") pod \"model-serving-api-54d89bd5fc-5klnx\" (UID: \"d77a8b92-6a16-4f5f-9027-1c8187486761\") " pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:05.486046 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.485881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d77a8b92-6a16-4f5f-9027-1c8187486761-tls-certs\") pod \"model-serving-api-54d89bd5fc-5klnx\" (UID: \"d77a8b92-6a16-4f5f-9027-1c8187486761\") " pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:05.486046 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:51:05.486003    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 18 13:51:05.486154 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:51:05.486068    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d77a8b92-6a16-4f5f-9027-1c8187486761-tls-certs podName:d77a8b92-6a16-4f5f-9027-1c8187486761 nodeName:}" failed. No retries permitted until 2026-09-18 13:51:05.986051511 +0000 UTC m=+414.677923083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d77a8b92-6a16-4f5f-9027-1c8187486761-tls-certs") pod "model-serving-api-54d89bd5fc-5klnx" (UID: "d77a8b92-6a16-4f5f-9027-1c8187486761") : secret "model-serving-api-tls" not found
Sep 18 13:51:05.495733 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.495709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kdlz\" (UniqueName: \"kubernetes.io/projected/d77a8b92-6a16-4f5f-9027-1c8187486761-kube-api-access-9kdlz\") pod \"model-serving-api-54d89bd5fc-5klnx\" (UID: \"d77a8b92-6a16-4f5f-9027-1c8187486761\") " pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:05.596844 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.596812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:05.991067 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.991022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d77a8b92-6a16-4f5f-9027-1c8187486761-tls-certs\") pod \"model-serving-api-54d89bd5fc-5klnx\" (UID: \"d77a8b92-6a16-4f5f-9027-1c8187486761\") " pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:05.994424 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:05.994383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d77a8b92-6a16-4f5f-9027-1c8187486761-tls-certs\") pod \"model-serving-api-54d89bd5fc-5klnx\" (UID: \"d77a8b92-6a16-4f5f-9027-1c8187486761\") " pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:06.175418 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.175376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:06.218294 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.218236    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:51:06.218415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.218355    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:51:06.218415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.218396    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:51:06.453771 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.453734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5klnx"]
Sep 18 13:51:06.458125 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:51:06.458100    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77a8b92_6a16_4f5f_9027_1c8187486761.slice/crio-72bafe4a4b9ceb6ca1ccc46c8f1cb4dd3c8cbff720e05421bcce5ad2ffa7e96c WatchSource:0}: Error finding container 72bafe4a4b9ceb6ca1ccc46c8f1cb4dd3c8cbff720e05421bcce5ad2ffa7e96c: Status 404 returned error can't find the container with id 72bafe4a4b9ceb6ca1ccc46c8f1cb4dd3c8cbff720e05421bcce5ad2ffa7e96c
Sep 18 13:51:06.591674 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.591577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5klnx" event={"ID":"d77a8b92-6a16-4f5f-9027-1c8187486761","Type":"ContainerStarted","Data":"72bafe4a4b9ceb6ca1ccc46c8f1cb4dd3c8cbff720e05421bcce5ad2ffa7e96c"}
Sep 18 13:51:06.593207 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.593182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6" event={"ID":"d70fdf34-3709-460c-9560-831da7dd8618","Type":"ContainerStarted","Data":"fd1ff23e2e52eed2fd51d459c436a422002bd1583f085f2a09c3b725a76a9f88"}
Sep 18 13:51:06.614643 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:06.614574    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6" podStartSLOduration=1.788670389 podStartE2EDuration="6.614561228s" totalImagesPullingTime="4.825890839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:06.613680859 +0000 UTC m=+415.305552453" watchObservedRunningTime="2026-09-18 13:51:06.614561228 +0000 UTC m=+415.306432823"
Sep 18 13:51:07.110968 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:07.110930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:07.116477 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:07.116450    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:07.597591 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:07.597556    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:07.598724 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:07.598703    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6"
Sep 18 13:51:08.602957 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:08.602921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5klnx" event={"ID":"d77a8b92-6a16-4f5f-9027-1c8187486761","Type":"ContainerStarted","Data":"74966c251b8937f6e34570b4301b8731565b8e85a935eba98b0291c88f2c2c6b"}
Sep 18 13:51:08.603411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:08.603275    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:08.622817 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:08.622756    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5klnx" podStartSLOduration=2.096603903 podStartE2EDuration="3.622739402s" totalImagesPullingTime="1.526135499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:08.622012384 +0000 UTC m=+417.313883979" watchObservedRunningTime="2026-09-18 13:51:08.622739402 +0000 UTC m=+417.314610998"
Sep 18 13:51:10.567363 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.567326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:10.604758 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.604726    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"]
Sep 18 13:51:10.606819 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.606797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.610989 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.610964    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 18 13:51:10.610989 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.610979    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-44st8\""
Sep 18 13:51:10.611193 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.611127    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 18 13:51:10.611193 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.611157    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 18 13:51:10.618717 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.618692    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"]
Sep 18 13:51:10.640839 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.640809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:10.734955 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.734919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6870b75d-48cf-470d-acaa-8f1d6e2c6579-metrics-cert\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.735119 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.734979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6870b75d-48cf-470d-acaa-8f1d6e2c6579-manager-config\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.735119 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.735019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj6mq\" (UniqueName: \"kubernetes.io/projected/6870b75d-48cf-470d-acaa-8f1d6e2c6579-kube-api-access-cj6mq\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.735119 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.735046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6870b75d-48cf-470d-acaa-8f1d6e2c6579-cert\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.833279 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.833177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:10.836289 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.836269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6870b75d-48cf-470d-acaa-8f1d6e2c6579-manager-config\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.836361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.836299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj6mq\" (UniqueName: \"kubernetes.io/projected/6870b75d-48cf-470d-acaa-8f1d6e2c6579-kube-api-access-cj6mq\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.836361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.836323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6870b75d-48cf-470d-acaa-8f1d6e2c6579-cert\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.836463 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.836362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6870b75d-48cf-470d-acaa-8f1d6e2c6579-metrics-cert\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.837010 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.836985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6870b75d-48cf-470d-acaa-8f1d6e2c6579-manager-config\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.839081 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.839064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6870b75d-48cf-470d-acaa-8f1d6e2c6579-metrics-cert\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.839270 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.839251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6870b75d-48cf-470d-acaa-8f1d6e2c6579-cert\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.850645 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.850623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj6mq\" (UniqueName: \"kubernetes.io/projected/6870b75d-48cf-470d-acaa-8f1d6e2c6579-kube-api-access-cj6mq\") pod \"lws-controller-manager-5f877cc68b-lh5bn\" (UID: \"6870b75d-48cf-470d-acaa-8f1d6e2c6579\") " pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.916241 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.916207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:10.954209 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:10.954122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:11.189075 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:11.188926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"]
Sep 18 13:51:11.191578 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:51:11.191546    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6870b75d_48cf_470d_acaa_8f1d6e2c6579.slice/crio-d05832e6eb727024c02648ef678c827befb4216e3f8cb304d51bb6717edd3dd1 WatchSource:0}: Error finding container d05832e6eb727024c02648ef678c827befb4216e3f8cb304d51bb6717edd3dd1: Status 404 returned error can't find the container with id d05832e6eb727024c02648ef678c827befb4216e3f8cb304d51bb6717edd3dd1
Sep 18 13:51:11.616757 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:11.616671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn" event={"ID":"6870b75d-48cf-470d-acaa-8f1d6e2c6579","Type":"ContainerStarted","Data":"d05832e6eb727024c02648ef678c827befb4216e3f8cb304d51bb6717edd3dd1"}
Sep 18 13:51:13.627452 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:13.627415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn" event={"ID":"6870b75d-48cf-470d-acaa-8f1d6e2c6579","Type":"ContainerStarted","Data":"2811af8fe264c33598bc90567f28ca2b45d5314d896e29d6a9b62198873ea504"}
Sep 18 13:51:13.627923 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:13.627526    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:13.649548 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:13.649496    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn" podStartSLOduration=1.92519031 podStartE2EDuration="3.649479244s" totalImagesPullingTime="1.724288934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:51:13.646965454 +0000 UTC m=+422.338837048" watchObservedRunningTime="2026-09-18 13:51:13.649479244 +0000 UTC m=+422.341350840"
Sep 18 13:51:15.582589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:15.582557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:15.702893 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:15.702861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:15.836044 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:15.835954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:16.031339 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:16.031306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:16.904974 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:16.904939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:17.005124 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:17.005091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:19.611322 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:19.611292    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5klnx"
Sep 18 13:51:23.213952 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:23.213922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:23.303120 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:23.303086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:24.634076 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:24.634044    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f877cc68b-lh5bn"
Sep 18 13:51:25.214090 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:25.214054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:51:25.308453 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:51:25.308415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:05.627825 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:05.627788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:05.725337 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:05.725298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:17.259846 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:17.259810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:17.339188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:17.339154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:18.453028 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:18.452992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:19.266198 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:19.266166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:20.066405 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:20.066374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:22.337639 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:22.337590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:23.272475 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:23.272438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:23.749905 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:23.749870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:23.946145 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:23.946105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:26.283677 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:26.283644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:26.392400 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:26.392372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:28.468180 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:28.468131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:28.700802 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:28.700772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:30.876255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:30.876217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:31.177354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:31.177274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:33.497561 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:33.497525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:33.599311 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:33.599274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:33.865388 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:33.865307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:33.944925 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:33.944888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:34.263325 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:34.263293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:34.339374 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:34.339339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:42.162454 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:42.162419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:42.260975 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:42.260939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:42.357084 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:42.357050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:44.992776 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:44.992739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:45.088701 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:45.088668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:45.214152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:45.214121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:47.566196 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:47.566163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:47.669972 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:47.669932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:54.499486 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:54.499439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:54.598485 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:54.598453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:54.883809 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:54.883722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:54.983486 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:54.983446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:55.086791 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:55.086748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:55.187773 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:55.187747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:52:55.810597 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:52:55.810557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:03.900175 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:03.900095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:04.001098 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:04.001057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:06.894520 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:06.894481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:06.992891 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:06.992858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:09.352804 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:09.352770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:09.453383 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:09.453346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:13.877188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:13.877152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:14.387930 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:14.387899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:19.147201 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.147167    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:19.284530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.284498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:19.384975 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.384945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:19.955178 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.955140    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-8lpb6"]
Sep 18 13:53:19.958300 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.958278    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6"
Sep 18 13:53:19.961199 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.961175    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 13:53:19.962271 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.962250    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-87ggk\""
Sep 18 13:53:19.962362 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.962254    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 13:53:19.968183 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:19.968164    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-8lpb6"]
Sep 18 13:53:20.008742 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:20.008715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:20.065890 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:20.065859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwjd\" (UniqueName: \"kubernetes.io/projected/51d148c0-e583-4c4e-8d16-ac220f3be74d-kube-api-access-2nwjd\") pod \"authorino-7bcfd8f9cd-8lpb6\" (UID: \"51d148c0-e583-4c4e-8d16-ac220f3be74d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6"
Sep 18 13:53:20.093223 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:20.093200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:20.166756 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:20.166726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwjd\" (UniqueName: \"kubernetes.io/projected/51d148c0-e583-4c4e-8d16-ac220f3be74d-kube-api-access-2nwjd\") pod \"authorino-7bcfd8f9cd-8lpb6\" (UID: \"51d148c0-e583-4c4e-8d16-ac220f3be74d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6"
Sep 18 13:53:20.175513 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:20.175489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwjd\" (UniqueName: \"kubernetes.io/projected/51d148c0-e583-4c4e-8d16-ac220f3be74d-kube-api-access-2nwjd\") pod \"authorino-7bcfd8f9cd-8lpb6\" (UID: \"51d148c0-e583-4c4e-8d16-ac220f3be74d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6"
Sep 18 13:53:20.267684 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:20.267554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6"
Sep 18 13:53:20.540822 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:20.540602    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-8lpb6"]
Sep 18 13:53:20.543680 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:53:20.543653    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51d148c0_e583_4c4e_8d16_ac220f3be74d.slice/crio-263c32681f1bf339e49efa3677702badd016186e35ecc17d794d1504934f0f17 WatchSource:0}: Error finding container 263c32681f1bf339e49efa3677702badd016186e35ecc17d794d1504934f0f17: Status 404 returned error can't find the container with id 263c32681f1bf339e49efa3677702badd016186e35ecc17d794d1504934f0f17
Sep 18 13:53:21.159770 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:21.159729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6" event={"ID":"51d148c0-e583-4c4e-8d16-ac220f3be74d","Type":"ContainerStarted","Data":"263c32681f1bf339e49efa3677702badd016186e35ecc17d794d1504934f0f17"}
Sep 18 13:53:22.694746 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:22.694705    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-8lpb6"]
Sep 18 13:53:23.169389 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:23.169303    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6" event={"ID":"51d148c0-e583-4c4e-8d16-ac220f3be74d","Type":"ContainerStarted","Data":"429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc"}
Sep 18 13:53:23.169557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:23.169381    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6" podUID="51d148c0-e583-4c4e-8d16-ac220f3be74d" containerName="authorino" containerID="cri-o://429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc" gracePeriod=30
Sep 18 13:53:23.186344 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:23.186300    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6" podStartSLOduration=1.9491568959999999 podStartE2EDuration="4.186283449s" totalImagesPullingTime="2.237126553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:23.184104608 +0000 UTC m=+551.875976202" watchObservedRunningTime="2026-09-18 13:53:23.186283449 +0000 UTC m=+551.878155044"
Sep 18 13:53:23.413331 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:23.413302    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6"
Sep 18 13:53:23.498923 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:23.498882    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nwjd\" (UniqueName: \"kubernetes.io/projected/51d148c0-e583-4c4e-8d16-ac220f3be74d-kube-api-access-2nwjd\") pod \"51d148c0-e583-4c4e-8d16-ac220f3be74d\" (UID: \"51d148c0-e583-4c4e-8d16-ac220f3be74d\") "
Sep 18 13:53:23.501182 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:23.501147    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d148c0-e583-4c4e-8d16-ac220f3be74d-kube-api-access-2nwjd" (OuterVolumeSpecName: "kube-api-access-2nwjd") pod "51d148c0-e583-4c4e-8d16-ac220f3be74d" (UID: "51d148c0-e583-4c4e-8d16-ac220f3be74d"). InnerVolumeSpecName "kube-api-access-2nwjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:53:23.600035 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:23.599998    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nwjd\" (UniqueName: \"kubernetes.io/projected/51d148c0-e583-4c4e-8d16-ac220f3be74d-kube-api-access-2nwjd\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:53:24.175116 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.175015    2578 generic.go:356] "Generic (PLEG): container finished" podID="51d148c0-e583-4c4e-8d16-ac220f3be74d" containerID="429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc" exitCode=0
Sep 18 13:53:24.175116 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.175063    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6" event={"ID":"51d148c0-e583-4c4e-8d16-ac220f3be74d","Type":"ContainerDied","Data":"429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc"}
Sep 18 13:53:24.175116 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.175095    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6"
Sep 18 13:53:24.175116 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.175110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-8lpb6" event={"ID":"51d148c0-e583-4c4e-8d16-ac220f3be74d","Type":"ContainerDied","Data":"263c32681f1bf339e49efa3677702badd016186e35ecc17d794d1504934f0f17"}
Sep 18 13:53:24.175766 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.175127    2578 scope.go:117] "RemoveContainer" containerID="429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc"
Sep 18 13:53:24.183282 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.183267    2578 scope.go:117] "RemoveContainer" containerID="429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc"
Sep 18 13:53:24.183553 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:53:24.183530    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc\": container with ID starting with 429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc not found: ID does not exist" containerID="429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc"
Sep 18 13:53:24.183631 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.183568    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc"} err="failed to get container status \"429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc\": rpc error: code = NotFound desc = could not find container \"429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc\": container with ID starting with 429d02ed6be7361af4a0b566d8ce6036fb6c033f2dbec70cfebb706b48dedcfc not found: ID does not exist"
Sep 18 13:53:24.191345 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.191325    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-8lpb6"]
Sep 18 13:53:24.195317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:24.195298    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-8lpb6"]
Sep 18 13:53:25.850113 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:25.850077    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d148c0-e583-4c4e-8d16-ac220f3be74d" path="/var/lib/kubelet/pods/51d148c0-e583-4c4e-8d16-ac220f3be74d/volumes"
Sep 18 13:53:35.138672 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:35.138634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:35.238336 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:35.238289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:35.668814 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:35.668767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:47.574767 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.574727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:47.798735 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.798696    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-wvspd"]
Sep 18 13:53:47.799025 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.799011    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d148c0-e583-4c4e-8d16-ac220f3be74d" containerName="authorino"
Sep 18 13:53:47.799092 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.799030    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d148c0-e583-4c4e-8d16-ac220f3be74d" containerName="authorino"
Sep 18 13:53:47.799092 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.799084    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d148c0-e583-4c4e-8d16-ac220f3be74d" containerName="authorino"
Sep 18 13:53:47.801895 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.801879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wvspd"
Sep 18 13:53:47.805089 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.805067    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-87ggk\""
Sep 18 13:53:47.805215 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.805070    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 13:53:47.805852 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.805833    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 13:53:47.808320 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.808299    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-wvspd"]
Sep 18 13:53:47.883085 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.883010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k25pr\" (UniqueName: \"kubernetes.io/projected/9aaf5265-4152-447f-91b7-0e23b0f6dd98-kube-api-access-k25pr\") pod \"authorino-557f876f69-wvspd\" (UID: \"9aaf5265-4152-447f-91b7-0e23b0f6dd98\") " pod="kuadrant-system/authorino-557f876f69-wvspd"
Sep 18 13:53:47.983403 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.983371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k25pr\" (UniqueName: \"kubernetes.io/projected/9aaf5265-4152-447f-91b7-0e23b0f6dd98-kube-api-access-k25pr\") pod \"authorino-557f876f69-wvspd\" (UID: \"9aaf5265-4152-447f-91b7-0e23b0f6dd98\") " pod="kuadrant-system/authorino-557f876f69-wvspd"
Sep 18 13:53:47.992585 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:47.992561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k25pr\" (UniqueName: \"kubernetes.io/projected/9aaf5265-4152-447f-91b7-0e23b0f6dd98-kube-api-access-k25pr\") pod \"authorino-557f876f69-wvspd\" (UID: \"9aaf5265-4152-447f-91b7-0e23b0f6dd98\") " pod="kuadrant-system/authorino-557f876f69-wvspd"
Sep 18 13:53:48.033274 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.033245    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-wvspd"]
Sep 18 13:53:48.033493 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.033481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wvspd"
Sep 18 13:53:48.064305 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.064267    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bd79845d7-bhtgt"]
Sep 18 13:53:48.068156 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.068138    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd79845d7-bhtgt"
Sep 18 13:53:48.075124 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.075093    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bd79845d7-bhtgt"]
Sep 18 13:53:48.084465 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.084437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd5xp\" (UniqueName: \"kubernetes.io/projected/a0f0d36c-8a99-4007-8495-c4306b8ca0e8-kube-api-access-bd5xp\") pod \"authorino-7bd79845d7-bhtgt\" (UID: \"a0f0d36c-8a99-4007-8495-c4306b8ca0e8\") " pod="kuadrant-system/authorino-7bd79845d7-bhtgt"
Sep 18 13:53:48.184921 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.184890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd5xp\" (UniqueName: \"kubernetes.io/projected/a0f0d36c-8a99-4007-8495-c4306b8ca0e8-kube-api-access-bd5xp\") pod \"authorino-7bd79845d7-bhtgt\" (UID: \"a0f0d36c-8a99-4007-8495-c4306b8ca0e8\") " pod="kuadrant-system/authorino-7bd79845d7-bhtgt"
Sep 18 13:53:48.195089 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.195060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd5xp\" (UniqueName: \"kubernetes.io/projected/a0f0d36c-8a99-4007-8495-c4306b8ca0e8-kube-api-access-bd5xp\") pod \"authorino-7bd79845d7-bhtgt\" (UID: \"a0f0d36c-8a99-4007-8495-c4306b8ca0e8\") " pod="kuadrant-system/authorino-7bd79845d7-bhtgt"
Sep 18 13:53:48.309088 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.309056    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-wvspd"]
Sep 18 13:53:48.312239 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:53:48.312209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aaf5265_4152_447f_91b7_0e23b0f6dd98.slice/crio-5f44d3909d7731ff38ea4bdebb5d68012941b3f0f2686eee2a703e11722bbad1 WatchSource:0}: Error finding container 5f44d3909d7731ff38ea4bdebb5d68012941b3f0f2686eee2a703e11722bbad1: Status 404 returned error can't find the container with id 5f44d3909d7731ff38ea4bdebb5d68012941b3f0f2686eee2a703e11722bbad1
Sep 18 13:53:48.381139 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.381105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd79845d7-bhtgt"
Sep 18 13:53:48.592787 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.592693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:48.653899 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:48.653765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bd79845d7-bhtgt"]
Sep 18 13:53:48.656429 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:53:48.656399    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0f0d36c_8a99_4007_8495_c4306b8ca0e8.slice/crio-f8101201e8e2d65be01a4f9f9d6146eec6b4d249c574e894cd7f20a7b8d3ee04 WatchSource:0}: Error finding container f8101201e8e2d65be01a4f9f9d6146eec6b4d249c574e894cd7f20a7b8d3ee04: Status 404 returned error can't find the container with id f8101201e8e2d65be01a4f9f9d6146eec6b4d249c574e894cd7f20a7b8d3ee04
Sep 18 13:53:49.290227 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.289913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd79845d7-bhtgt" event={"ID":"a0f0d36c-8a99-4007-8495-c4306b8ca0e8","Type":"ContainerStarted","Data":"2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0"}
Sep 18 13:53:49.290227 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.289963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd79845d7-bhtgt" event={"ID":"a0f0d36c-8a99-4007-8495-c4306b8ca0e8","Type":"ContainerStarted","Data":"f8101201e8e2d65be01a4f9f9d6146eec6b4d249c574e894cd7f20a7b8d3ee04"}
Sep 18 13:53:49.291948 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.291833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-wvspd" event={"ID":"9aaf5265-4152-447f-91b7-0e23b0f6dd98","Type":"ContainerStarted","Data":"955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae"}
Sep 18 13:53:49.291948 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.291877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-wvspd" event={"ID":"9aaf5265-4152-447f-91b7-0e23b0f6dd98","Type":"ContainerStarted","Data":"5f44d3909d7731ff38ea4bdebb5d68012941b3f0f2686eee2a703e11722bbad1"}
Sep 18 13:53:49.291948 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.291872    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-wvspd" podUID="9aaf5265-4152-447f-91b7-0e23b0f6dd98" containerName="authorino" containerID="cri-o://955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae" gracePeriod=30
Sep 18 13:53:49.309305 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.309247    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bd79845d7-bhtgt" podStartSLOduration=0.740085778 podStartE2EDuration="1.30922716s" totalImagesPullingTime="569.141382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:49.30832018 +0000 UTC m=+578.000191775" watchObservedRunningTime="2026-09-18 13:53:49.30922716 +0000 UTC m=+578.001098754"
Sep 18 13:53:49.329122 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.329064    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-wvspd" podStartSLOduration=1.450089346 podStartE2EDuration="2.329043085s" totalImagesPullingTime="878.953739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:49.326500936 +0000 UTC m=+578.018372532" watchObservedRunningTime="2026-09-18 13:53:49.329043085 +0000 UTC m=+578.020914681"
Sep 18 13:53:49.457446 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.457417    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-667576b6d5-vzdnn"]
Sep 18 13:53:49.468083 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.468048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:49.469702 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.469676    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667576b6d5-vzdnn"]
Sep 18 13:53:49.471351 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.471324    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 18 13:53:49.494706 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.494664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdhwb\" (UniqueName: \"kubernetes.io/projected/9f7725c7-250e-405f-b4a6-bc4c8ffade46-kube-api-access-mdhwb\") pod \"authorino-667576b6d5-vzdnn\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") " pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:49.494706 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.494713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7725c7-250e-405f-b4a6-bc4c8ffade46-tls-cert\") pod \"authorino-667576b6d5-vzdnn\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") " pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:49.536046 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.536020    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wvspd"
Sep 18 13:53:49.595533 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.595502    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k25pr\" (UniqueName: \"kubernetes.io/projected/9aaf5265-4152-447f-91b7-0e23b0f6dd98-kube-api-access-k25pr\") pod \"9aaf5265-4152-447f-91b7-0e23b0f6dd98\" (UID: \"9aaf5265-4152-447f-91b7-0e23b0f6dd98\") "
Sep 18 13:53:49.595889 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.595682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdhwb\" (UniqueName: \"kubernetes.io/projected/9f7725c7-250e-405f-b4a6-bc4c8ffade46-kube-api-access-mdhwb\") pod \"authorino-667576b6d5-vzdnn\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") " pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:49.595889 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.595712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7725c7-250e-405f-b4a6-bc4c8ffade46-tls-cert\") pod \"authorino-667576b6d5-vzdnn\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") " pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:49.597700 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.597667    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aaf5265-4152-447f-91b7-0e23b0f6dd98-kube-api-access-k25pr" (OuterVolumeSpecName: "kube-api-access-k25pr") pod "9aaf5265-4152-447f-91b7-0e23b0f6dd98" (UID: "9aaf5265-4152-447f-91b7-0e23b0f6dd98"). InnerVolumeSpecName "kube-api-access-k25pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:53:49.598052 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.598036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7725c7-250e-405f-b4a6-bc4c8ffade46-tls-cert\") pod \"authorino-667576b6d5-vzdnn\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") " pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:49.609006 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.608985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdhwb\" (UniqueName: \"kubernetes.io/projected/9f7725c7-250e-405f-b4a6-bc4c8ffade46-kube-api-access-mdhwb\") pod \"authorino-667576b6d5-vzdnn\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") " pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:49.696474 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.696431    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k25pr\" (UniqueName: \"kubernetes.io/projected/9aaf5265-4152-447f-91b7-0e23b0f6dd98-kube-api-access-k25pr\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:53:49.779110 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:49.779029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:53:50.050801 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.050736    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667576b6d5-vzdnn"]
Sep 18 13:53:50.053864 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:53:50.053840    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7725c7_250e_405f_b4a6_bc4c8ffade46.slice/crio-f2aaf82d518ea424d1c65ef8431b5b3b7901ab6c847ef12fe81cd6a2a20a0ba4 WatchSource:0}: Error finding container f2aaf82d518ea424d1c65ef8431b5b3b7901ab6c847ef12fe81cd6a2a20a0ba4: Status 404 returned error can't find the container with id f2aaf82d518ea424d1c65ef8431b5b3b7901ab6c847ef12fe81cd6a2a20a0ba4
Sep 18 13:53:50.297557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.297519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667576b6d5-vzdnn" event={"ID":"9f7725c7-250e-405f-b4a6-bc4c8ffade46","Type":"ContainerStarted","Data":"f2aaf82d518ea424d1c65ef8431b5b3b7901ab6c847ef12fe81cd6a2a20a0ba4"}
Sep 18 13:53:50.298720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.298692    2578 generic.go:356] "Generic (PLEG): container finished" podID="9aaf5265-4152-447f-91b7-0e23b0f6dd98" containerID="955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae" exitCode=0
Sep 18 13:53:50.298859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.298741    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wvspd"
Sep 18 13:53:50.298859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.298776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-wvspd" event={"ID":"9aaf5265-4152-447f-91b7-0e23b0f6dd98","Type":"ContainerDied","Data":"955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae"}
Sep 18 13:53:50.298859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.298815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-wvspd" event={"ID":"9aaf5265-4152-447f-91b7-0e23b0f6dd98","Type":"ContainerDied","Data":"5f44d3909d7731ff38ea4bdebb5d68012941b3f0f2686eee2a703e11722bbad1"}
Sep 18 13:53:50.298859 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.298832    2578 scope.go:117] "RemoveContainer" containerID="955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae"
Sep 18 13:53:50.306761 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.306743    2578 scope.go:117] "RemoveContainer" containerID="955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae"
Sep 18 13:53:50.307017 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:53:50.306999    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae\": container with ID starting with 955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae not found: ID does not exist" containerID="955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae"
Sep 18 13:53:50.307068 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.307025    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae"} err="failed to get container status \"955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae\": rpc error: code = NotFound desc = could not find container \"955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae\": container with ID starting with 955fd467304054768227dcc8739a6d103747f8a683f217212e2c5cbc598b27ae not found: ID does not exist"
Sep 18 13:53:50.319162 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.319141    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-wvspd"]
Sep 18 13:53:50.323206 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:50.323186    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-wvspd"]
Sep 18 13:53:51.305005 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.304967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667576b6d5-vzdnn" event={"ID":"9f7725c7-250e-405f-b4a6-bc4c8ffade46","Type":"ContainerStarted","Data":"0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6"}
Sep 18 13:53:51.323372 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.323328    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-667576b6d5-vzdnn" podStartSLOduration=1.932300393 podStartE2EDuration="2.323311326s" totalImagesPullingTime="391.010933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:53:51.321843976 +0000 UTC m=+580.013715571" watchObservedRunningTime="2026-09-18 13:53:51.323311326 +0000 UTC m=+580.015182922"
Sep 18 13:53:51.349964 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.349935    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bd79845d7-bhtgt"]
Sep 18 13:53:51.350118 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.350090    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bd79845d7-bhtgt" podUID="a0f0d36c-8a99-4007-8495-c4306b8ca0e8" containerName="authorino" containerID="cri-o://2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0" gracePeriod=30
Sep 18 13:53:51.596377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.596346    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd79845d7-bhtgt"
Sep 18 13:53:51.611465 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.611431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd5xp\" (UniqueName: \"kubernetes.io/projected/a0f0d36c-8a99-4007-8495-c4306b8ca0e8-kube-api-access-bd5xp\") pod \"a0f0d36c-8a99-4007-8495-c4306b8ca0e8\" (UID: \"a0f0d36c-8a99-4007-8495-c4306b8ca0e8\") "
Sep 18 13:53:51.614000 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.613973    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f0d36c-8a99-4007-8495-c4306b8ca0e8-kube-api-access-bd5xp" (OuterVolumeSpecName: "kube-api-access-bd5xp") pod "a0f0d36c-8a99-4007-8495-c4306b8ca0e8" (UID: "a0f0d36c-8a99-4007-8495-c4306b8ca0e8"). InnerVolumeSpecName "kube-api-access-bd5xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:53:51.712277 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.712243    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd5xp\" (UniqueName: \"kubernetes.io/projected/a0f0d36c-8a99-4007-8495-c4306b8ca0e8-kube-api-access-bd5xp\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:53:51.850416 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:51.850333    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aaf5265-4152-447f-91b7-0e23b0f6dd98" path="/var/lib/kubelet/pods/9aaf5265-4152-447f-91b7-0e23b0f6dd98/volumes"
Sep 18 13:53:52.311038 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.311001    2578 generic.go:356] "Generic (PLEG): container finished" podID="a0f0d36c-8a99-4007-8495-c4306b8ca0e8" containerID="2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0" exitCode=0
Sep 18 13:53:52.311510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.311060    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd79845d7-bhtgt"
Sep 18 13:53:52.311510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.311085    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd79845d7-bhtgt" event={"ID":"a0f0d36c-8a99-4007-8495-c4306b8ca0e8","Type":"ContainerDied","Data":"2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0"}
Sep 18 13:53:52.311510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.311136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd79845d7-bhtgt" event={"ID":"a0f0d36c-8a99-4007-8495-c4306b8ca0e8","Type":"ContainerDied","Data":"f8101201e8e2d65be01a4f9f9d6146eec6b4d249c574e894cd7f20a7b8d3ee04"}
Sep 18 13:53:52.311510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.311156    2578 scope.go:117] "RemoveContainer" containerID="2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0"
Sep 18 13:53:52.321528 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.321507    2578 scope.go:117] "RemoveContainer" containerID="2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0"
Sep 18 13:53:52.321809 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:53:52.321792    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0\": container with ID starting with 2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0 not found: ID does not exist" containerID="2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0"
Sep 18 13:53:52.321852 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.321817    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0"} err="failed to get container status \"2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0\": rpc error: code = NotFound desc = could not find container \"2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0\": container with ID starting with 2937c684085b16b331ff25704fd02936e6fefcb4d31a1cbdc5e4e4267b68d7f0 not found: ID does not exist"
Sep 18 13:53:52.329394 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.329372    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bd79845d7-bhtgt"]
Sep 18 13:53:52.336503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:52.336482    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bd79845d7-bhtgt"]
Sep 18 13:53:53.850269 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:53.850235    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0f0d36c-8a99-4007-8495-c4306b8ca0e8" path="/var/lib/kubelet/pods/a0f0d36c-8a99-4007-8495-c4306b8ca0e8/volumes"
Sep 18 13:53:54.005724 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:54.005683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:54.104278 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:54.104208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:54.180155 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:54.180124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:54.574715 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:54.574678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:57.911217 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:57.911183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:53:58.038457 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:53:58.038415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:17.930662 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:17.930624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:28.325710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:28.325675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:28.427989 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:28.427941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:29.798694 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:29.798661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:29.902315 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:29.902263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:30.041093 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:30.041039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:30.109716 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:30.109598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:30.441864 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:30.441811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:30.544087 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:30.544050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:41.023722 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:41.023585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:41.120504 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:41.120466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:43.813801 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:43.813768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:54:51.896708 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:54:51.896678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:03.209877 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:03.209841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:14.770715 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.770653    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"]
Sep 18 13:55:14.771073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.770974    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aaf5265-4152-447f-91b7-0e23b0f6dd98" containerName="authorino"
Sep 18 13:55:14.771073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.770984    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aaf5265-4152-447f-91b7-0e23b0f6dd98" containerName="authorino"
Sep 18 13:55:14.771073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.770994    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f0d36c-8a99-4007-8495-c4306b8ca0e8" containerName="authorino"
Sep 18 13:55:14.771073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.771000    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f0d36c-8a99-4007-8495-c4306b8ca0e8" containerName="authorino"
Sep 18 13:55:14.771073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.771052    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aaf5265-4152-447f-91b7-0e23b0f6dd98" containerName="authorino"
Sep 18 13:55:14.771073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.771060    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0f0d36c-8a99-4007-8495-c4306b8ca0e8" containerName="authorino"
Sep 18 13:55:14.773895 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.773879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.776744 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.776719    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 18 13:55:14.777948 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.777933    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 13:55:14.777948 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.777940    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t99ts\""
Sep 18 13:55:14.778063 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.777965    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 13:55:14.789973 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.789951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"]
Sep 18 13:55:14.795680 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.795654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:14.829899 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.829868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.830049 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.829905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.830049 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.829924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.830049 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.829945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-252g8\" (UniqueName: \"kubernetes.io/projected/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-kube-api-access-252g8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.830212 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.830044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.830212 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.830121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.930468 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.930425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.930720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.930486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.930720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.930505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.930720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.930527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-252g8\" (UniqueName: \"kubernetes.io/projected/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-kube-api-access-252g8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.930720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.930564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.930720 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.930639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.930991 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.930899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.931030 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.931010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.931109 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.931083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.933092 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.933074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.933258 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.933241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:14.939097 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:14.939076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-252g8\" (UniqueName: \"kubernetes.io/projected/5b16d1fd-fd34-45c1-90b0-cfb10d8358f6-kube-api-access-252g8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pftrv\" (UID: \"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:15.084343 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:15.084251    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:15.101770 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:15.101725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:15.200798 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:15.200760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:15.357464 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:15.357423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"]
Sep 18 13:55:15.360375 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:55:15.360349    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b16d1fd_fd34_45c1_90b0_cfb10d8358f6.slice/crio-67fc6766231713c0134c1faf31c0ad7004352c296c3db0b9275afa8780b1647b WatchSource:0}: Error finding container 67fc6766231713c0134c1faf31c0ad7004352c296c3db0b9275afa8780b1647b: Status 404 returned error can't find the container with id 67fc6766231713c0134c1faf31c0ad7004352c296c3db0b9275afa8780b1647b
Sep 18 13:55:15.362183 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:15.362165    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 13:55:15.678082 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:15.677993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv" event={"ID":"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6","Type":"ContainerStarted","Data":"67fc6766231713c0134c1faf31c0ad7004352c296c3db0b9275afa8780b1647b"}
Sep 18 13:55:16.684425 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:16.684383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv" event={"ID":"5b16d1fd-fd34-45c1-90b0-cfb10d8358f6","Type":"ContainerStarted","Data":"a8909951828b0f154646c6af9afaf9e67f965dd14f195f26044f431d537e3ca3"}
Sep 18 13:55:16.705371 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:16.705320    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv" podStartSLOduration=1.524080764 podStartE2EDuration="2.705302289s" totalImagesPullingTime="1.181221525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:55:16.703548474 +0000 UTC m=+665.395420066" watchObservedRunningTime="2026-09-18 13:55:16.705302289 +0000 UTC m=+665.397173883"
Sep 18 13:55:18.442875 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:18.442835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:25.085243 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:25.085192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:25.085716 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:25.085267    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:25.097488 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:25.097460    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:25.739541 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:25.739512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pftrv"
Sep 18 13:55:26.677803 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.677772    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"]
Sep 18 13:55:26.681032 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.681017    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.683752 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.683731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 18 13:55:26.692476 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.692455    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"]
Sep 18 13:55:26.744597 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.744561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.744597 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.744593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec264359-94c3-4667-8331-a41e987d2aa6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.744831 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.744622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxz8l\" (UniqueName: \"kubernetes.io/projected/ec264359-94c3-4667-8331-a41e987d2aa6-kube-api-access-rxz8l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.744831 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.744719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.744831 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.744758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.744965 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.744855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.767736 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.767701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:26.845694 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.845664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.845842 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.845735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.845842 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.845754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec264359-94c3-4667-8331-a41e987d2aa6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.845842 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.845773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxz8l\" (UniqueName: \"kubernetes.io/projected/ec264359-94c3-4667-8331-a41e987d2aa6-kube-api-access-rxz8l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.845842 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.845822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.845842 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.845840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.846249 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.846217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.846377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.846272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.846377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.846283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.848168 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.848151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec264359-94c3-4667-8331-a41e987d2aa6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.848546 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.848522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec264359-94c3-4667-8331-a41e987d2aa6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.857078 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.857048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxz8l\" (UniqueName: \"kubernetes.io/projected/ec264359-94c3-4667-8331-a41e987d2aa6-kube-api-access-rxz8l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642\" (UID: \"ec264359-94c3-4667-8331-a41e987d2aa6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:26.991325 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:26.991296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:27.263042 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:27.262971    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"]
Sep 18 13:55:27.266385 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:55:27.266359    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec264359_94c3_4667_8331_a41e987d2aa6.slice/crio-77b3b409eba0b86df0ab32853f62cb455961bf56d8849d63f6b6a3db7bb9e559 WatchSource:0}: Error finding container 77b3b409eba0b86df0ab32853f62cb455961bf56d8849d63f6b6a3db7bb9e559: Status 404 returned error can't find the container with id 77b3b409eba0b86df0ab32853f62cb455961bf56d8849d63f6b6a3db7bb9e559
Sep 18 13:55:27.739599 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:27.739560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642" event={"ID":"ec264359-94c3-4667-8331-a41e987d2aa6","Type":"ContainerStarted","Data":"ddd92b62316aae89184a3eb78e248e335c26790391eadd72f79f533fb5f866f0"}
Sep 18 13:55:27.740091 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:27.739637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642" event={"ID":"ec264359-94c3-4667-8331-a41e987d2aa6","Type":"ContainerStarted","Data":"77b3b409eba0b86df0ab32853f62cb455961bf56d8849d63f6b6a3db7bb9e559"}
Sep 18 13:55:27.758539 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:27.758484    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642" podStartSLOduration=1.570862924 podStartE2EDuration="1.758468126s" totalImagesPullingTime="187.605202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:55:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:55:27.757367739 +0000 UTC m=+676.449239334" watchObservedRunningTime="2026-09-18 13:55:27.758468126 +0000 UTC m=+676.450339722"
Sep 18 13:55:36.992506 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:36.992466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:36.993001 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:36.992534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:37.004890 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:37.004866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:37.791700 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:37.791666    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642"
Sep 18 13:55:40.809875 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:40.809832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:45.377291 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.377259    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"]
Sep 18 13:55:45.380416 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.380394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.383370 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.383343    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 18 13:55:45.394077 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.394052    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"]
Sep 18 13:55:45.402682 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.402657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:45.513055 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.513015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.513228 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.513063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjfn8\" (UniqueName: \"kubernetes.io/projected/6e50c500-1652-4ce1-a23c-92c72c6898f2-kube-api-access-hjfn8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.513228 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.513131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.513228 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.513179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e50c500-1652-4ce1-a23c-92c72c6898f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.513228 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.513203    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.513361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.513237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614015 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.613981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e50c500-1652-4ce1-a23c-92c72c6898f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjfn8\" (UniqueName: \"kubernetes.io/projected/6e50c500-1652-4ce1-a23c-92c72c6898f2-kube-api-access-hjfn8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614433 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.614510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.614497    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.616732 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.616699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e50c500-1652-4ce1-a23c-92c72c6898f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.616949 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.616933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e50c500-1652-4ce1-a23c-92c72c6898f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.622841 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.622819    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjfn8\" (UniqueName: \"kubernetes.io/projected/6e50c500-1652-4ce1-a23c-92c72c6898f2-kube-api-access-hjfn8\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4rchf\" (UID: \"6e50c500-1652-4ce1-a23c-92c72c6898f2\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.690740 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.690707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:45.968063 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:45.967967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"]
Sep 18 13:55:45.973148 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:55:45.973120    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e50c500_1652_4ce1_a23c_92c72c6898f2.slice/crio-9894acb3565755f4a6c06033557d9be70a19bb60dce5fbd5a7a830233fa1068c WatchSource:0}: Error finding container 9894acb3565755f4a6c06033557d9be70a19bb60dce5fbd5a7a830233fa1068c: Status 404 returned error can't find the container with id 9894acb3565755f4a6c06033557d9be70a19bb60dce5fbd5a7a830233fa1068c
Sep 18 13:55:46.819941 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:46.819907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf" event={"ID":"6e50c500-1652-4ce1-a23c-92c72c6898f2","Type":"ContainerStarted","Data":"c43d35c4e65a069d6fa824fe542b5df0ee81aa43f9f373b57450fcd6c37da84b"}
Sep 18 13:55:46.820354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:46.819949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf" event={"ID":"6e50c500-1652-4ce1-a23c-92c72c6898f2","Type":"ContainerStarted","Data":"9894acb3565755f4a6c06033557d9be70a19bb60dce5fbd5a7a830233fa1068c"}
Sep 18 13:55:46.839936 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:46.839891    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf" podStartSLOduration=1.636131093 podStartE2EDuration="1.839874165s" totalImagesPullingTime="203.743072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:55:46.838160585 +0000 UTC m=+695.530032180" watchObservedRunningTime="2026-09-18 13:55:46.839874165 +0000 UTC m=+695.531745751"
Sep 18 13:55:55.691381 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:55.691339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:55.691819 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:55.691414    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:55.704115 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:55.704090    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:55.871819 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:55.871787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4rchf"
Sep 18 13:55:56.689921 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:56.689888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:55:56.797025 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:55:56.796990    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:08.085331 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:08.085293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:32.333332 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:32.333300    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:57:52.330794 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.330765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-96dcb6468-7lxjk"]
Sep 18 13:57:52.333986 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.333968    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.347857 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.347835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-96dcb6468-7lxjk"]
Sep 18 13:57:52.369082 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.369059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprt5\" (UniqueName: \"kubernetes.io/projected/d683e3ab-6d59-49da-a897-28cf01bd9b66-kube-api-access-hprt5\") pod \"authorino-96dcb6468-7lxjk\" (UID: \"d683e3ab-6d59-49da-a897-28cf01bd9b66\") " pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.369194 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.369111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d683e3ab-6d59-49da-a897-28cf01bd9b66-tls-cert\") pod \"authorino-96dcb6468-7lxjk\" (UID: \"d683e3ab-6d59-49da-a897-28cf01bd9b66\") " pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.470420 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.470382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprt5\" (UniqueName: \"kubernetes.io/projected/d683e3ab-6d59-49da-a897-28cf01bd9b66-kube-api-access-hprt5\") pod \"authorino-96dcb6468-7lxjk\" (UID: \"d683e3ab-6d59-49da-a897-28cf01bd9b66\") " pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.470596 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.470457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d683e3ab-6d59-49da-a897-28cf01bd9b66-tls-cert\") pod \"authorino-96dcb6468-7lxjk\" (UID: \"d683e3ab-6d59-49da-a897-28cf01bd9b66\") " pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.473073 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.473052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d683e3ab-6d59-49da-a897-28cf01bd9b66-tls-cert\") pod \"authorino-96dcb6468-7lxjk\" (UID: \"d683e3ab-6d59-49da-a897-28cf01bd9b66\") " pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.481168 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.481144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprt5\" (UniqueName: \"kubernetes.io/projected/d683e3ab-6d59-49da-a897-28cf01bd9b66-kube-api-access-hprt5\") pod \"authorino-96dcb6468-7lxjk\" (UID: \"d683e3ab-6d59-49da-a897-28cf01bd9b66\") " pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.642750 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.642669    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-96dcb6468-7lxjk"
Sep 18 13:57:52.911143 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:52.911119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-96dcb6468-7lxjk"]
Sep 18 13:57:52.913577 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:57:52.913550    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd683e3ab_6d59_49da_a897_28cf01bd9b66.slice/crio-160374865b0dab4e276d9c61b723b43a3edacca3697ec9bb92576405734cb195 WatchSource:0}: Error finding container 160374865b0dab4e276d9c61b723b43a3edacca3697ec9bb92576405734cb195: Status 404 returned error can't find the container with id 160374865b0dab4e276d9c61b723b43a3edacca3697ec9bb92576405734cb195
Sep 18 13:57:53.380293 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:57:53.380259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96dcb6468-7lxjk" event={"ID":"d683e3ab-6d59-49da-a897-28cf01bd9b66","Type":"ContainerStarted","Data":"160374865b0dab4e276d9c61b723b43a3edacca3697ec9bb92576405734cb195"}
Sep 18 13:58:02.422028 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.421988    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-96dcb6468-7lxjk" event={"ID":"d683e3ab-6d59-49da-a897-28cf01bd9b66","Type":"ContainerStarted","Data":"54686c5fdf269ff29ba0c58e443192ae087172abda728f2b53063cd0dcfff09a"}
Sep 18 13:58:02.444796 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.444739    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-96dcb6468-7lxjk" podStartSLOduration=1.637119067 podStartE2EDuration="10.444722781s" totalImagesPullingTime="8.807603714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:02.442705084 +0000 UTC m=+831.134576681" watchObservedRunningTime="2026-09-18 13:58:02.444722781 +0000 UTC m=+831.136594376"
Sep 18 13:58:02.478544 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.478509    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-667576b6d5-vzdnn"]
Sep 18 13:58:02.478774 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.478748    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-667576b6d5-vzdnn" podUID="9f7725c7-250e-405f-b4a6-bc4c8ffade46" containerName="authorino" containerID="cri-o://0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6" gracePeriod=30
Sep 18 13:58:02.720527 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.720504    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:58:02.761657 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.761623    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7725c7-250e-405f-b4a6-bc4c8ffade46-tls-cert\") pod \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") "
Sep 18 13:58:02.761829 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.761714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdhwb\" (UniqueName: \"kubernetes.io/projected/9f7725c7-250e-405f-b4a6-bc4c8ffade46-kube-api-access-mdhwb\") pod \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\" (UID: \"9f7725c7-250e-405f-b4a6-bc4c8ffade46\") "
Sep 18 13:58:02.763900 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.763871    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7725c7-250e-405f-b4a6-bc4c8ffade46-kube-api-access-mdhwb" (OuterVolumeSpecName: "kube-api-access-mdhwb") pod "9f7725c7-250e-405f-b4a6-bc4c8ffade46" (UID: "9f7725c7-250e-405f-b4a6-bc4c8ffade46"). InnerVolumeSpecName "kube-api-access-mdhwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:02.771795 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.771765    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7725c7-250e-405f-b4a6-bc4c8ffade46-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9f7725c7-250e-405f-b4a6-bc4c8ffade46" (UID: "9f7725c7-250e-405f-b4a6-bc4c8ffade46"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 13:58:02.862857 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.862819    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9f7725c7-250e-405f-b4a6-bc4c8ffade46-tls-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:58:02.862857 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:02.862851    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdhwb\" (UniqueName: \"kubernetes.io/projected/9f7725c7-250e-405f-b4a6-bc4c8ffade46-kube-api-access-mdhwb\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:58:03.014870 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.014651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:03.115259 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.115227    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:03.428621 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.428527    2578 generic.go:356] "Generic (PLEG): container finished" podID="9f7725c7-250e-405f-b4a6-bc4c8ffade46" containerID="0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6" exitCode=0
Sep 18 13:58:03.428621 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.428582    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667576b6d5-vzdnn"
Sep 18 13:58:03.429061 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.428633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667576b6d5-vzdnn" event={"ID":"9f7725c7-250e-405f-b4a6-bc4c8ffade46","Type":"ContainerDied","Data":"0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6"}
Sep 18 13:58:03.429061 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.428680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667576b6d5-vzdnn" event={"ID":"9f7725c7-250e-405f-b4a6-bc4c8ffade46","Type":"ContainerDied","Data":"f2aaf82d518ea424d1c65ef8431b5b3b7901ab6c847ef12fe81cd6a2a20a0ba4"}
Sep 18 13:58:03.429061 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.428701    2578 scope.go:117] "RemoveContainer" containerID="0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6"
Sep 18 13:58:03.437666 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.437643    2578 scope.go:117] "RemoveContainer" containerID="0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6"
Sep 18 13:58:03.437967 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:03.437945    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6\": container with ID starting with 0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6 not found: ID does not exist" containerID="0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6"
Sep 18 13:58:03.438034 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.437974    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6"} err="failed to get container status \"0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6\": rpc error: code = NotFound desc = could not find container \"0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6\": container with ID starting with 0eaea2c2a88f0ffd4c64f43e5ed57337a0e1bda8d176c95abf59ae7c612405b6 not found: ID does not exist"
Sep 18 13:58:03.455389 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.455354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-667576b6d5-vzdnn"]
Sep 18 13:58:03.458809 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.458785    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-667576b6d5-vzdnn"]
Sep 18 13:58:03.850592 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:03.850550    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7725c7-250e-405f-b4a6-bc4c8ffade46" path="/var/lib/kubelet/pods/9f7725c7-250e-405f-b4a6-bc4c8ffade46/volumes"
Sep 18 13:58:04.193974 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:04.193937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:04.288743 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:04.288696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.231922 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.231885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.332826 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.332798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.439672 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.439645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.585077 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.585003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.625085 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.625051    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"]
Sep 18 13:58:20.625522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.625506    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7725c7-250e-405f-b4a6-bc4c8ffade46" containerName="authorino"
Sep 18 13:58:20.625522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.625523    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7725c7-250e-405f-b4a6-bc4c8ffade46" containerName="authorino"
Sep 18 13:58:20.625723 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.625628    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7725c7-250e-405f-b4a6-bc4c8ffade46" containerName="authorino"
Sep 18 13:58:20.630077 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.630058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.633704 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.633681    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-a02b2c-openshift-default-dockercfg-vcwkf\""
Sep 18 13:58:20.643283 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.643260    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"]
Sep 18 13:58:20.690516 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.690475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.710930 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.710897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20d1afd-878b-40e7-9d2a-086731db4732-istiod-ca-cert\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711112 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.710959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20d1afd-878b-40e7-9d2a-086731db4732-istio-podinfo\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711112 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.711020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-envoy\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711112 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.711051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-credential-socket\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711112 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.711090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-certs\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711339 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.711120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rq6k\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-kube-api-access-2rq6k\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711339 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.711204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-istio-token\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711339 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.711251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-socket\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.711339 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.711287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-data\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.790886 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.790847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.812002 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.811970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-data\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20d1afd-878b-40e7-9d2a-086731db4732-istiod-ca-cert\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20d1afd-878b-40e7-9d2a-086731db4732-istio-podinfo\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-envoy\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-credential-socket\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-certs\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812407 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rq6k\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-kube-api-access-2rq6k\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812407 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-istio-token\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812407 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-socket\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812567 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-data\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812655 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-socket\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812737 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-certs\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.812880 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.812852    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-credential-socket\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.813387 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.813364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20d1afd-878b-40e7-9d2a-086731db4732-istiod-ca-cert\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.814964 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.814944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-envoy\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.815178 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.815153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20d1afd-878b-40e7-9d2a-086731db4732-istio-podinfo\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.823988 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.823958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rq6k\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-kube-api-access-2rq6k\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.824563 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.824546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-istio-token\") pod \"e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") " pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.889748 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.889667    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:20.943419 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.943385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:20.952413 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:20.952385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:21.224961 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.224935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"]
Sep 18 13:58:21.226565 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:58:21.226541    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20d1afd_878b_40e7_9d2a_086731db4732.slice/crio-c5c728f47f327f54d03896c995977a3cdeffaef1d7a7e665e8c1ac6229b78d45 WatchSource:0}: Error finding container c5c728f47f327f54d03896c995977a3cdeffaef1d7a7e665e8c1ac6229b78d45: Status 404 returned error can't find the container with id c5c728f47f327f54d03896c995977a3cdeffaef1d7a7e665e8c1ac6229b78d45
Sep 18 13:58:21.228771 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.228741    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.228851 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.228808    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.228851 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.228837    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:21.510676 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.510578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" event={"ID":"a20d1afd-878b-40e7-9d2a-086731db4732","Type":"ContainerStarted","Data":"932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee"}
Sep 18 13:58:21.510676 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.510662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" event={"ID":"a20d1afd-878b-40e7-9d2a-086731db4732","Type":"ContainerStarted","Data":"c5c728f47f327f54d03896c995977a3cdeffaef1d7a7e665e8c1ac6229b78d45"}
Sep 18 13:58:21.548258 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.548214    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podStartSLOduration=1.548193869 podStartE2EDuration="1.548193869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:21.545520076 +0000 UTC m=+850.237391674" watchObservedRunningTime="2026-09-18 13:58:21.548193869 +0000 UTC m=+850.240065463"
Sep 18 13:58:21.748871 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.748818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:21.841880 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.841800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:21.943778 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:21.943747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:22.221782 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.221756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:22.338317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.338287    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-611bda"]
Sep 18 13:58:22.341655 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.341640    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:22.344665 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.344647    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mwrqv\""
Sep 18 13:58:22.349081 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.349057    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-611bda"]
Sep 18 13:58:22.426398 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.426368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms2qr\" (UniqueName: \"kubernetes.io/projected/15cc5208-e459-4adc-8715-7b60756b4314-kube-api-access-ms2qr\") pod \"test-curl-7441-611bda\" (UID: \"15cc5208-e459-4adc-8715-7b60756b4314\") " pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:22.526897 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.526820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms2qr\" (UniqueName: \"kubernetes.io/projected/15cc5208-e459-4adc-8715-7b60756b4314-kube-api-access-ms2qr\") pod \"test-curl-7441-611bda\" (UID: \"15cc5208-e459-4adc-8715-7b60756b4314\") " pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:22.536053 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.536026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms2qr\" (UniqueName: \"kubernetes.io/projected/15cc5208-e459-4adc-8715-7b60756b4314-kube-api-access-ms2qr\") pod \"test-curl-7441-611bda\" (UID: \"15cc5208-e459-4adc-8715-7b60756b4314\") " pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:22.653458 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.653430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:22.926047 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.926018    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-611bda"]
Sep 18 13:58:22.928732 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:58:22.928708    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15cc5208_e459_4adc_8715_7b60756b4314.slice/crio-e054e93002b1eaccb41bd87eb1c6e93a18a71008425ae8f734459fce2f06853e WatchSource:0}: Error finding container e054e93002b1eaccb41bd87eb1c6e93a18a71008425ae8f734459fce2f06853e: Status 404 returned error can't find the container with id e054e93002b1eaccb41bd87eb1c6e93a18a71008425ae8f734459fce2f06853e
Sep 18 13:58:22.948511 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:22.948475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:23.520488 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:23.520453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-611bda" event={"ID":"15cc5208-e459-4adc-8715-7b60756b4314","Type":"ContainerStarted","Data":"e054e93002b1eaccb41bd87eb1c6e93a18a71008425ae8f734459fce2f06853e"}
Sep 18 13:58:23.520729 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:23.520716    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:23.521708 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:23.521691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:23.549730 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:23.549699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:23.645529 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:23.645504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:23.935029 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:23.934984    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:24.089733 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:24.089664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:24.248359 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:24.248276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:25.418280 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:25.418203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:25.523681 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:25.523648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:25.531889 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:25.531863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-611bda" event={"ID":"15cc5208-e459-4adc-8715-7b60756b4314","Type":"ContainerStarted","Data":"8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1"}
Sep 18 13:58:25.558547 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:25.558502    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7441-611bda" podStartSLOduration=1.374230254 podStartE2EDuration="3.558486789s" totalImagesPullingTime="2.184256535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:25.556568525 +0000 UTC m=+854.248440119" watchObservedRunningTime="2026-09-18 13:58:25.558486789 +0000 UTC m=+854.250358383"
Sep 18 13:58:25.779532 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:25.779498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:26.051519 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.051441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:26.150039 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.149995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:26.166192 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.166162    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-611bda"]
Sep 18 13:58:26.173717 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.173680    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-611bda"]
Sep 18 13:58:26.304223 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.304140    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7441-79c212"]
Sep 18 13:58:26.304534 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.304514    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cc5208-e459-4adc-8715-7b60756b4314" containerName="test-curl-7441-611bda"
Sep 18 13:58:26.304641 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.304537    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cc5208-e459-4adc-8715-7b60756b4314" containerName="test-curl-7441-611bda"
Sep 18 13:58:26.304710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.304675    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cc5208-e459-4adc-8715-7b60756b4314" containerName="test-curl-7441-611bda"
Sep 18 13:58:26.307749 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.307717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:26.315556 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.315536    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-79c212"]
Sep 18 13:58:26.463675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.463638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvm4j\" (UniqueName: \"kubernetes.io/projected/f329a15a-de7c-45e9-885f-9adb0de61665-kube-api-access-qvm4j\") pod \"test-curl-7441-79c212\" (UID: \"f329a15a-de7c-45e9-885f-9adb0de61665\") " pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:26.536308 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:26.536284    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7441-611bda" container="test-curl-7441-611bda"
Sep 18 13:58:26.564509 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.564449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvm4j\" (UniqueName: \"kubernetes.io/projected/f329a15a-de7c-45e9-885f-9adb0de61665-kube-api-access-qvm4j\") pod \"test-curl-7441-79c212\" (UID: \"f329a15a-de7c-45e9-885f-9adb0de61665\") " pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:26.573146 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.573122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvm4j\" (UniqueName: \"kubernetes.io/projected/f329a15a-de7c-45e9-885f-9adb0de61665-kube-api-access-qvm4j\") pod \"test-curl-7441-79c212\" (UID: \"f329a15a-de7c-45e9-885f-9adb0de61665\") " pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:26.617630 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.617580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:26.781787 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.781756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:26.884201 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.884104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:26.891419 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.891396    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7441-79c212"]
Sep 18 13:58:26.893092 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:58:26.893063    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf329a15a_de7c_45e9_885f_9adb0de61665.slice/crio-8a3ed3ccb6071f0b59f9f9172ecb6f590ece2de2db334b71982b843d13ac8728 WatchSource:0}: Error finding container 8a3ed3ccb6071f0b59f9f9172ecb6f590ece2de2db334b71982b843d13ac8728: Status 404 returned error can't find the container with id 8a3ed3ccb6071f0b59f9f9172ecb6f590ece2de2db334b71982b843d13ac8728
Sep 18 13:58:26.981943 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:26.981919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:27.335277 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:27.335248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:27.431412 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:27.431358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:27.541723 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:27.541692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-79c212" event={"ID":"f329a15a-de7c-45e9-885f-9adb0de61665","Type":"ContainerStarted","Data":"5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d"}
Sep 18 13:58:27.541723 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:27.541729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7441-79c212" event={"ID":"f329a15a-de7c-45e9-885f-9adb0de61665","Type":"ContainerStarted","Data":"8a3ed3ccb6071f0b59f9f9172ecb6f590ece2de2db334b71982b843d13ac8728"}
Sep 18 13:58:27.542200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:27.541748    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7441-611bda" podUID="15cc5208-e459-4adc-8715-7b60756b4314" containerName="test-curl-7441-611bda" containerID="cri-o://8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1" gracePeriod=2
Sep 18 13:58:27.545212 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:27.545188    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-611bda\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="15cc5208-e459-4adc-8715-7b60756b4314" pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:27.577411 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:27.577357    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7441-79c212" podStartSLOduration=1.577340495 podStartE2EDuration="1.577340495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:27.575389061 +0000 UTC m=+856.267260652" watchObservedRunningTime="2026-09-18 13:58:27.577340495 +0000 UTC m=+856.269212089"
Sep 18 13:58:27.578506 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:27.578481    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-611bda\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="15cc5208-e459-4adc-8715-7b60756b4314" pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:27.927043 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:27.927005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:28.018492 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.018420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:28.195583 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.195546    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7441-79c212"]
Sep 18 13:58:28.200361 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.200337    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7441-79c212"]
Sep 18 13:58:28.413972 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.413869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:28.546680 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:28.546653    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7441-79c212" container="test-curl-7441-79c212"
Sep 18 13:58:28.595586 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.595558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:28.699866 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.699835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:28.722497 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.722467    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"]
Sep 18 13:58:28.722835 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.722822    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f329a15a-de7c-45e9-885f-9adb0de61665" containerName="test-curl-7441-79c212"
Sep 18 13:58:28.722882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.722838    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f329a15a-de7c-45e9-885f-9adb0de61665" containerName="test-curl-7441-79c212"
Sep 18 13:58:28.722915 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.722908    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f329a15a-de7c-45e9-885f-9adb0de61665" containerName="test-curl-7441-79c212"
Sep 18 13:58:28.725933 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.725918    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:28.729112 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.729087    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-036fc2-dockercfg-5lwzf\""
Sep 18 13:58:28.729230 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.729113    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-036fc2\""
Sep 18 13:58:28.740932 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.740908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"]
Sep 18 13:58:28.784972 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.784939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:28.882064 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.882030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2ba86a-7c74-4e11-b655-178fccf94d4a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:28.882250 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.882070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2bz\" (UniqueName: \"kubernetes.io/projected/0d2ba86a-7c74-4e11-b655-178fccf94d4a-kube-api-access-fs2bz\") pod \"payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:28.983077 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.982966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2ba86a-7c74-4e11-b655-178fccf94d4a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:28.983077 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.983035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2bz\" (UniqueName: \"kubernetes.io/projected/0d2ba86a-7c74-4e11-b655-178fccf94d4a-kube-api-access-fs2bz\") pod \"payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:28.983828 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.983808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2ba86a-7c74-4e11-b655-178fccf94d4a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:28.995796 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:28.995766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2bz\" (UniqueName: \"kubernetes.io/projected/0d2ba86a-7c74-4e11-b655-178fccf94d4a-kube-api-access-fs2bz\") pod \"payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:29.036013 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.035984    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:29.036683 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.036661    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"]
Sep 18 13:58:29.039786 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.039770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.042845 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.042822    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-13658e-openshift-default-dockercfg-bfqj8\""
Sep 18 13:58:29.054648 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.054590    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"]
Sep 18 13:58:29.068270 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.068240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:29.185955 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.185919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24848088-b7fd-400f-9372-21ecae63e7e5-istiod-ca-cert\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.185973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24848088-b7fd-400f-9372-21ecae63e7e5-istio-podinfo\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.186077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-socket\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.186110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-certs\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.186146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-data\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186355 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.186221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-credential-socket\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186355 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.186253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwdr\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-kube-api-access-wpwdr\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186422 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.186353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-envoy\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.186422 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.186381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-istio-token\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.254152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.254067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:29.287132 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-envoy\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287214 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-istio-token\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287214 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24848088-b7fd-400f-9372-21ecae63e7e5-istiod-ca-cert\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287214 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24848088-b7fd-400f-9372-21ecae63e7e5-istio-podinfo\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287368 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-socket\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287368 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-certs\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287368 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-data\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287575 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-credential-socket\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287575 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwdr\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-kube-api-access-wpwdr\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287723 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-socket\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.287837 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.287814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-certs\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.288119 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.288013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-data\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.288119 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.288108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-credential-socket\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.288119 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.288140    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24848088-b7fd-400f-9372-21ecae63e7e5-istiod-ca-cert\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.291818 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.291437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-envoy\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.291818 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.291705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24848088-b7fd-400f-9372-21ecae63e7e5-istio-podinfo\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.297147 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.297122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-istio-token\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.297242 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.297188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwdr\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-kube-api-access-wpwdr\") pod \"e2e-autores-13658e-openshift-default-b456f7846-hqlkq\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") " pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.319793 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.319776    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"]
Sep 18 13:58:29.321954 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:58:29.321934    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2ba86a_7c74_4e11_b655_178fccf94d4a.slice/crio-2b576481a68f756a2cf425e83d7dfa8b38bf60c48080b8e14d608fb98c539dfa WatchSource:0}: Error finding container 2b576481a68f756a2cf425e83d7dfa8b38bf60c48080b8e14d608fb98c539dfa: Status 404 returned error can't find the container with id 2b576481a68f756a2cf425e83d7dfa8b38bf60c48080b8e14d608fb98c539dfa
Sep 18 13:58:29.352807 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.352781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:29.368367 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.368345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:29.553106 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.553079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt" event={"ID":"0d2ba86a-7c74-4e11-b655-178fccf94d4a","Type":"ContainerStarted","Data":"2b576481a68f756a2cf425e83d7dfa8b38bf60c48080b8e14d608fb98c539dfa"}
Sep 18 13:58:29.553456 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.553130    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7441-79c212" podUID="f329a15a-de7c-45e9-885f-9adb0de61665" containerName="test-curl-7441-79c212" containerID="cri-o://5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d" gracePeriod=2
Sep 18 13:58:29.555662 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:29.555632    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-79c212\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="f329a15a-de7c-45e9-885f-9adb0de61665" pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:29.649200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.649168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"]
Sep 18 13:58:29.658051 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:58:29.658016    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24848088_b7fd_400f_9372_21ecae63e7e5.slice/crio-efb6ae8e70ad2185467c12b9a563130882cc9c60bbfba13405f66d041b854f9e WatchSource:0}: Error finding container efb6ae8e70ad2185467c12b9a563130882cc9c60bbfba13405f66d041b854f9e: Status 404 returned error can't find the container with id efb6ae8e70ad2185467c12b9a563130882cc9c60bbfba13405f66d041b854f9e
Sep 18 13:58:29.660700 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.660650    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:29.660799 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.660749    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:29.660845 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.660798    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:29.715317 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.715291    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:29.718935 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:29.718909    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7441-79c212\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="f329a15a-de7c-45e9-885f-9adb0de61665" pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:29.791585 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.791551    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms2qr\" (UniqueName: \"kubernetes.io/projected/15cc5208-e459-4adc-8715-7b60756b4314-kube-api-access-ms2qr\") pod \"15cc5208-e459-4adc-8715-7b60756b4314\" (UID: \"15cc5208-e459-4adc-8715-7b60756b4314\") "
Sep 18 13:58:29.794282 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.794248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cc5208-e459-4adc-8715-7b60756b4314-kube-api-access-ms2qr" (OuterVolumeSpecName: "kube-api-access-ms2qr") pod "15cc5208-e459-4adc-8715-7b60756b4314" (UID: "15cc5208-e459-4adc-8715-7b60756b4314"). InnerVolumeSpecName "kube-api-access-ms2qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:29.854442 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.854080    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cc5208-e459-4adc-8715-7b60756b4314" path="/var/lib/kubelet/pods/15cc5208-e459-4adc-8715-7b60756b4314/volumes"
Sep 18 13:58:29.892939 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:29.892900    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms2qr\" (UniqueName: \"kubernetes.io/projected/15cc5208-e459-4adc-8715-7b60756b4314-kube-api-access-ms2qr\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:58:30.036881 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.036850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:30.310771 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.310739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:30.410043 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.410012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:30.539982 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.539946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:30.559717 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.559689    2578 generic.go:356] "Generic (PLEG): container finished" podID="15cc5208-e459-4adc-8715-7b60756b4314" containerID="8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1" exitCode=137
Sep 18 13:58:30.560117 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.559737    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-611bda"
Sep 18 13:58:30.560117 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.559790    2578 scope.go:117] "RemoveContainer" containerID="8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1"
Sep 18 13:58:30.561951 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.561922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" event={"ID":"24848088-b7fd-400f-9372-21ecae63e7e5","Type":"ContainerStarted","Data":"caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4"}
Sep 18 13:58:30.562066 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.561980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" event={"ID":"24848088-b7fd-400f-9372-21ecae63e7e5","Type":"ContainerStarted","Data":"efb6ae8e70ad2185467c12b9a563130882cc9c60bbfba13405f66d041b854f9e"}
Sep 18 13:58:30.589186 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.589140    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podStartSLOduration=1.589125916 podStartE2EDuration="1.589125916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:30.587356646 +0000 UTC m=+859.279228240" watchObservedRunningTime="2026-09-18 13:58:30.589125916 +0000 UTC m=+859.280997510"
Sep 18 13:58:30.829970 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.829903    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"]
Sep 18 13:58:30.839208 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.839180    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:30.842095 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.841959    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-57fc5a8f-openshift-default-dockercfg-sbffc\""
Sep 18 13:58:30.848377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.848173    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"]
Sep 18 13:58:30.859043 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.858964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:30.958899 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:30.958863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:31.002190 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-certs\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002439 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-envoy\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002439 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4674a74-b207-4102-b69e-8df2b651e74a-istiod-ca-cert\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002439 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-data\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002643 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-credential-socket\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002643 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-istio-token\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002759 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-socket\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002759 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4674a74-b207-4102-b69e-8df2b651e74a-istio-podinfo\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.002868 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.002755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9bt7\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-kube-api-access-d9bt7\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-credential-socket\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-istio-token\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-socket\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4674a74-b207-4102-b69e-8df2b651e74a-istio-podinfo\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9bt7\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-kube-api-access-d9bt7\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-certs\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-envoy\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4674a74-b207-4102-b69e-8df2b651e74a-istiod-ca-cert\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.104626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.104585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-data\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.105068 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.105038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-data\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.105274 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.105250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-socket\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.105580 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.105550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-certs\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.105764 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.105742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-credential-socket\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.105996 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.105970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4674a74-b207-4102-b69e-8df2b651e74a-istiod-ca-cert\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.108102 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.108077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-envoy\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.108183 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.108105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4674a74-b207-4102-b69e-8df2b651e74a-istio-podinfo\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.117931 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.117903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9bt7\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-kube-api-access-d9bt7\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.118303 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.118280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-istio-token\") pod \"e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") " pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.153355 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.153330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:31.369323 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.369253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:31.375075 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.375044    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:31.423796 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.423752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:31.491399 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.491378    2578 scope.go:117] "RemoveContainer" containerID="8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1"
Sep 18 13:58:31.491795 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:31.491773    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1\": container with ID starting with 8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1 not found: ID does not exist" containerID="8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1"
Sep 18 13:58:31.491863 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.491808    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1"} err="failed to get container status \"8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1\": rpc error: code = NotFound desc = could not find container \"8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1\": container with ID starting with 8d61de215dc7432bc2cfdaf38a66d2cf0970ed47e4f09bce902f788e7cb8a2d1 not found: ID does not exist"
Sep 18 13:58:31.568358 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.568334    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:31.569982 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.569947    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:31.720825 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.720797    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:31.768572 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.768537    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"]
Sep 18 13:58:31.788350 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.787668    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:31.788350 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.787756    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:31.788350 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.787795    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:31.811215 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.811176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvm4j\" (UniqueName: \"kubernetes.io/projected/f329a15a-de7c-45e9-885f-9adb0de61665-kube-api-access-qvm4j\") pod \"f329a15a-de7c-45e9-885f-9adb0de61665\" (UID: \"f329a15a-de7c-45e9-885f-9adb0de61665\") "
Sep 18 13:58:31.813912 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.813879    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f329a15a-de7c-45e9-885f-9adb0de61665-kube-api-access-qvm4j" (OuterVolumeSpecName: "kube-api-access-qvm4j") pod "f329a15a-de7c-45e9-885f-9adb0de61665" (UID: "f329a15a-de7c-45e9-885f-9adb0de61665"). InnerVolumeSpecName "kube-api-access-qvm4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:58:31.855182 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.855010    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f329a15a-de7c-45e9-885f-9adb0de61665" path="/var/lib/kubelet/pods/f329a15a-de7c-45e9-885f-9adb0de61665/volumes"
Sep 18 13:58:31.912395 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.912324    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvm4j\" (UniqueName: \"kubernetes.io/projected/f329a15a-de7c-45e9-885f-9adb0de61665-kube-api-access-qvm4j\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:58:31.918378 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:31.918318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:32.541527 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.541470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:32.575697 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.575655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt" event={"ID":"0d2ba86a-7c74-4e11-b655-178fccf94d4a","Type":"ContainerStarted","Data":"6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7"}
Sep 18 13:58:32.576156 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.575762    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:32.577124 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.577095    2578 generic.go:356] "Generic (PLEG): container finished" podID="f329a15a-de7c-45e9-885f-9adb0de61665" containerID="5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d" exitCode=137
Sep 18 13:58:32.577256 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.577142    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7441-79c212"
Sep 18 13:58:32.577256 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.577185    2578 scope.go:117] "RemoveContainer" containerID="5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d"
Sep 18 13:58:32.579426 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.579386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" event={"ID":"d4674a74-b207-4102-b69e-8df2b651e74a","Type":"ContainerStarted","Data":"132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505"}
Sep 18 13:58:32.579536 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.579439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" event={"ID":"d4674a74-b207-4102-b69e-8df2b651e74a","Type":"ContainerStarted","Data":"e196720f5baff73e595c1f5f6d0f2c5398fa5f6889d30e904eacc9c69054153c"}
Sep 18 13:58:32.587418 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.587225    2578 scope.go:117] "RemoveContainer" containerID="5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d"
Sep 18 13:58:32.587585 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:32.587560    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d\": container with ID starting with 5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d not found: ID does not exist" containerID="5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d"
Sep 18 13:58:32.587675 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.587595    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d"} err="failed to get container status \"5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d\": rpc error: code = NotFound desc = could not find container \"5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d\": container with ID starting with 5010307f4c6ac0c3d272720c6132cf285d0920388acd6dbf2d7738fb65e1887d not found: ID does not exist"
Sep 18 13:58:32.604086 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.604031    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt" podStartSLOduration=2.383429808 podStartE2EDuration="4.604013246s" totalImagesPullingTime="2.220583438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:32.601915021 +0000 UTC m=+861.293786617" watchObservedRunningTime="2026-09-18 13:58:32.604013246 +0000 UTC m=+861.295884843"
Sep 18 13:58:32.631785 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.631732    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" podStartSLOduration=2.631716801 podStartE2EDuration="2.631716801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:32.6302379 +0000 UTC m=+861.322109496" watchObservedRunningTime="2026-09-18 13:58:32.631716801 +0000 UTC m=+861.323588396"
Sep 18 13:58:32.638008 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.637978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:32.935697 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:32.935665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:33.153658 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:33.153623    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:33.159487 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:33.159459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:33.585671 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:33.585639    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:33.586267 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:33.586251    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:34.109645 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:34.109590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:34.220336 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:34.220298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:34.320634 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:34.320565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:35.403554 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:35.403519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:36.289344 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:36.289314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:36.396474 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:36.396435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:36.524504 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:36.524469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:36.886837 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:36.886805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:36.984124 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:36.984075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:37.373589 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:37.373558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:37.485825 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:37.485795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:37.583343 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:37.583311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.036626 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.036584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.138508 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.138470    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.287238 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.287160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.444625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.444578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.543981 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.543898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.785339 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.785273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.895345 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.895259    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:38.989329 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:38.989301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:39.090039 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:39.090009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:39.313459 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:39.313424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:39.504025 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:39.503988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:39.607511 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:39.607421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:39.716582 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:39.716548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:39.808647 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:39.808597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:40.709403 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:40.709367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:41.456006 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:41.455971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:42.383990 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.383887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:42.488845 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.488806    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:42.627522 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.627486    2578 generic.go:356] "Generic (PLEG): container finished" podID="a20d1afd-878b-40e7-9d2a-086731db4732" containerID="932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee" exitCode=0
Sep 18 13:58:42.627701 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.627562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" event={"ID":"a20d1afd-878b-40e7-9d2a-086731db4732","Type":"ContainerDied","Data":"932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee"}
Sep 18 13:58:42.628009 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.627995    2578 scope.go:117] "RemoveContainer" containerID="932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee"
Sep 18 13:58:42.629054 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.629031    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:42.629114 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.629101    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:42.629153 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:42.629134    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:43.436227 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:43.436190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:43.587942 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:43.587909    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 13:58:43.637504 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:43.637468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" event={"ID":"a20d1afd-878b-40e7-9d2a-086731db4732","Type":"ContainerStarted","Data":"48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6"}
Sep 18 13:58:43.715316 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:43.715231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:43.944215 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:43.944173    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:43.944647 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:43.944458    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 13:58:43.944647 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:43.944522    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 13:58:44.042701 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:44.042594    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:44.384371 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:44.384283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:44.477188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:44.477147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:44.944021 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:44.943984    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 13:58:44.944426 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:44.944053    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 13:58:44.964335 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:44.964299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:45.342724 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:45.342635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:45.943837 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:45.943801    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 13:58:45.944022 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:45.943857    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 13:58:46.328831 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:46.328737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:46.944590 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:46.944551    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 13:58:46.944773 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:46.944633    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 13:58:47.100184 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:47.100151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:47.888270 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:47.888229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:47.944044 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:47.943996    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 13:58:47.944200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:47.944060    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 13:58:48.003216 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:48.003175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:48.100414 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:48.100370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:48.215841 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:48.215809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:48.944294 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:48.944258    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 13:58:48.944722 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:48.944316    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 13:58:49.220378 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.219206    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"]
Sep 18 13:58:49.235110 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.234686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.249554 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.248516    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 13:58:49.249554 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.248776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 13:58:49.249554 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.248787    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 13:58:49.249554 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.248947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-12afdd-serving-cert\""
Sep 18 13:58:49.249554 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.249007    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5jwtb\""
Sep 18 13:58:49.249554 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.249465    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"]
Sep 18 13:58:49.309572 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.309534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:49.314709 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.314682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.314929 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.314909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/097b3363-b590-4a2e-ac05-1643691c44f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.315116 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.315099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-metrics-certs\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.315244 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.315228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg98p\" (UniqueName: \"kubernetes.io/projected/097b3363-b590-4a2e-ac05-1643691c44f1-kube-api-access-bg98p\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.416444 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.416407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.416444 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.416452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/097b3363-b590-4a2e-ac05-1643691c44f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.416693 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.416503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-metrics-certs\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.416693 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.416521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg98p\" (UniqueName: \"kubernetes.io/projected/097b3363-b590-4a2e-ac05-1643691c44f1-kube-api-access-bg98p\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.416934 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:49.416916    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-serving-cert: secret "maas-api-e2e-inf-b-12afdd-serving-cert" not found
Sep 18 13:58:49.417088 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:49.417078    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls podName:097b3363-b590-4a2e-ac05-1643691c44f1 nodeName:}" failed. No retries permitted until 2026-09-18 13:58:49.917060033 +0000 UTC m=+878.608931607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls") pod "maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" (UID: "097b3363-b590-4a2e-ac05-1643691c44f1") : secret "maas-api-e2e-inf-b-12afdd-serving-cert" not found
Sep 18 13:58:49.417821 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.417801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/097b3363-b590-4a2e-ac05-1643691c44f1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.421225 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.421202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-metrics-certs\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.437677 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.437652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg98p\" (UniqueName: \"kubernetes.io/projected/097b3363-b590-4a2e-ac05-1643691c44f1-kube-api-access-bg98p\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.445444 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.445421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:49.912631 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.912551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:49.921905 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.921581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:49.921905 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:49.921784    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-serving-cert: secret "maas-api-e2e-inf-b-12afdd-serving-cert" not found
Sep 18 13:58:49.921905 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:58:49.921855    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls podName:097b3363-b590-4a2e-ac05-1643691c44f1 nodeName:}" failed. No retries permitted until 2026-09-18 13:58:50.921834632 +0000 UTC m=+879.613706205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls") pod "maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" (UID: "097b3363-b590-4a2e-ac05-1643691c44f1") : secret "maas-api-e2e-inf-b-12afdd-serving-cert" not found
Sep 18 13:58:49.949710 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.949683    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:49.950509 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.950484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:49.951319 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:49.951300    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 13:58:50.009962 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.009918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:50.095642 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.093892    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"]
Sep 18 13:58:50.111659 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.109837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.115631 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.114000    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-12afdd-dockercfg-l2rmp\""
Sep 18 13:58:50.115631 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.114756    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-12afdd\""
Sep 18 13:58:50.118147 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.118077    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"]
Sep 18 13:58:50.124332 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.124305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073b9169-afb6-4a76-ad12-495b9d46ec0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.124514 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.124499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pdmr\" (UniqueName: \"kubernetes.io/projected/073b9169-afb6-4a76-ad12-495b9d46ec0d-kube-api-access-9pdmr\") pod \"payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.225510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.225477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073b9169-afb6-4a76-ad12-495b9d46ec0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.225510 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.225514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pdmr\" (UniqueName: \"kubernetes.io/projected/073b9169-afb6-4a76-ad12-495b9d46ec0d-kube-api-access-9pdmr\") pod \"payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.226465 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.226436    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073b9169-afb6-4a76-ad12-495b9d46ec0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.238630 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.237564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pdmr\" (UniqueName: \"kubernetes.io/projected/073b9169-afb6-4a76-ad12-495b9d46ec0d-kube-api-access-9pdmr\") pod \"payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.410578 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.410538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:50.425730 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.425702    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:50.577371 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.577177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:50.769694 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.767060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"]
Sep 18 13:58:50.781634 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:58:50.780910    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073b9169_afb6_4a76_ad12_495b9d46ec0d.slice/crio-e2af26eefc5467eccdae6d8f1ea543a0648da322c059e86abeee14e83f08a500 WatchSource:0}: Error finding container e2af26eefc5467eccdae6d8f1ea543a0648da322c059e86abeee14e83f08a500: Status 404 returned error can't find the container with id e2af26eefc5467eccdae6d8f1ea543a0648da322c059e86abeee14e83f08a500
Sep 18 13:58:50.931041 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.931006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:50.934011 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:50.933982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls\") pod \"maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:51.107975 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.107865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:51.340064 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.340021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:51.389466 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.389442    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"]
Sep 18 13:58:51.393137 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:58:51.393105    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097b3363_b590_4a2e_ac05_1643691c44f1.slice/crio-027a02859db0d8e913e967094f1ca60f6858b96c4fbcb9bf593eab21d6f17dca WatchSource:0}: Error finding container 027a02859db0d8e913e967094f1ca60f6858b96c4fbcb9bf593eab21d6f17dca: Status 404 returned error can't find the container with id 027a02859db0d8e913e967094f1ca60f6858b96c4fbcb9bf593eab21d6f17dca
Sep 18 13:58:51.686843 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.686790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" event={"ID":"097b3363-b590-4a2e-ac05-1643691c44f1","Type":"ContainerStarted","Data":"027a02859db0d8e913e967094f1ca60f6858b96c4fbcb9bf593eab21d6f17dca"}
Sep 18 13:58:51.688926 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.688899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk" event={"ID":"073b9169-afb6-4a76-ad12-495b9d46ec0d","Type":"ContainerStarted","Data":"0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142"}
Sep 18 13:58:51.689159 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.688939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk" event={"ID":"073b9169-afb6-4a76-ad12-495b9d46ec0d","Type":"ContainerStarted","Data":"e2af26eefc5467eccdae6d8f1ea543a0648da322c059e86abeee14e83f08a500"}
Sep 18 13:58:51.689159 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.689000    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:58:51.711792 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:51.711731    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk" podStartSLOduration=1.711711413 podStartE2EDuration="1.711711413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:51.710589912 +0000 UTC m=+880.402461507" watchObservedRunningTime="2026-09-18 13:58:51.711711413 +0000 UTC m=+880.403583009"
Sep 18 13:58:52.111803 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:52.111709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:52.355874 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:52.355825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:52.905910 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:52.905869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:53.642536 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:53.642412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:54.345102 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.345025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:54.714800 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.714770    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4674a74-b207-4102-b69e-8df2b651e74a" containerID="132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505" exitCode=0
Sep 18 13:58:54.715260 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.714849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" event={"ID":"d4674a74-b207-4102-b69e-8df2b651e74a","Type":"ContainerDied","Data":"132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505"}
Sep 18 13:58:54.715323 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.715311    2578 scope.go:117] "RemoveContainer" containerID="132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505"
Sep 18 13:58:54.716711 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.716666    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:54.716711 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.716702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" event={"ID":"097b3363-b590-4a2e-ac05-1643691c44f1","Type":"ContainerStarted","Data":"85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1"}
Sep 18 13:58:54.716878 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.716780    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:54.716878 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.716823    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:58:54.716878 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.716836    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:54.793455 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:54.793403    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" podStartSLOduration=3.238655524 podStartE2EDuration="5.793367232s" totalImagesPullingTime="2.554711708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:58:54.790203642 +0000 UTC m=+883.482075236" watchObservedRunningTime="2026-09-18 13:58:54.793367232 +0000 UTC m=+883.485238828"
Sep 18 13:58:55.299987 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.299954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:55.723911 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.723870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" event={"ID":"d4674a74-b207-4102-b69e-8df2b651e74a","Type":"ContainerStarted","Data":"0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0"}
Sep 18 13:58:55.725453 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.725430    2578 generic.go:356] "Generic (PLEG): container finished" podID="24848088-b7fd-400f-9372-21ecae63e7e5" containerID="caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4" exitCode=0
Sep 18 13:58:55.725587 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.725504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" event={"ID":"24848088-b7fd-400f-9372-21ecae63e7e5","Type":"ContainerDied","Data":"caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4"}
Sep 18 13:58:55.725936 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.725922    2578 scope.go:117] "RemoveContainer" containerID="caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4"
Sep 18 13:58:55.727082 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.727044    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:55.727189 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.727124    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:55.727189 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:55.727152    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:58:56.032115 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:56.032025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:56.153532 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:56.153494    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:58:56.154016 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:56.153991    2578 patch_prober.go:28] interesting pod/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 18 13:58:56.154236 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:56.154209    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 18 13:58:56.732333 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:56.732297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" event={"ID":"24848088-b7fd-400f-9372-21ecae63e7e5","Type":"ContainerStarted","Data":"3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b"}
Sep 18 13:58:56.961049 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:56.960994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:57.153983 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:57.153876    2578 patch_prober.go:28] interesting pod/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 18 13:58:57.153983 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:57.153944    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 18 13:58:57.369421 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:57.369381    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:58:57.370429 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:57.370390    2578 patch_prober.go:28] interesting pod/e2e-autores-13658e-openshift-default-b456f7846-hqlkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 18 13:58:57.370565 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:57.370461    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 18 13:58:57.755902 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:57.755874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:58.154666 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.154557    2578 patch_prober.go:28] interesting pod/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 18 13:58:58.154666 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.154644    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 18 13:58:58.307173 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.307140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:58.369690 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.369657    2578 patch_prober.go:28] interesting pod/e2e-autores-13658e-openshift-default-b456f7846-hqlkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 18 13:58:58.369993 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.369954    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 18 13:58:58.406447 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.406296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:58.525149 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.525117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:58.635164 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:58.635130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:59.154867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.154831    2578 patch_prober.go:28] interesting pod/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 18 13:58:59.155469 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.155426    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 18 13:58:59.369895 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.369850    2578 patch_prober.go:28] interesting pod/e2e-autores-13658e-openshift-default-b456f7846-hqlkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 18 13:58:59.370108 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.369920    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 18 13:58:59.731454 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.731417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:58:59.783823 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.783781    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"]
Sep 18 13:58:59.787039 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.787013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.793393 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.793363    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-40970f\"/\"kube-root-ca.crt\""
Sep 18 13:58:59.793674 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.793652    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-40970f\"/\"openshift-service-ca.crt\""
Sep 18 13:58:59.793819 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.793795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-40970f\"/\"simulator-w0-40970f-kserve-self-signed-certs\""
Sep 18 13:58:59.793915 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.793894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-40970f\"/\"default-dockercfg-mzr67\""
Sep 18 13:58:59.812297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.812270    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"]
Sep 18 13:58:59.820809 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.820785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-tmp-dir\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.820944 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.820815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qpcf\" (UniqueName: \"kubernetes.io/projected/f2e09651-db03-4c62-9800-94376cb7a2c6-kube-api-access-8qpcf\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.820944 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.820915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-dshm\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.821056 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.820957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-home\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.821056 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.821020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-model-cache\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.821165 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.821071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e09651-db03-4c62-9800-94376cb7a2c6-tls-certs\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.921931 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.921890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-model-cache\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.921931 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.921932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e09651-db03-4c62-9800-94376cb7a2c6-tls-certs\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.922188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.922001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-tmp-dir\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.922188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.922022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qpcf\" (UniqueName: \"kubernetes.io/projected/f2e09651-db03-4c62-9800-94376cb7a2c6-kube-api-access-8qpcf\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.922188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.922083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-dshm\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.922188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.922108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-home\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.922490 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.922469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-home\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.922696 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.922676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-tmp-dir\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.922791 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.922755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-model-cache\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.924748 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.924728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e09651-db03-4c62-9800-94376cb7a2c6-tls-certs\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.925855 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.925830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-dshm\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:58:59.932180 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:58:59.932153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qpcf\" (UniqueName: \"kubernetes.io/projected/f2e09651-db03-4c62-9800-94376cb7a2c6-kube-api-access-8qpcf\") pod \"simulator-w0-40970f-kserve-584ffcc4c9-w877s\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") " pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:59:00.079691 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.079133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:00.102513 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.102283    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:59:00.168634 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.167428    2578 patch_prober.go:28] interesting pod/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 18 13:59:00.168634 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.167520    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 18 13:59:00.372692 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.372043    2578 patch_prober.go:28] interesting pod/e2e-autores-13658e-openshift-default-b456f7846-hqlkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 18 13:59:00.372692 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.372123    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 18 13:59:00.439944 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.439917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"]
Sep 18 13:59:00.442313 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:59:00.442280    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2e09651_db03_4c62_9800_94376cb7a2c6.slice/crio-d227886d16eff18954aad675832f233165444d61dbb798bbd68e81bff4ec9337 WatchSource:0}: Error finding container d227886d16eff18954aad675832f233165444d61dbb798bbd68e81bff4ec9337: Status 404 returned error can't find the container with id d227886d16eff18954aad675832f233165444d61dbb798bbd68e81bff4ec9337
Sep 18 13:59:00.586632 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.586080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:00.731415 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.731388    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 13:59:00.757930 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.757858    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s" event={"ID":"f2e09651-db03-4c62-9800-94376cb7a2c6","Type":"ContainerStarted","Data":"d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41"}
Sep 18 13:59:00.757930 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.757921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s" event={"ID":"f2e09651-db03-4c62-9800-94376cb7a2c6","Type":"ContainerStarted","Data":"d227886d16eff18954aad675832f233165444d61dbb798bbd68e81bff4ec9337"}
Sep 18 13:59:00.833927 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:00.833874    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s" podStartSLOduration=1.833857848 podStartE2EDuration="1.833857848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:00.83216319 +0000 UTC m=+889.524034785" watchObservedRunningTime="2026-09-18 13:59:00.833857848 +0000 UTC m=+889.525729697"
Sep 18 13:59:01.168351 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:01.168246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:59:01.170353 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:01.170331    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:59:01.174994 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:01.174978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:59:01.369081 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:01.369040    2578 patch_prober.go:28] interesting pod/e2e-autores-13658e-openshift-default-b456f7846-hqlkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 18 13:59:01.369284 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:01.369113    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 18 13:59:01.480127 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:01.480079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:01.569257 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:01.569202    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:59:02.369826 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:02.369779    2578 patch_prober.go:28] interesting pod/e2e-autores-13658e-openshift-default-b456f7846-hqlkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 18 13:59:02.370329 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:02.369849    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 18 13:59:02.702255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:02.702222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 13:59:03.373270 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:03.373239    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:59:03.374350 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:03.374333    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 13:59:04.956897 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:04.956860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.045715 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.045686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.125560 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.125530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.215899 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.215780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.364932 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.364895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.397305 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.397275    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"]
Sep 18 13:59:05.397485 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.397458    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy" containerID="cri-o://0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0" gracePeriod=30
Sep 18 13:59:05.446064 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.446027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.584941 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.584833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.795869 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.795824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:05.890158 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:05.890061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:06.017550 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.017522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:06.408980 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.408942    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"]
Sep 18 13:59:06.411132 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.411110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.414071 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.414049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-850ecce6-gw-openshift-default-dockercfg-zxrf4\""
Sep 18 13:59:06.433169 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.433145    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"]
Sep 18 13:59:06.456884 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.456860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:06.487167 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g86z\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-kube-api-access-4g86z\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istiod-ca-cert\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487297 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-certs\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487369 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-podinfo\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487418 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-socket\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487418 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-credential-socket\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487482 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-envoy\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487482 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-data\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.487482 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.487477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-token\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588279 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-socket\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588279 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-credential-socket\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-envoy\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-data\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-token\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g86z\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-kube-api-access-4g86z\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istiod-ca-cert\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-certs\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588530 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-podinfo\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588945 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-socket\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588945 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-credential-socket\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.588945 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-data\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.589086 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.588975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-certs\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.589152 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.589135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istiod-ca-cert\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.591079 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.591057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-envoy\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.591195 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.591178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-podinfo\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.597861 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.597836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-token\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.597958 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.597923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g86z\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-kube-api-access-4g86z\") pod \"e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") " pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.609347 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.609327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:06.722342 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.722308    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:06.893742 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:06.893707    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:07.003877 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.003852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"]
Sep 18 13:59:07.006333 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:59:07.006305    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9cf173_eee6_489c_8dc3_5ccc7550c050.slice/crio-fd703d2178be74d477a2037464ad8d1c601866ed7e9ec952979e0699a49327ae WatchSource:0}: Error finding container fd703d2178be74d477a2037464ad8d1c601866ed7e9ec952979e0699a49327ae: Status 404 returned error can't find the container with id fd703d2178be74d477a2037464ad8d1c601866ed7e9ec952979e0699a49327ae
Sep 18 13:59:07.013050 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.013000    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:07.013424 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.013405    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:07.013493 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.013477    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:07.634851 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.634817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:07.800497 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.800453    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" event={"ID":"ea9cf173-eee6-489c-8dc3-5ccc7550c050","Type":"ContainerStarted","Data":"f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217"}
Sep 18 13:59:07.800708 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.800541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" event={"ID":"ea9cf173-eee6-489c-8dc3-5ccc7550c050","Type":"ContainerStarted","Data":"fd703d2178be74d477a2037464ad8d1c601866ed7e9ec952979e0699a49327ae"}
Sep 18 13:59:07.822255 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:07.822211    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" podStartSLOduration=1.822195171 podStartE2EDuration="1.822195171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:07.820309969 +0000 UTC m=+896.512181563" watchObservedRunningTime="2026-09-18 13:59:07.822195171 +0000 UTC m=+896.514066763"
Sep 18 13:59:08.601977 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:08.601944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:08.723036 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:08.723000    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:08.728707 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:08.728682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:08.805480 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:08.805446    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:08.806300 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:08.806282    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:09.492827 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:09.492791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:09.593807 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:09.593773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:10.102948 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.102919    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:59:10.103386 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.102966    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:59:10.115592 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.115563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:59:10.514979 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.514907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:10.634818 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.634798    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:59:10.725431 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-data\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725443    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4674a74-b207-4102-b69e-8df2b651e74a-istiod-ca-cert\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725471    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9bt7\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-kube-api-access-d9bt7\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725507    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-certs\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-istio-token\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725571 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725567    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4674a74-b207-4102-b69e-8df2b651e74a-istio-podinfo\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725832 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725639    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-credential-socket\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725832 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725665    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-socket\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725832 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725711    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:10.725832 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-envoy\") pod \"d4674a74-b207-4102-b69e-8df2b651e74a\" (UID: \"d4674a74-b207-4102-b69e-8df2b651e74a\") "
Sep 18 13:59:10.725832 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725805    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:10.726026 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.725872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4674a74-b207-4102-b69e-8df2b651e74a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:59:10.726026 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.726008    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:10.726147 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.726123    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:10.726278 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.726258    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.726278 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.726285    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4674a74-b207-4102-b69e-8df2b651e74a-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.726374 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.726299    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.726374 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.726313    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.726374 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.726327    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.728033 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.728001    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:59:10.728277 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.728250    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-kube-api-access-d9bt7" (OuterVolumeSpecName: "kube-api-access-d9bt7") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "kube-api-access-d9bt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:59:10.728542 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.728517    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:10.728542 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.728530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4674a74-b207-4102-b69e-8df2b651e74a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4674a74-b207-4102-b69e-8df2b651e74a" (UID: "d4674a74-b207-4102-b69e-8df2b651e74a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 13:59:10.817075 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.817047    2578 generic.go:356] "Generic (PLEG): container finished" podID="d4674a74-b207-4102-b69e-8df2b651e74a" containerID="0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0" exitCode=0
Sep 18 13:59:10.817202 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.817104    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"
Sep 18 13:59:10.817202 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.817130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" event={"ID":"d4674a74-b207-4102-b69e-8df2b651e74a","Type":"ContainerDied","Data":"0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0"}
Sep 18 13:59:10.817202 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.817190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv" event={"ID":"d4674a74-b207-4102-b69e-8df2b651e74a","Type":"ContainerDied","Data":"e196720f5baff73e595c1f5f6d0f2c5398fa5f6889d30e904eacc9c69054153c"}
Sep 18 13:59:10.817310 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.817215    2578 scope.go:117] "RemoveContainer" containerID="0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0"
Sep 18 13:59:10.826377 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.826361    2578 scope.go:117] "RemoveContainer" containerID="132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505"
Sep 18 13:59:10.826804 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.826780    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9bt7\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-kube-api-access-d9bt7\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.826913 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.826809    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4674a74-b207-4102-b69e-8df2b651e74a-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.826913 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.826825    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4674a74-b207-4102-b69e-8df2b651e74a-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.826913 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.826839    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4674a74-b207-4102-b69e-8df2b651e74a-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:10.830244 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.830223    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 13:59:10.834803 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.834787    2578 scope.go:117] "RemoveContainer" containerID="0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0"
Sep 18 13:59:10.835065 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:59:10.835050    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0\": container with ID starting with 0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0 not found: ID does not exist" containerID="0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0"
Sep 18 13:59:10.835111 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.835072    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0"} err="failed to get container status \"0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0\": rpc error: code = NotFound desc = could not find container \"0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0\": container with ID starting with 0b1549b2fbfe23b2fe22af6a1ecf0f127f4b44b347b9636193be31fccbacc8c0 not found: ID does not exist"
Sep 18 13:59:10.835111 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.835087    2578 scope.go:117] "RemoveContainer" containerID="132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505"
Sep 18 13:59:10.835337 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:59:10.835319    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505\": container with ID starting with 132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505 not found: ID does not exist" containerID="132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505"
Sep 18 13:59:10.835389 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.835341    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505"} err="failed to get container status \"132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505\": rpc error: code = NotFound desc = could not find container \"132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505\": container with ID starting with 132c8a003a118f32ee1473db1fb0038415abfb08f973414cfc9cbbee0472b505 not found: ID does not exist"
Sep 18 13:59:10.841272 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.841252    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"]
Sep 18 13:59:10.851706 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:10.849754    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-57fc5a8f-openshift-default-568ff6c57d-klgbv"]
Sep 18 13:59:11.611757 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:11.611727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:11.735107 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:11.735071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:11.809163 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:11.809129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:11.850796 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:11.850769    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" path="/var/lib/kubelet/pods/d4674a74-b207-4102-b69e-8df2b651e74a/volumes"
Sep 18 13:59:12.148683 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.148652    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:12.248978 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.248948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:12.269299 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.269266    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"]
Sep 18 13:59:12.269685 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.269668    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy"
Sep 18 13:59:12.269799 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.269687    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy"
Sep 18 13:59:12.269873 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.269797    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy"
Sep 18 13:59:12.269873 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.269813    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy"
Sep 18 13:59:12.272507 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.272487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.275261 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.275240    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-850ecce6\""
Sep 18 13:59:12.275350 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.275313    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-850ecce6-dockercfg-m86d2\""
Sep 18 13:59:12.284087 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.284064    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"]
Sep 18 13:59:12.338355 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.338333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8869fc0-ba7a-41d8-a9ff-0964215a7900-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.338466 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.338385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92v8q\" (UniqueName: \"kubernetes.io/projected/c8869fc0-ba7a-41d8-a9ff-0964215a7900-kube-api-access-92v8q\") pod \"payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.439527 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.439502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8869fc0-ba7a-41d8-a9ff-0964215a7900-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.439696 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.439563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92v8q\" (UniqueName: \"kubernetes.io/projected/c8869fc0-ba7a-41d8-a9ff-0964215a7900-kube-api-access-92v8q\") pod \"payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.440200 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.440181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8869fc0-ba7a-41d8-a9ff-0964215a7900-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.448424 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.448395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92v8q\" (UniqueName: \"kubernetes.io/projected/c8869fc0-ba7a-41d8-a9ff-0964215a7900-kube-api-access-92v8q\") pod \"payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.583734 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.583703    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:12.604066 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.604041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:12.707170 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.707087    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:12.805861 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.805796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:12.858557 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:12.858532    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"]
Sep 18 13:59:12.860340 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:59:12.860317    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8869fc0_ba7a_41d8_a9ff_0964215a7900.slice/crio-31278c7e2d81b748db722f49ec966e8d2a52ff0486cee84d7a0f0d9c217e403e WatchSource:0}: Error finding container 31278c7e2d81b748db722f49ec966e8d2a52ff0486cee84d7a0f0d9c217e403e: Status 404 returned error can't find the container with id 31278c7e2d81b748db722f49ec966e8d2a52ff0486cee84d7a0f0d9c217e403e
Sep 18 13:59:13.348819 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:13.348787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:13.834126 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:13.834090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44" event={"ID":"c8869fc0-ba7a-41d8-a9ff-0964215a7900","Type":"ContainerStarted","Data":"2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19"}
Sep 18 13:59:13.834516 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:13.834149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44" event={"ID":"c8869fc0-ba7a-41d8-a9ff-0964215a7900","Type":"ContainerStarted","Data":"31278c7e2d81b748db722f49ec966e8d2a52ff0486cee84d7a0f0d9c217e403e"}
Sep 18 13:59:13.834516 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:13.834270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:13.853352 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:13.853289    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44" podStartSLOduration=1.8532677469999999 podStartE2EDuration="1.853267747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:59:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:13.851924244 +0000 UTC m=+902.543795842" watchObservedRunningTime="2026-09-18 13:59:13.853267747 +0000 UTC m=+902.545139341"
Sep 18 13:59:14.225739 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:14.225700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:14.946489 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:14.946456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:15.814405 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:15.814354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:16.531968 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:16.531931    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:24.840188 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:24.840157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:27.920226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:27.920192    2578 generic.go:356] "Generic (PLEG): container finished" podID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerID="f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217" exitCode=0
Sep 18 13:59:27.920781 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:27.920272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" event={"ID":"ea9cf173-eee6-489c-8dc3-5ccc7550c050","Type":"ContainerDied","Data":"f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217"}
Sep 18 13:59:27.920882 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:27.920864    2578 scope.go:117] "RemoveContainer" containerID="f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217"
Sep 18 13:59:27.922069 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:27.922040    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:27.922154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:27.922107    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:27.922154 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:27.922138    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 13:59:28.927427 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:28.927393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" event={"ID":"ea9cf173-eee6-489c-8dc3-5ccc7550c050","Type":"ContainerStarted","Data":"841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1"}
Sep 18 13:59:29.723185 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:29.723152    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:29.723533 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:29.723511    2578 patch_prober.go:28] interesting pod/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 13:59:29.723590 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:29.723557    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 13:59:30.723503 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:30.723468    2578 patch_prober.go:28] interesting pod/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 13:59:30.723925 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:30.723522    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 13:59:31.722953 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:31.722916    2578 patch_prober.go:28] interesting pod/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 13:59:31.723133 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:31.722972    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 13:59:32.723168 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:32.723129    2578 patch_prober.go:28] interesting pod/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 13:59:32.723635 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:32.723183    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 13:59:33.722850 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.722810    2578 patch_prober.go:28] interesting pod/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 13:59:33.723045 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.722884    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 13:59:33.783676 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.781130    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"]
Sep 18 13:59:33.783676 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.781778    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy"
Sep 18 13:59:33.783676 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.781815    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4674a74-b207-4102-b69e-8df2b651e74a" containerName="istio-proxy"
Sep 18 13:59:33.785166 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.785141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.788275 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.788245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:33.789713 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.789692    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"openshift-service-ca.crt\""
Sep 18 13:59:33.789827 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.789724    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"kube-root-ca.crt\""
Sep 18 13:59:33.789827 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.789692    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"default-dockercfg-hzkhc\""
Sep 18 13:59:33.789827 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.789783    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"simulator-w4-a02b2c-kserve-self-signed-certs\""
Sep 18 13:59:33.799007 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.798982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"]
Sep 18 13:59:33.835924 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.835901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18cdac-2015-4426-9238-97fe10262ef4-tls-certs\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.836042 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.835930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8gh\" (UniqueName: \"kubernetes.io/projected/0d18cdac-2015-4426-9238-97fe10262ef4-kube-api-access-6s8gh\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.836042 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.835951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-dshm\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.836042 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.835989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-model-cache\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.836176 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.836096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-tmp-dir\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.836176 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.836155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-home\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.896984 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.896946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:33.937355 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.937322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18cdac-2015-4426-9238-97fe10262ef4-tls-certs\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.937726 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.937370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8gh\" (UniqueName: \"kubernetes.io/projected/0d18cdac-2015-4426-9238-97fe10262ef4-kube-api-access-6s8gh\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.937726 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.937404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-dshm\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.937726 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.937470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-model-cache\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.937726 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.937516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-tmp-dir\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.937726 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.937589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-home\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.938039 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.938006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-home\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.938289 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.938240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-tmp-dir\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.938822 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.938797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-model-cache\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.940358 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.940335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-dshm\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.940460 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.940376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18cdac-2015-4426-9238-97fe10262ef4-tls-certs\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:33.948480 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:33.948424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8gh\" (UniqueName: \"kubernetes.io/projected/0d18cdac-2015-4426-9238-97fe10262ef4-kube-api-access-6s8gh\") pod \"simulator-w4-a02b2c-kserve-6f56764d5f-h59fg\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") " pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:34.095500 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.095401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:34.380230 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.380202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"]
Sep 18 13:59:34.382077 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:59:34.382046    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d18cdac_2015_4426_9238_97fe10262ef4.slice/crio-f250f780700f50d5fbe660d409a9c13f2b2817562018eb179eba60c18a369923 WatchSource:0}: Error finding container f250f780700f50d5fbe660d409a9c13f2b2817562018eb179eba60c18a369923: Status 404 returned error can't find the container with id f250f780700f50d5fbe660d409a9c13f2b2817562018eb179eba60c18a369923
Sep 18 13:59:34.641593 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.641508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:34.726625 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.726587    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:34.726905 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.726876    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:34.727519 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.727501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:34.967381 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.967344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg" event={"ID":"0d18cdac-2015-4426-9238-97fe10262ef4","Type":"ContainerStarted","Data":"381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021"}
Sep 18 13:59:34.967867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.967394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg" event={"ID":"0d18cdac-2015-4426-9238-97fe10262ef4","Type":"ContainerStarted","Data":"f250f780700f50d5fbe660d409a9c13f2b2817562018eb179eba60c18a369923"}
Sep 18 13:59:34.986755 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:34.986710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg" podStartSLOduration=1.986693581 podStartE2EDuration="1.986693581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:34.985537821 +0000 UTC m=+923.677409419" watchObservedRunningTime="2026-09-18 13:59:34.986693581 +0000 UTC m=+923.678565178"
Sep 18 13:59:35.616994 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:35.616963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:36.328450 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:36.328407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:37.127258 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:37.127221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:37.843570 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:37.843510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:38.716575 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:38.716535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:39.645326 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:39.645258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:40.693685 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:40.693233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:41.335409 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.335363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:41.371648 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.371588    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"]
Sep 18 13:59:41.371881 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.371832    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44" podUID="c8869fc0-ba7a-41d8-a9ff-0964215a7900" containerName="payload-pre-processing" containerID="cri-o://2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19" gracePeriod=30
Sep 18 13:59:41.435156 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.435123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:41.535726 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.535692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:41.626268 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.626239    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:41.637943 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.637905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:41.678079 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.678051    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"]
Sep 18 13:59:41.678283 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.678257    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy" containerID="cri-o://841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1" gracePeriod=30
Sep 18 13:59:41.705165 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.705140    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8869fc0-ba7a-41d8-a9ff-0964215a7900-plugins-config-volume\") pod \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") "
Sep 18 13:59:41.705488 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.705226    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92v8q\" (UniqueName: \"kubernetes.io/projected/c8869fc0-ba7a-41d8-a9ff-0964215a7900-kube-api-access-92v8q\") pod \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\" (UID: \"c8869fc0-ba7a-41d8-a9ff-0964215a7900\") "
Sep 18 13:59:41.705488 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.705473    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8869fc0-ba7a-41d8-a9ff-0964215a7900-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c8869fc0-ba7a-41d8-a9ff-0964215a7900" (UID: "c8869fc0-ba7a-41d8-a9ff-0964215a7900"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:59:41.707401 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.707370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8869fc0-ba7a-41d8-a9ff-0964215a7900-kube-api-access-92v8q" (OuterVolumeSpecName: "kube-api-access-92v8q") pod "c8869fc0-ba7a-41d8-a9ff-0964215a7900" (UID: "c8869fc0-ba7a-41d8-a9ff-0964215a7900"). InnerVolumeSpecName "kube-api-access-92v8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:59:41.721111 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.721084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:41.806354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.806322    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92v8q\" (UniqueName: \"kubernetes.io/projected/c8869fc0-ba7a-41d8-a9ff-0964215a7900-kube-api-access-92v8q\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:41.806354 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:41.806349    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8869fc0-ba7a-41d8-a9ff-0964215a7900-plugins-config-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:42.005004 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.004966    2578 generic.go:356] "Generic (PLEG): container finished" podID="c8869fc0-ba7a-41d8-a9ff-0964215a7900" containerID="2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19" exitCode=0
Sep 18 13:59:42.005004 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.005005    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"
Sep 18 13:59:42.005235 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.005044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44" event={"ID":"c8869fc0-ba7a-41d8-a9ff-0964215a7900","Type":"ContainerDied","Data":"2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19"}
Sep 18 13:59:42.005235 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.005086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44" event={"ID":"c8869fc0-ba7a-41d8-a9ff-0964215a7900","Type":"ContainerDied","Data":"31278c7e2d81b748db722f49ec966e8d2a52ff0486cee84d7a0f0d9c217e403e"}
Sep 18 13:59:42.005235 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.005110    2578 scope.go:117] "RemoveContainer" containerID="2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19"
Sep 18 13:59:42.013435 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.013409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:42.016012 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.015989    2578 scope.go:117] "RemoveContainer" containerID="2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19"
Sep 18 13:59:42.016230 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:59:42.016208    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19\": container with ID starting with 2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19 not found: ID does not exist" containerID="2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19"
Sep 18 13:59:42.016283 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.016242    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19"} err="failed to get container status \"2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19\": rpc error: code = NotFound desc = could not find container \"2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19\": container with ID starting with 2f5488ab3e050ce81603eb603b41af2e3102ba9f2f08cc7b6d542297f3365d19 not found: ID does not exist"
Sep 18 13:59:42.023332 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.023309    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"]
Sep 18 13:59:42.026345 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.026317    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-850ecce6-d6459965d-wvb44"]
Sep 18 13:59:42.121652 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.121544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:42.438238 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.438205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:42.689347 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.689271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:42.930686 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:42.930656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:43.816423 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:43.816376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:43.850432 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:43.850399    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8869fc0-ba7a-41d8-a9ff-0964215a7900" path="/var/lib/kubelet/pods/c8869fc0-ba7a-41d8-a9ff-0964215a7900/volumes"
Sep 18 13:59:44.096525 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:44.096431    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:44.096934 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:44.096523    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:44.108986 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:44.108955    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:44.674648 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:44.674592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:44.757372 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:44.757338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:44.835222 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:44.835181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:45.033346 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:45.033312    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 13:59:45.924319 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:45.924265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:46.773030 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:46.773000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:46.939908 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:46.939845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:47.032575 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.032545    2578 generic.go:356] "Generic (PLEG): container finished" podID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerID="841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1" exitCode=0
Sep 18 13:59:47.032765 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.032600    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"
Sep 18 13:59:47.032765 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.032648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" event={"ID":"ea9cf173-eee6-489c-8dc3-5ccc7550c050","Type":"ContainerDied","Data":"841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1"}
Sep 18 13:59:47.032765 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.032714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6" event={"ID":"ea9cf173-eee6-489c-8dc3-5ccc7550c050","Type":"ContainerDied","Data":"fd703d2178be74d477a2037464ad8d1c601866ed7e9ec952979e0699a49327ae"}
Sep 18 13:59:47.032765 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.032743    2578 scope.go:117] "RemoveContainer" containerID="841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1"
Sep 18 13:59:47.043594 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.043575    2578 scope.go:117] "RemoveContainer" containerID="f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217"
Sep 18 13:59:47.051406 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.051391    2578 scope.go:117] "RemoveContainer" containerID="841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1"
Sep 18 13:59:47.051684 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:59:47.051666    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1\": container with ID starting with 841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1 not found: ID does not exist" containerID="841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1"
Sep 18 13:59:47.051760 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.051691    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1"} err="failed to get container status \"841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1\": rpc error: code = NotFound desc = could not find container \"841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1\": container with ID starting with 841fcfeabc84f7dffa58fd735b17cf54df61ab0ca5cbceab6bca8e0e1f0607d1 not found: ID does not exist"
Sep 18 13:59:47.051760 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.051708    2578 scope.go:117] "RemoveContainer" containerID="f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217"
Sep 18 13:59:47.051939 ip-10-0-132-244 kubenswrapper[2578]: E0918 13:59:47.051923    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217\": container with ID starting with f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217 not found: ID does not exist" containerID="f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217"
Sep 18 13:59:47.051995 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.051941    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217"} err="failed to get container status \"f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217\": rpc error: code = NotFound desc = could not find container \"f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217\": container with ID starting with f11cf01b69eb587c6399355fe3bccb2ad0adcab49f5d2fd80ccba310bf2a2217 not found: ID does not exist"
Sep 18 13:59:47.053181 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053165    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-envoy\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053223 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053205    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-token\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053279 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053226    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-podinfo\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053279 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053269    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istiod-ca-cert\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053385 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053286    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-certs\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053385 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053306    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-credential-socket\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053520 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053441    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-data\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053520 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053478    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g86z\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-kube-api-access-4g86z\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053649 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-socket\") pod \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\" (UID: \"ea9cf173-eee6-489c-8dc3-5ccc7550c050\") "
Sep 18 13:59:47.053649 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053627    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:47.053649 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053631    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:47.053815 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 13:59:47.053876 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053841    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:47.053876 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053857    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:47.054151 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053933    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.054151 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053946    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.054151 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053956    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.054151 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053964    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.054151 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.053974    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.055639 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.055590    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 13:59:47.055742 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.055678    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:59:47.055802 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.055783    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 13:59:47.055867 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.055848    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-kube-api-access-4g86z" (OuterVolumeSpecName: "kube-api-access-4g86z") pod "ea9cf173-eee6-489c-8dc3-5ccc7550c050" (UID: "ea9cf173-eee6-489c-8dc3-5ccc7550c050"). InnerVolumeSpecName "kube-api-access-4g86z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 13:59:47.154937 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.154905    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.154937 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.154933    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.154937 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.154944    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9cf173-eee6-489c-8dc3-5ccc7550c050-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.155209 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.154955    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g86z\" (UniqueName: \"kubernetes.io/projected/ea9cf173-eee6-489c-8dc3-5ccc7550c050-kube-api-access-4g86z\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 13:59:47.363090 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.363059    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"]
Sep 18 13:59:47.367226 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.367203    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-850ecce6-gw-openshift-default-94f6d6f56-4kdh6"]
Sep 18 13:59:47.851842 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.851807    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" path="/var/lib/kubelet/pods/ea9cf173-eee6-489c-8dc3-5ccc7550c050/volumes"
Sep 18 13:59:47.878727 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.878688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:47.991356 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:47.991312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:48.433407 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.433371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:48.533271 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.533209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:48.565413 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565389    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"]
Sep 18 13:59:48.565764 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565752    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy"
Sep 18 13:59:48.565812 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565766    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy"
Sep 18 13:59:48.565812 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565787    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8869fc0-ba7a-41d8-a9ff-0964215a7900" containerName="payload-pre-processing"
Sep 18 13:59:48.565812 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565792    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8869fc0-ba7a-41d8-a9ff-0964215a7900" containerName="payload-pre-processing"
Sep 18 13:59:48.565954 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565850    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy"
Sep 18 13:59:48.565954 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565858    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy"
Sep 18 13:59:48.565954 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.565866    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8869fc0-ba7a-41d8-a9ff-0964215a7900" containerName="payload-pre-processing"
Sep 18 13:59:48.570577 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.570557    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:48.573755 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.573733    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8a84bc4e-dockercfg-sxm8x\""
Sep 18 13:59:48.573880 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.573739    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8a84bc4e\""
Sep 18 13:59:48.583922 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.583900    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"]
Sep 18 13:59:48.669501 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.669466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") " pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:48.669683 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.669659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qshkh\" (UniqueName: \"kubernetes.io/projected/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-kube-api-access-qshkh\") pod \"payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") " pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:48.770662 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.770571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qshkh\" (UniqueName: \"kubernetes.io/projected/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-kube-api-access-qshkh\") pod \"payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") " pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:48.770798 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.770669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") " pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:48.771353 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.771333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-plugins-config-volume\") pod \"payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") " pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:48.782488 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.782457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qshkh\" (UniqueName: \"kubernetes.io/projected/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-kube-api-access-qshkh\") pod \"payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") " pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:48.881363 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:48.881339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:49.159370 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:49.159348    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"]
Sep 18 13:59:49.161249 ip-10-0-132-244 kubenswrapper[2578]: W0918 13:59:49.161219    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14c92e7_d959_49e0_aa3f_85d2a57e8bc0.slice/crio-d5fbeab02bbbfde1889120ecf69c90e14f2e1003d7850f2598758fee3176522a WatchSource:0}: Error finding container d5fbeab02bbbfde1889120ecf69c90e14f2e1003d7850f2598758fee3176522a: Status 404 returned error can't find the container with id d5fbeab02bbbfde1889120ecf69c90e14f2e1003d7850f2598758fee3176522a
Sep 18 13:59:49.239563 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:49.239538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:50.050164 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:50.050116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:50.050379 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:50.050193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66" event={"ID":"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0","Type":"ContainerStarted","Data":"570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef"}
Sep 18 13:59:50.050379 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:50.050245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66" event={"ID":"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0","Type":"ContainerStarted","Data":"d5fbeab02bbbfde1889120ecf69c90e14f2e1003d7850f2598758fee3176522a"}
Sep 18 13:59:50.050485 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:50.050402    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 13:59:50.072427 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:50.072380    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66" podStartSLOduration=2.072365592 podStartE2EDuration="2.072365592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 13:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 13:59:50.071778854 +0000 UTC m=+938.763650449" watchObservedRunningTime="2026-09-18 13:59:50.072365592 +0000 UTC m=+938.764237231"
Sep 18 13:59:50.987004 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:50.986971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:51.822499 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:51.822467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 13:59:52.550381 ip-10-0-132-244 kubenswrapper[2578]: I0918 13:59:52.550333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:00.189499 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.189463    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"]
Sep 18 14:00:00.190083 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.190064    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy"
Sep 18 14:00:00.190126 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.190088    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9cf173-eee6-489c-8dc3-5ccc7550c050" containerName="istio-proxy"
Sep 18 14:00:00.193853 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.193836    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"]
Sep 18 14:00:00.193970 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.193954    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"
Sep 18 14:00:00.197161 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.197140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"
Sep 18 14:00:00.197429 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.197413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:00:00.204530 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.204508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"
Sep 18 14:00:00.213458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.213439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"
Sep 18 14:00:00.214570 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.214552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"]
Sep 18 14:00:00.227529 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.227495    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"]
Sep 18 14:00:00.244851 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.244821    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"]
Sep 18 14:00:00.249808 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.249788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"
Sep 18 14:00:00.261117 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.260938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"
Sep 18 14:00:00.267647 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.267247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"]
Sep 18 14:00:00.503732 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.503661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"]
Sep 18 14:00:00.505957 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:00:00.505932    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd99fc3_295b_473c_a0c6_266fff46d3ad.slice/crio-2e6ce220a0d9ce595afc9d19dfa81d4799d69e71f2c821f169b6817fb641d8d7 WatchSource:0}: Error finding container 2e6ce220a0d9ce595afc9d19dfa81d4799d69e71f2c821f169b6817fb641d8d7: Status 404 returned error can't find the container with id 2e6ce220a0d9ce595afc9d19dfa81d4799d69e71f2c821f169b6817fb641d8d7
Sep 18 14:00:00.509785 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.509724    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"]
Sep 18 14:00:00.511628 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:00:00.511588    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ea85b9_1a38_4739_a602_9d6132a3d597.slice/crio-b04541bdae4541b3c932b7b48a0db372e9aa59904e666fdf4ab87cfdbafd3051 WatchSource:0}: Error finding container b04541bdae4541b3c932b7b48a0db372e9aa59904e666fdf4ab87cfdbafd3051: Status 404 returned error can't find the container with id b04541bdae4541b3c932b7b48a0db372e9aa59904e666fdf4ab87cfdbafd3051
Sep 18 14:00:00.556355 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:00.556337    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"]
Sep 18 14:00:00.558043 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:00:00.558021    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93417303_0ad4_4733_a609_c429c0da88ba.slice/crio-9270fd91ec5f0dbcd7c6e9b0c2ac8ccb69d1d7a18023f4d53c016144b0f01b26 WatchSource:0}: Error finding container 9270fd91ec5f0dbcd7c6e9b0c2ac8ccb69d1d7a18023f4d53c016144b0f01b26: Status 404 returned error can't find the container with id 9270fd91ec5f0dbcd7c6e9b0c2ac8ccb69d1d7a18023f4d53c016144b0f01b26
Sep 18 14:00:01.058272 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:01.058245    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 14:00:01.103734 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:01.103699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq" event={"ID":"7cd99fc3-295b-473c-a0c6-266fff46d3ad","Type":"ContainerStarted","Data":"2e6ce220a0d9ce595afc9d19dfa81d4799d69e71f2c821f169b6817fb641d8d7"}
Sep 18 14:00:01.105123 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:01.105098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k" event={"ID":"f5ea85b9-1a38-4739-a602-9d6132a3d597","Type":"ContainerStarted","Data":"b04541bdae4541b3c932b7b48a0db372e9aa59904e666fdf4ab87cfdbafd3051"}
Sep 18 14:00:01.106270 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:01.106250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v" event={"ID":"93417303-0ad4-4733-a609-c429c0da88ba","Type":"ContainerStarted","Data":"9270fd91ec5f0dbcd7c6e9b0c2ac8ccb69d1d7a18023f4d53c016144b0f01b26"}
Sep 18 14:00:04.126134 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:04.126094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq" event={"ID":"7cd99fc3-295b-473c-a0c6-266fff46d3ad","Type":"ContainerStarted","Data":"f712a1d7dd11c7be1041c195a62c26ddfc0bc637eef1dbe625c0f8a48cce4d51"}
Sep 18 14:00:04.127814 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:04.127788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k" event={"ID":"f5ea85b9-1a38-4739-a602-9d6132a3d597","Type":"ContainerStarted","Data":"04d05c5e56c23af9d879bd1c7d9dd25e92cc81cca0cdeacdddd3f7d80bf54ce1"}
Sep 18 14:00:04.129244 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:04.129221    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v" event={"ID":"93417303-0ad4-4733-a609-c429c0da88ba","Type":"ContainerStarted","Data":"be678b6bd9d81dfef0e6149910761d07acbbba368c11fc9a262e58203b809b28"}
Sep 18 14:00:04.153629 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:04.152964    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq" podStartSLOduration=1.3535782840000001 podStartE2EDuration="4.152944014s" totalImagesPullingTime="2.79936573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:04.152021928 +0000 UTC m=+952.843893524" watchObservedRunningTime="2026-09-18 14:00:04.152944014 +0000 UTC m=+952.844815610"
Sep 18 14:00:04.170793 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:04.170742    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k" podStartSLOduration=1.375982555 podStartE2EDuration="4.17072402s" totalImagesPullingTime="2.794741465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:04.169727382 +0000 UTC m=+952.861598977" watchObservedRunningTime="2026-09-18 14:00:04.17072402 +0000 UTC m=+952.862595614"
Sep 18 14:00:04.185250 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:04.185206    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v" podStartSLOduration=1.441367258 podStartE2EDuration="4.185190021s" totalImagesPullingTime="2.743822763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:04.184896733 +0000 UTC m=+952.876768332" watchObservedRunningTime="2026-09-18 14:00:04.185190021 +0000 UTC m=+952.877061616"
Sep 18 14:00:04.377753 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:00:04.377690    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd99fc3_295b_473c_a0c6_266fff46d3ad.slice/crio-f712a1d7dd11c7be1041c195a62c26ddfc0bc637eef1dbe625c0f8a48cce4d51.scope\": RecentStats: unable to find data in memory cache]"
Sep 18 14:00:05.136474 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:05.136443    2578 generic.go:356] "Generic (PLEG): container finished" podID="7cd99fc3-295b-473c-a0c6-266fff46d3ad" containerID="f712a1d7dd11c7be1041c195a62c26ddfc0bc637eef1dbe625c0f8a48cce4d51" exitCode=0
Sep 18 14:00:05.136963 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:05.136520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq" event={"ID":"7cd99fc3-295b-473c-a0c6-266fff46d3ad","Type":"ContainerDied","Data":"f712a1d7dd11c7be1041c195a62c26ddfc0bc637eef1dbe625c0f8a48cce4d51"}
Sep 18 14:00:05.138095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:05.138070    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5ea85b9-1a38-4739-a602-9d6132a3d597" containerID="04d05c5e56c23af9d879bd1c7d9dd25e92cc81cca0cdeacdddd3f7d80bf54ce1" exitCode=0
Sep 18 14:00:05.138204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:05.138137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k" event={"ID":"f5ea85b9-1a38-4739-a602-9d6132a3d597","Type":"ContainerDied","Data":"04d05c5e56c23af9d879bd1c7d9dd25e92cc81cca0cdeacdddd3f7d80bf54ce1"}
Sep 18 14:00:05.139691 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:05.139671    2578 generic.go:356] "Generic (PLEG): container finished" podID="93417303-0ad4-4733-a609-c429c0da88ba" containerID="be678b6bd9d81dfef0e6149910761d07acbbba368c11fc9a262e58203b809b28" exitCode=0
Sep 18 14:00:05.139766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:05.139738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v" event={"ID":"93417303-0ad4-4733-a609-c429c0da88ba","Type":"ContainerDied","Data":"be678b6bd9d81dfef0e6149910761d07acbbba368c11fc9a262e58203b809b28"}
Sep 18 14:00:06.285907 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:06.285874    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"
Sep 18 14:00:06.342156 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:06.342136    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"
Sep 18 14:00:06.345056 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:06.345039    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"
Sep 18 14:00:07.151165 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.151135    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"
Sep 18 14:00:07.151363 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.151133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq" event={"ID":"7cd99fc3-295b-473c-a0c6-266fff46d3ad","Type":"ContainerDied","Data":"2e6ce220a0d9ce595afc9d19dfa81d4799d69e71f2c821f169b6817fb641d8d7"}
Sep 18 14:00:07.151363 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.151236    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e6ce220a0d9ce595afc9d19dfa81d4799d69e71f2c821f169b6817fb641d8d7"
Sep 18 14:00:07.152642 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.152620    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"
Sep 18 14:00:07.152777 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.152656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k" event={"ID":"f5ea85b9-1a38-4739-a602-9d6132a3d597","Type":"ContainerDied","Data":"b04541bdae4541b3c932b7b48a0db372e9aa59904e666fdf4ab87cfdbafd3051"}
Sep 18 14:00:07.152777 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.152707    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b04541bdae4541b3c932b7b48a0db372e9aa59904e666fdf4ab87cfdbafd3051"
Sep 18 14:00:07.154127 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.154102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v" event={"ID":"93417303-0ad4-4733-a609-c429c0da88ba","Type":"ContainerDied","Data":"9270fd91ec5f0dbcd7c6e9b0c2ac8ccb69d1d7a18023f4d53c016144b0f01b26"}
Sep 18 14:00:07.154238 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.154137    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"
Sep 18 14:00:07.154238 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:07.154148    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9270fd91ec5f0dbcd7c6e9b0c2ac8ccb69d1d7a18023f4d53c016144b0f01b26"
Sep 18 14:00:08.990505 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:08.990471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:10.616496 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:10.616462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:11.517972 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:11.517936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:12.263205 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:12.263170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:12.980792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:12.980745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:13.929481 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:13.929440    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:14.797284 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:14.797254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:15.524551 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:15.524517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:16.223107 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:16.223073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:17.379697 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.379660    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"]
Sep 18 14:00:17.380262 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380240    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93417303-0ad4-4733-a609-c429c0da88ba" containerName="cleanup"
Sep 18 14:00:17.380352 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380265    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="93417303-0ad4-4733-a609-c429c0da88ba" containerName="cleanup"
Sep 18 14:00:17.380352 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380300    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd99fc3-295b-473c-a0c6-266fff46d3ad" containerName="cleanup"
Sep 18 14:00:17.380352 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380309    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd99fc3-295b-473c-a0c6-266fff46d3ad" containerName="cleanup"
Sep 18 14:00:17.380352 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380321    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ea85b9-1a38-4739-a602-9d6132a3d597" containerName="cleanup"
Sep 18 14:00:17.380352 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380330    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ea85b9-1a38-4739-a602-9d6132a3d597" containerName="cleanup"
Sep 18 14:00:17.380601 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380429    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd99fc3-295b-473c-a0c6-266fff46d3ad" containerName="cleanup"
Sep 18 14:00:17.380601 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380441    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="93417303-0ad4-4733-a609-c429c0da88ba" containerName="cleanup"
Sep 18 14:00:17.380601 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.380456    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5ea85b9-1a38-4739-a602-9d6132a3d597" containerName="cleanup"
Sep 18 14:00:17.384919 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.384897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.390406 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.390386    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-13658e\"/\"autores-model-13658e-kserve-self-signed-certs\""
Sep 18 14:00:17.391020 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.391001    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-13658e\"/\"kube-root-ca.crt\""
Sep 18 14:00:17.391145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.391001    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-13658e\"/\"default-dockercfg-jjjsq\""
Sep 18 14:00:17.391145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.391019    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-13658e\"/\"openshift-service-ca.crt\""
Sep 18 14:00:17.400450 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.400430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"]
Sep 18 14:00:17.432580 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.432550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-home\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.432580 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.432585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzsmm\" (UniqueName: \"kubernetes.io/projected/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-kube-api-access-qzsmm\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.432791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.432669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tmp-dir\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.432791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.432691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tls-certs\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.432791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.432714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-model-cache\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.432791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.432755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-dshm\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.533928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.533894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzsmm\" (UniqueName: \"kubernetes.io/projected/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-kube-api-access-qzsmm\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.533965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tmp-dir\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.533993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tls-certs\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.534016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-model-cache\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.534086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-dshm\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534315 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.534126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-home\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534466 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.534445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tmp-dir\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534524 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.534461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-home\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.534524 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.534503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-model-cache\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.536408 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.536389    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-dshm\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.536675 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.536658    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tls-certs\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.558383 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.558356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzsmm\" (UniqueName: \"kubernetes.io/projected/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-kube-api-access-qzsmm\") pod \"autores-model-13658e-kserve-65bdfbf6c5-hchzv\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") " pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.588485 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.588449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:17.682020 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.681943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:17.694204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.694177    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:17.844683 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.844643    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:17.966983 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:17.966954    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"]
Sep 18 14:00:17.969985 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:00:17.969959    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5db3ff97_fa11_42d1_a78a_a6e0164d50d8.slice/crio-615e8c6cf70f67cd90b8f95b5ce0e6017282c0feb384d04b7bd03789c663bdca WatchSource:0}: Error finding container 615e8c6cf70f67cd90b8f95b5ce0e6017282c0feb384d04b7bd03789c663bdca: Status 404 returned error can't find the container with id 615e8c6cf70f67cd90b8f95b5ce0e6017282c0feb384d04b7bd03789c663bdca
Sep 18 14:00:18.208936 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:18.208907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv" event={"ID":"5db3ff97-fa11-42d1-a78a-a6e0164d50d8","Type":"ContainerStarted","Data":"3f85fae1931b7ab82e51406b48dec139365bf533369e7f79c94204470ed38a64"}
Sep 18 14:00:18.209094 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:18.208944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv" event={"ID":"5db3ff97-fa11-42d1-a78a-a6e0164d50d8","Type":"ContainerStarted","Data":"615e8c6cf70f67cd90b8f95b5ce0e6017282c0feb384d04b7bd03789c663bdca"}
Sep 18 14:00:18.228418 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:18.228339    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv" podStartSLOduration=1.228324481 podStartE2EDuration="1.228324481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:18.22573576 +0000 UTC m=+966.917607355" watchObservedRunningTime="2026-09-18 14:00:18.228324481 +0000 UTC m=+966.920196075"
Sep 18 14:00:18.611803 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:18.611696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:19.531983 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:19.531948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:20.319661 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:20.319591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:21.216140 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:21.216107    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:22.522587 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:22.522541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:22.623521 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:22.623476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:26.517386 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.517354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:26.574286 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.574252    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"]
Sep 18 14:00:26.574551 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.574523    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66" podUID="e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" containerName="payload-processing" containerID="cri-o://570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef" gracePeriod=30
Sep 18 14:00:26.618232 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.618202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:26.718853 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.718818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:26.794434 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.794348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:26.823425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.823404    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 14:00:26.920073 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.920044    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-plugins-config-volume\") pod \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") "
Sep 18 14:00:26.920265 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.920149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qshkh\" (UniqueName: \"kubernetes.io/projected/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-kube-api-access-qshkh\") pod \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\" (UID: \"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0\") "
Sep 18 14:00:26.920403 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.920379    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" (UID: "e14c92e7-d959-49e0-aa3f-85d2a57e8bc0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:00:26.922451 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:26.922418    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-kube-api-access-qshkh" (OuterVolumeSpecName: "kube-api-access-qshkh") pod "e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" (UID: "e14c92e7-d959-49e0-aa3f-85d2a57e8bc0"). InnerVolumeSpecName "kube-api-access-qshkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:00:27.021063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.021021    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-plugins-config-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:00:27.021063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.021054    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qshkh\" (UniqueName: \"kubernetes.io/projected/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0-kube-api-access-qshkh\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:00:27.255313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.255280    2578 generic.go:356] "Generic (PLEG): container finished" podID="e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" containerID="570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef" exitCode=0
Sep 18 14:00:27.255545 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.255325    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"
Sep 18 14:00:27.255545 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.255356    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66" event={"ID":"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0","Type":"ContainerDied","Data":"570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef"}
Sep 18 14:00:27.255545 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.255406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66" event={"ID":"e14c92e7-d959-49e0-aa3f-85d2a57e8bc0","Type":"ContainerDied","Data":"d5fbeab02bbbfde1889120ecf69c90e14f2e1003d7850f2598758fee3176522a"}
Sep 18 14:00:27.255545 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.255427    2578 scope.go:117] "RemoveContainer" containerID="570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef"
Sep 18 14:00:27.264571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.264554    2578 scope.go:117] "RemoveContainer" containerID="570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef"
Sep 18 14:00:27.264886 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:00:27.264866    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef\": container with ID starting with 570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef not found: ID does not exist" containerID="570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef"
Sep 18 14:00:27.264942 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.264897    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef"} err="failed to get container status \"570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef\": rpc error: code = NotFound desc = could not find container \"570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef\": container with ID starting with 570f6be58a2f06226c317b16448e753ba2b31f354b44bbc7272bcd633da657ef not found: ID does not exist"
Sep 18 14:00:27.282802 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.282777    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"]
Sep 18 14:00:27.286039 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.286018    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8a84bc4e-669bfd9f9c-m2v66"]
Sep 18 14:00:27.300520 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.300492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:27.694970 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.694919    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:27.695452 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.694991    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:27.707340 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.707319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:27.851923 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.851886    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" path="/var/lib/kubelet/pods/e14c92e7-d959-49e0-aa3f-85d2a57e8bc0/volumes"
Sep 18 14:00:27.875203 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:27.875169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:28.168337 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.168250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:28.272683 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.272659    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:00:28.367633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.367565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:28.783935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.783900    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"]
Sep 18 14:00:28.784337 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.784261    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" containerName="payload-processing"
Sep 18 14:00:28.784337 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.784271    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" containerName="payload-processing"
Sep 18 14:00:28.784430 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.784353    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14c92e7-d959-49e0-aa3f-85d2a57e8bc0" containerName="payload-processing"
Sep 18 14:00:28.788840 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.788822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.792158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.792140    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-21049c60-openshift-default-dockercfg-p6t75\""
Sep 18 14:00:28.811724 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.811700    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"]
Sep 18 14:00:28.838276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-envoy\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838420 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-data\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838420 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-socket\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838420 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afd918d-e216-4cac-9e79-97ee04d20574-istiod-ca-cert\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6jc\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-kube-api-access-tt6jc\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838563 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-istio-token\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838596 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-credential-socket\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838596 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afd918d-e216-4cac-9e79-97ee04d20574-istio-podinfo\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.838693 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.838602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-certs\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.863299 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.863264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:28.939523 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939475    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-credential-socket\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.939523 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afd918d-e216-4cac-9e79-97ee04d20574-istio-podinfo\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.939834 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-certs\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.939834 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-envoy\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.939834 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-data\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.939834 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-socket\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.939834 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afd918d-e216-4cac-9e79-97ee04d20574-istiod-ca-cert\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.939834 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6jc\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-kube-api-access-tt6jc\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.940158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-istio-token\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.940158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.939981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-certs\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.940158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.940068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-socket\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.940158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.940119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-data\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.940368 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.940252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-credential-socket\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.940578 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.940561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afd918d-e216-4cac-9e79-97ee04d20574-istiod-ca-cert\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.942204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.942183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-envoy\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.942498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.942479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afd918d-e216-4cac-9e79-97ee04d20574-istio-podinfo\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.951913 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.951880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-istio-token\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.952547 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.952524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6jc\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-kube-api-access-tt6jc\") pod \"e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") " pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:28.971839 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:28.971810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:29.098680 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:29.098581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:29.340928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:29.340877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:29.399017 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:29.398992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"]
Sep 18 14:00:29.400709 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:00:29.400681    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afd918d_e216_4cac_9e79_97ee04d20574.slice/crio-b44cea6266b1d4e44bf0e5a40dfa7276dcd2e10fe96d8623a36cbf99ef23c785 WatchSource:0}: Error finding container b44cea6266b1d4e44bf0e5a40dfa7276dcd2e10fe96d8623a36cbf99ef23c785: Status 404 returned error can't find the container with id b44cea6266b1d4e44bf0e5a40dfa7276dcd2e10fe96d8623a36cbf99ef23c785
Sep 18 14:00:29.403267 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:29.403233    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:29.403362 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:29.403324    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:29.403444 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:29.403369    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:30.169137 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:30.169109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:30.271784 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:30.271747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" event={"ID":"9afd918d-e216-4cac-9e79-97ee04d20574","Type":"ContainerStarted","Data":"c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc"}
Sep 18 14:00:30.271960 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:30.271829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" event={"ID":"9afd918d-e216-4cac-9e79-97ee04d20574","Type":"ContainerStarted","Data":"b44cea6266b1d4e44bf0e5a40dfa7276dcd2e10fe96d8623a36cbf99ef23c785"}
Sep 18 14:00:30.295974 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:30.295924    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podStartSLOduration=2.295910099 podStartE2EDuration="2.295910099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:00:30.2939759 +0000 UTC m=+978.985847495" watchObservedRunningTime="2026-09-18 14:00:30.295910099 +0000 UTC m=+978.987781694"
Sep 18 14:00:31.016386 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.016351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:31.099384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.099346    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:31.104809 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.104785    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:31.276747 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.276666    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:31.277494 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.277476    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:31.657152 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.657064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:31.755622 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.755577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:31.938947 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:31.938916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:32.801125 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:32.801046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:33.723408 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:33.723368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:34.632326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:34.632285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:35.330181 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:35.330145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:36.208506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:36.208476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:36.274577 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:36.274544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:36.373400 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:36.373363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:36.679720 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:36.679602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:36.769761 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:36.769726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:39.042689 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:39.042654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:39.107332 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:39.107303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:40.909961 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:40.909928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:56.821268 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:56.821226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:57.328983 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.328946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:57.422988 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.422957    2578 generic.go:356] "Generic (PLEG): container finished" podID="9afd918d-e216-4cac-9e79-97ee04d20574" containerID="c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc" exitCode=0
Sep 18 14:00:57.423121 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.423034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" event={"ID":"9afd918d-e216-4cac-9e79-97ee04d20574","Type":"ContainerDied","Data":"c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc"}
Sep 18 14:00:57.423412 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.423387    2578 scope.go:117] "RemoveContainer" containerID="c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc"
Sep 18 14:00:57.424463 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.424435    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:57.424564 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.424519    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:57.424647 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.424571    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:00:57.732748 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:57.732718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:58.430251 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:58.430212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" event={"ID":"9afd918d-e216-4cac-9e79-97ee04d20574","Type":"ContainerStarted","Data":"df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee"}
Sep 18 14:00:58.723783 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:58.723750    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:00:59.098874 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:59.098782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:00:59.100053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:59.100027    2578 patch_prober.go:28] interesting pod/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 14:00:59.100178 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:59.100090    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 14:00:59.604861 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:00:59.604831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:00.099858 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:00.099820    2578 patch_prober.go:28] interesting pod/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 14:01:00.100058 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:00.099886    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 14:01:00.368171 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:00.368049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:01.099161 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:01.099126    2578 patch_prober.go:28] interesting pod/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 14:01:01.099573 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:01.099197    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 14:01:01.134176 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:01.134139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:01.277055 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:01.277017    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:01:02.020832 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:02.020795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:02.099245 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:02.099216    2578 patch_prober.go:28] interesting pod/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 14:01:02.099674 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:02.099277    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 14:01:02.905550 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:02.905503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:03.099468 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:03.099432    2578 patch_prober.go:28] interesting pod/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 14:01:03.099901 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:03.099502    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 14:01:03.731555 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:03.731516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:04.105181 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:04.105107    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:01:04.106278 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:04.106254    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:01:04.515537 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:04.515500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:05.353368 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:05.353336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:06.196738 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:06.196683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:07.219626 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:07.219561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:08.122249 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:08.122217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:08.755513 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:08.755484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:08.760042 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:08.760002    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"]
Sep 18 14:01:08.762465 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:08.762441    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-13658e-29829000-rbhvq"]
Sep 18 14:01:08.847663 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:08.847592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:08.912266 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:08.912229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:09.012228 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:09.012146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:09.114117 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:09.114089    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:09.216294 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:09.216262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:09.405938 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:09.405851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:09.850590 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:09.850557    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd99fc3-295b-473c-a0c6-266fff46d3ad" path="/var/lib/kubelet/pods/7cd99fc3-295b-473c-a0c6-266fff46d3ad/volumes"
Sep 18 14:01:10.055560 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:10.055528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:10.818271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:10.818238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:11.571434 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:11.571397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:12.312959 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:12.312928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:13.229512 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:13.229476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:14.098481 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:14.098449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:14.384966 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:14.384862    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"]
Sep 18 14:01:14.479114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:14.479080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:17.671771 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:17.671733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:17.771471 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:17.771419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:17.876057 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:17.876027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:17.978230 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:17.978205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:18.054407 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:18.054376    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"]
Sep 18 14:01:18.054651 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:18.054626    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy" containerID="cri-o://df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee" gracePeriod=30
Sep 18 14:01:18.094217 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:18.094187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:18.350685 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:18.350583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:18.778109 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:18.778071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:18.920687 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:18.920653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:19.107753 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:19.107665    2578 patch_prober.go:28] interesting pod/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:01:19.107753 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:19.107737    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:01:19.860518 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:19.860471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:20.421420 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:20.421389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:20.913185 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:20.913154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:22.016682 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:22.016640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:22.828540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:22.828490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:23.304511 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.304488    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:01:23.467266 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afd918d-e216-4cac-9e79-97ee04d20574-istiod-ca-cert\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.467434 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt6jc\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-kube-api-access-tt6jc\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.467434 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467345    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-certs\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.467434 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afd918d-e216-4cac-9e79-97ee04d20574-istio-podinfo\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.467434 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-data\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467435    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-credential-socket\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467484    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-istio-token\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467517    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-socket\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-envoy\") pod \"9afd918d-e216-4cac-9e79-97ee04d20574\" (UID: \"9afd918d-e216-4cac-9e79-97ee04d20574\") "
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467763    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467768    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9afd918d-e216-4cac-9e79-97ee04d20574-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467775    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-data" (OuterVolumeSpecName: "istio-data") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467870    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467939    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467958    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467970    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9afd918d-e216-4cac-9e79-97ee04d20574-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.468078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.467998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:23.469717 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.469694    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9afd918d-e216-4cac-9e79-97ee04d20574-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:01:23.469948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.469932    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:23.470248 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.470226    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-kube-api-access-tt6jc" (OuterVolumeSpecName: "kube-api-access-tt6jc") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "kube-api-access-tt6jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:23.470248 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.470223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-istio-token" (OuterVolumeSpecName: "istio-token") pod "9afd918d-e216-4cac-9e79-97ee04d20574" (UID: "9afd918d-e216-4cac-9e79-97ee04d20574"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:23.564058 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.564021    2578 generic.go:356] "Generic (PLEG): container finished" podID="9afd918d-e216-4cac-9e79-97ee04d20574" containerID="df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee" exitCode=0
Sep 18 14:01:23.564237 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.564072    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"
Sep 18 14:01:23.564237 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.564103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" event={"ID":"9afd918d-e216-4cac-9e79-97ee04d20574","Type":"ContainerDied","Data":"df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee"}
Sep 18 14:01:23.564237 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.564169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7" event={"ID":"9afd918d-e216-4cac-9e79-97ee04d20574","Type":"ContainerDied","Data":"b44cea6266b1d4e44bf0e5a40dfa7276dcd2e10fe96d8623a36cbf99ef23c785"}
Sep 18 14:01:23.564237 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.564200    2578 scope.go:117] "RemoveContainer" containerID="df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee"
Sep 18 14:01:23.568480 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.568455    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.568480 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.568476    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.568480 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.568486    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.568760 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.568495    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt6jc\" (UniqueName: \"kubernetes.io/projected/9afd918d-e216-4cac-9e79-97ee04d20574-kube-api-access-tt6jc\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.568760 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.568504    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9afd918d-e216-4cac-9e79-97ee04d20574-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.568760 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.568512    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9afd918d-e216-4cac-9e79-97ee04d20574-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:23.573794 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.573768    2578 scope.go:117] "RemoveContainer" containerID="c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc"
Sep 18 14:01:23.581734 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.581719    2578 scope.go:117] "RemoveContainer" containerID="df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee"
Sep 18 14:01:23.582007 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:01:23.581992    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee\": container with ID starting with df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee not found: ID does not exist" containerID="df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee"
Sep 18 14:01:23.582045 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.582015    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee"} err="failed to get container status \"df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee\": rpc error: code = NotFound desc = could not find container \"df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee\": container with ID starting with df738735e1a256226723d11e11c2a142ae818128dc3bd555169c34909c7f60ee not found: ID does not exist"
Sep 18 14:01:23.582045 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.582030    2578 scope.go:117] "RemoveContainer" containerID="c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc"
Sep 18 14:01:23.582272 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:01:23.582256    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc\": container with ID starting with c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc not found: ID does not exist" containerID="c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc"
Sep 18 14:01:23.582310 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.582280    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc"} err="failed to get container status \"c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc\": rpc error: code = NotFound desc = could not find container \"c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc\": container with ID starting with c6a6d11b55bca2d6a6172748fcf6ef7c0125f78d3cdf0064b21108d49c826dbc not found: ID does not exist"
Sep 18 14:01:23.591622 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.591583    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"]
Sep 18 14:01:23.597230 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.597210    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-21049c60-openshift-default-5d96b56c76-zdtb7"]
Sep 18 14:01:23.851178 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:23.851104    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" path="/var/lib/kubelet/pods/9afd918d-e216-4cac-9e79-97ee04d20574/volumes"
Sep 18 14:01:26.287006 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:26.286941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:26.397163 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:26.397076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:26.494806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:26.494778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:26.558038 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:26.557946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:26.968097 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:26.968061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:29.348252 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.348202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:29.404578 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.404531    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv" podUID="5db3ff97-fa11-42d1-a78a-a6e0164d50d8" containerName="main" containerID="cri-o://3f85fae1931b7ab82e51406b48dec139365bf533369e7f79c94204470ed38a64" gracePeriod=45
Sep 18 14:01:29.596299 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.596270    2578 generic.go:356] "Generic (PLEG): container finished" podID="5db3ff97-fa11-42d1-a78a-a6e0164d50d8" containerID="3f85fae1931b7ab82e51406b48dec139365bf533369e7f79c94204470ed38a64" exitCode=0
Sep 18 14:01:29.596455 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.596353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv" event={"ID":"5db3ff97-fa11-42d1-a78a-a6e0164d50d8","Type":"ContainerDied","Data":"3f85fae1931b7ab82e51406b48dec139365bf533369e7f79c94204470ed38a64"}
Sep 18 14:01:29.648705 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.648681    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:01:29.722063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722037    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-home\") pod \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") "
Sep 18 14:01:29.722218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722083    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tmp-dir\") pod \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") "
Sep 18 14:01:29.722218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722126    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-model-cache\") pod \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") "
Sep 18 14:01:29.722218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tls-certs\") pod \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") "
Sep 18 14:01:29.722384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722230    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-dshm\") pod \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") "
Sep 18 14:01:29.722384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzsmm\" (UniqueName: \"kubernetes.io/projected/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-kube-api-access-qzsmm\") pod \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\" (UID: \"5db3ff97-fa11-42d1-a78a-a6e0164d50d8\") "
Sep 18 14:01:29.722384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722337    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-home" (OuterVolumeSpecName: "home") pod "5db3ff97-fa11-42d1-a78a-a6e0164d50d8" (UID: "5db3ff97-fa11-42d1-a78a-a6e0164d50d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:29.722526 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722387    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "5db3ff97-fa11-42d1-a78a-a6e0164d50d8" (UID: "5db3ff97-fa11-42d1-a78a-a6e0164d50d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:29.722526 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722400    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5db3ff97-fa11-42d1-a78a-a6e0164d50d8" (UID: "5db3ff97-fa11-42d1-a78a-a6e0164d50d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:29.722658 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722641    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:29.722725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722665    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:29.722725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.722680    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:29.724702 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.724660    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-dshm" (OuterVolumeSpecName: "dshm") pod "5db3ff97-fa11-42d1-a78a-a6e0164d50d8" (UID: "5db3ff97-fa11-42d1-a78a-a6e0164d50d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:29.724702 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.724681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-kube-api-access-qzsmm" (OuterVolumeSpecName: "kube-api-access-qzsmm") pod "5db3ff97-fa11-42d1-a78a-a6e0164d50d8" (UID: "5db3ff97-fa11-42d1-a78a-a6e0164d50d8"). InnerVolumeSpecName "kube-api-access-qzsmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:29.724852 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.724773    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5db3ff97-fa11-42d1-a78a-a6e0164d50d8" (UID: "5db3ff97-fa11-42d1-a78a-a6e0164d50d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:01:29.823956 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.823927    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:29.823956 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.823951    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:29.823956 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:29.823960    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzsmm\" (UniqueName: \"kubernetes.io/projected/5db3ff97-fa11-42d1-a78a-a6e0164d50d8-kube-api-access-qzsmm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:30.602640 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:30.602598    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"
Sep 18 14:01:30.602640 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:30.602621    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv" event={"ID":"5db3ff97-fa11-42d1-a78a-a6e0164d50d8","Type":"ContainerDied","Data":"615e8c6cf70f67cd90b8f95b5ce0e6017282c0feb384d04b7bd03789c663bdca"}
Sep 18 14:01:30.603188 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:30.602668    2578 scope.go:117] "RemoveContainer" containerID="3f85fae1931b7ab82e51406b48dec139365bf533369e7f79c94204470ed38a64"
Sep 18 14:01:30.632451 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:30.632418    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"]
Sep 18 14:01:30.641883 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:30.641861    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-13658e/autores-model-13658e-kserve-65bdfbf6c5-hchzv"]
Sep 18 14:01:31.849811 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:31.849775    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db3ff97-fa11-42d1-a78a-a6e0164d50d8" path="/var/lib/kubelet/pods/5db3ff97-fa11-42d1-a78a-a6e0164d50d8/volumes"
Sep 18 14:01:46.110384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:46.110351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:51.444217 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:51.444180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:51.676488 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:51.676452    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"]
Sep 18 14:01:51.676741 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:51.676680    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy" containerID="cri-o://3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b" gracePeriod=30
Sep 18 14:01:51.705585 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:51.705515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:52.108084 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.107997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:52.407099 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.407010    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"]
Sep 18 14:01:52.407445 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.407429    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy"
Sep 18 14:01:52.407445 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.407446    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy"
Sep 18 14:01:52.407637 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.407483    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db3ff97-fa11-42d1-a78a-a6e0164d50d8" containerName="main"
Sep 18 14:01:52.407637 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.407492    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db3ff97-fa11-42d1-a78a-a6e0164d50d8" containerName="main"
Sep 18 14:01:52.407637 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.407560    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy"
Sep 18 14:01:52.407637 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.407573    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db3ff97-fa11-42d1-a78a-a6e0164d50d8" containerName="main"
Sep 18 14:01:52.410557 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.410533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.413908 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.413884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-ec85d5-openshift-default-dockercfg-bprn5\""
Sep 18 14:01:52.424702 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.424681    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"]
Sep 18 14:01:52.443573 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.443541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:52.521818 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.521774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-data\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.521859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-credential-socket\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.522016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-podinfo\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.522069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istiod-ca-cert\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.522145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-envoy\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.522184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-token\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.522208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7wdq\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-kube-api-access-f7wdq\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.522293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-socket\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.522498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.522348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-certs\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-credential-socket\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-podinfo\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istiod-ca-cert\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-envoy\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-token\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7wdq\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-kube-api-access-f7wdq\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-socket\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-certs\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623669 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-credential-socket\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623669 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-data\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623669 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-certs\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623837 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-socket\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623893 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-data\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.623949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.623887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istiod-ca-cert\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.625568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.625541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-envoy\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.625921 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.625904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-podinfo\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.634703 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.634681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7wdq\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-kube-api-access-f7wdq\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.658157 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.658099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-token\") pod \"e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") " pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.722413 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.722389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:52.747954 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.747920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:52.890727 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:52.890694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:53.004571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.004509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"]
Sep 18 14:01:53.007217 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:01:53.007188    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1f859a_ac1e_4418_9a0d_51ab341107bc.slice/crio-60efb16428d9e31b87826f583d60cb7d57015f6ec37b83779a42412393aa3272 WatchSource:0}: Error finding container 60efb16428d9e31b87826f583d60cb7d57015f6ec37b83779a42412393aa3272: Status 404 returned error can't find the container with id 60efb16428d9e31b87826f583d60cb7d57015f6ec37b83779a42412393aa3272
Sep 18 14:01:53.009547 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.009518    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:01:53.009602 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.009582    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:01:53.009657 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.009632    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:01:53.714455 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.714423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" event={"ID":"5d1f859a-ac1e-4418-9a0d-51ab341107bc","Type":"ContainerStarted","Data":"54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666"}
Sep 18 14:01:53.714837 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.714483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" event={"ID":"5d1f859a-ac1e-4418-9a0d-51ab341107bc","Type":"ContainerStarted","Data":"60efb16428d9e31b87826f583d60cb7d57015f6ec37b83779a42412393aa3272"}
Sep 18 14:01:53.723532 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.723515    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:53.737350 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:53.737305    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podStartSLOduration=1.737290872 podStartE2EDuration="1.737290872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:01:53.735676367 +0000 UTC m=+1062.427547963" watchObservedRunningTime="2026-09-18 14:01:53.737290872 +0000 UTC m=+1062.429162539"
Sep 18 14:01:54.727506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:54.727472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:54.945487 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:54.945454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:55.654310 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:55.654276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:55.724593 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:55.724552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:55.725423 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:55.725402    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:01:55.752296 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:55.752267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:55.935792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:55.935760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:56.903969 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:56.903918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:56.925809 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:56.925787    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 14:01:57.064736 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064661    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24848088-b7fd-400f-9372-21ecae63e7e5-istio-podinfo\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064736 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064708    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-certs\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-data\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-istio-token\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064800    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-credential-socket\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24848088-b7fd-400f-9372-21ecae63e7e5-istiod-ca-cert\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-socket\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064883    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpwdr\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-kube-api-access-wpwdr\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.064965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.064941    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-envoy\") pod \"24848088-b7fd-400f-9372-21ecae63e7e5\" (UID: \"24848088-b7fd-400f-9372-21ecae63e7e5\") "
Sep 18 14:01:57.065298 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.065016    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:57.065298 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.065090    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:57.065298 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.065223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24848088-b7fd-400f-9372-21ecae63e7e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:01:57.065298 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.065272    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.065298 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.065282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:57.065298 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.065293    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.065560 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.065411    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:57.067048 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.067024    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:57.067178 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.067064    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24848088-b7fd-400f-9372-21ecae63e7e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:01:57.067227 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.067177    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-kube-api-access-wpwdr" (OuterVolumeSpecName: "kube-api-access-wpwdr") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "kube-api-access-wpwdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:01:57.067595 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.067570    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24848088-b7fd-400f-9372-21ecae63e7e5" (UID: "24848088-b7fd-400f-9372-21ecae63e7e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:01:57.166638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.166590    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.166638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.166634    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.166638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.166644    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24848088-b7fd-400f-9372-21ecae63e7e5-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.166638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.166652    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.166896 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.166661    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpwdr\" (UniqueName: \"kubernetes.io/projected/24848088-b7fd-400f-9372-21ecae63e7e5-kube-api-access-wpwdr\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.166896 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.166668    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24848088-b7fd-400f-9372-21ecae63e7e5-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.166896 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.166676    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24848088-b7fd-400f-9372-21ecae63e7e5-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:01:57.735900 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.735859    2578 generic.go:356] "Generic (PLEG): container finished" podID="24848088-b7fd-400f-9372-21ecae63e7e5" containerID="3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b" exitCode=0
Sep 18 14:01:57.736073 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.735913    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"
Sep 18 14:01:57.736073 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.735948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" event={"ID":"24848088-b7fd-400f-9372-21ecae63e7e5","Type":"ContainerDied","Data":"3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b"}
Sep 18 14:01:57.736073 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.736003    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq" event={"ID":"24848088-b7fd-400f-9372-21ecae63e7e5","Type":"ContainerDied","Data":"efb6ae8e70ad2185467c12b9a563130882cc9c60bbfba13405f66d041b854f9e"}
Sep 18 14:01:57.736073 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.736028    2578 scope.go:117] "RemoveContainer" containerID="3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b"
Sep 18 14:01:57.745968 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.745953    2578 scope.go:117] "RemoveContainer" containerID="caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4"
Sep 18 14:01:57.753901 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.753882    2578 scope.go:117] "RemoveContainer" containerID="3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b"
Sep 18 14:01:57.754172 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:01:57.754153    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b\": container with ID starting with 3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b not found: ID does not exist" containerID="3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b"
Sep 18 14:01:57.754221 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.754181    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b"} err="failed to get container status \"3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b\": rpc error: code = NotFound desc = could not find container \"3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b\": container with ID starting with 3e470b9bc3ec3715bdb1d8a8b0b4fc34ee58ea2a1c48911b14d08767d719eb9b not found: ID does not exist"
Sep 18 14:01:57.754221 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.754199    2578 scope.go:117] "RemoveContainer" containerID="caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4"
Sep 18 14:01:57.754452 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:01:57.754434    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4\": container with ID starting with caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4 not found: ID does not exist" containerID="caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4"
Sep 18 14:01:57.754509 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.754461    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4"} err="failed to get container status \"caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4\": rpc error: code = NotFound desc = could not find container \"caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4\": container with ID starting with caa5fa11928ce38bedee752b5e92aa7f3c81e3e30abd4b5951ef9810da805ae4 not found: ID does not exist"
Sep 18 14:01:57.760957 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.760932    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"]
Sep 18 14:01:57.767199 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.767181    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-13658e-openshift-default-b456f7846-hqlkq"]
Sep 18 14:01:57.827808 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.827781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:57.851357 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:57.851333    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" path="/var/lib/kubelet/pods/24848088-b7fd-400f-9372-21ecae63e7e5/volumes"
Sep 18 14:01:58.678740 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:58.678711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:59.642502 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:59.642474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:59.746010 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:59.745971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:01:59.954518 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:01:59.954488    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:00.061792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:00.061765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:00.343894 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:00.343812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:00.430750 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:00.430716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:15.780679 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:15.780640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:16.834363 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:16.834330    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerID="54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666" exitCode=0
Sep 18 14:02:16.834840 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:16.834408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" event={"ID":"5d1f859a-ac1e-4418-9a0d-51ab341107bc","Type":"ContainerDied","Data":"54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666"}
Sep 18 14:02:16.834887 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:16.834851    2578 scope.go:117] "RemoveContainer" containerID="54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666"
Sep 18 14:02:16.836033 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:16.836006    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:02:16.836102 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:16.836083    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:02:16.836140 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:16.836123    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:02:17.840518 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:17.840487    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" event={"ID":"5d1f859a-ac1e-4418-9a0d-51ab341107bc","Type":"ContainerStarted","Data":"22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719"}
Sep 18 14:02:18.723213 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:18.723179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:02:18.723443 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:18.723407    2578 patch_prober.go:28] interesting pod/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 18 14:02:18.723551 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:18.723494    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 18 14:02:19.723318 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:19.723283    2578 patch_prober.go:28] interesting pod/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 18 14:02:19.723775 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:19.723349    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 18 14:02:20.723271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:20.723233    2578 patch_prober.go:28] interesting pod/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 18 14:02:20.723498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:20.723299    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 18 14:02:21.723291 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:21.723257    2578 patch_prober.go:28] interesting pod/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 18 14:02:21.723515 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:21.723344    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 18 14:02:21.933087 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:21.933053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:22.041972 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:22.041891    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:22.150015 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:22.149983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:22.252635 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:22.252571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:22.723571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:22.723534    2578 patch_prober.go:28] interesting pod/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 18 14:02:22.723988 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:22.723588    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 18 14:02:23.204923 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:23.204890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:23.767183 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:23.767156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:02:23.767825 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:23.767472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:02:23.768772 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:23.768752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:02:24.194173 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:24.194147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:24.938594 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:24.938560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:25.631192 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:25.631158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:25.733736 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:25.733687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:26.413482 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:26.413450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:32.281011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.280971    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"]
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281331    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281342    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281351    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281357    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281377    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281382    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281434    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281443    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9afd918d-e216-4cac-9e79-97ee04d20574" containerName="istio-proxy"
Sep 18 14:02:32.281446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.281449    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="24848088-b7fd-400f-9372-21ecae63e7e5" containerName="istio-proxy"
Sep 18 14:02:32.284578 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.284561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.287764 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.287745    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"premium-w4-a02b2c-kserve-self-signed-certs\""
Sep 18 14:02:32.305288 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.305261    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"]
Sep 18 14:02:32.386384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.386353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:32.391158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.391140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-model-cache\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.391229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.391170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-home\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.391229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.391187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989g5\" (UniqueName: \"kubernetes.io/projected/a8a822e4-40a8-480e-8f34-76c74bf3869a-kube-api-access-989g5\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.391314 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.391273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a822e4-40a8-480e-8f34-76c74bf3869a-tls-certs\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.391361 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.391314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-dshm\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.391398 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.391371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-tmp-dir\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492199 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-tmp-dir\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492370 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-model-cache\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492370 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-home\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492370 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989g5\" (UniqueName: \"kubernetes.io/projected/a8a822e4-40a8-480e-8f34-76c74bf3869a-kube-api-access-989g5\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492370 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a822e4-40a8-480e-8f34-76c74bf3869a-tls-certs\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492584 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-dshm\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492677 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492638    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-tmp-dir\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492677 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-model-cache\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.492793 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.492695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-home\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.494881 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.494855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-dshm\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.495027 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.495009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a822e4-40a8-480e-8f34-76c74bf3869a-tls-certs\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.502378 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.502356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-989g5\" (UniqueName: \"kubernetes.io/projected/a8a822e4-40a8-480e-8f34-76c74bf3869a-kube-api-access-989g5\") pod \"premium-w4-a02b2c-kserve-8687f86d98-q4m7m\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") " pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.593489 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.593397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:32.602531 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.602474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:32.867011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.866982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"]
Sep 18 14:02:32.868955 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:02:32.868926    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8a822e4_40a8_480e_8f34_76c74bf3869a.slice/crio-9bdc597350132ea93d663602af3ae55d7e83d1723fe06dfc070fa12ac1b6afb9 WatchSource:0}: Error finding container 9bdc597350132ea93d663602af3ae55d7e83d1723fe06dfc070fa12ac1b6afb9: Status 404 returned error can't find the container with id 9bdc597350132ea93d663602af3ae55d7e83d1723fe06dfc070fa12ac1b6afb9
Sep 18 14:02:32.918751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:32.918724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m" event={"ID":"a8a822e4-40a8-480e-8f34-76c74bf3869a","Type":"ContainerStarted","Data":"9bdc597350132ea93d663602af3ae55d7e83d1723fe06dfc070fa12ac1b6afb9"}
Sep 18 14:02:33.378227 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:33.378148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:33.925223 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:33.925189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m" event={"ID":"a8a822e4-40a8-480e-8f34-76c74bf3869a","Type":"ContainerStarted","Data":"2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5"}
Sep 18 14:02:33.946808 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:33.946752    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m" podStartSLOduration=1.946735575 podStartE2EDuration="1.946735575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:33.945310911 +0000 UTC m=+1102.637182506" watchObservedRunningTime="2026-09-18 14:02:33.946735575 +0000 UTC m=+1102.638607169"
Sep 18 14:02:39.561841 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:39.561800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:39.669451 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:39.669419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:39.805867 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:39.805831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:39.962425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:39.962394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:40.528861 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:40.528820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:40.632163 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:40.632099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:40.726892 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:40.726858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:42.114715 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:42.114682    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:42.594158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:42.594119    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:42.594358 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:42.594173    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:42.606798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:42.606776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:42.983705 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:42.983670    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:02:48.688784 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.688743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:48.786905 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.786867    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"]
Sep 18 14:02:48.790047 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.790031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:48.793534 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.793515    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-12afdd\"/\"default-dockercfg-lh476\""
Sep 18 14:02:48.793965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.793948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-12afdd\"/\"test-model-12afdd-kserve-self-signed-certs\""
Sep 18 14:02:48.794056 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.794043    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-12afdd\"/\"kube-root-ca.crt\""
Sep 18 14:02:48.795222 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.795209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-12afdd\"/\"openshift-service-ca.crt\""
Sep 18 14:02:48.799246 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.799225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:48.803664 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.803643    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"]
Sep 18 14:02:48.888330 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.888295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:48.956312 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.956197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-dshm\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:48.956312 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.956273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-home\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:48.956527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.956327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-model-cache\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:48.956527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.956398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fhbf\" (UniqueName: \"kubernetes.io/projected/00c2d656-5b86-4df3-8491-fa8019e721ae-kube-api-access-6fhbf\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:48.956527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.956477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00c2d656-5b86-4df3-8491-fa8019e721ae-tls-certs\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:48.956744 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:48.956578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-tmp-dir\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.057730 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.057700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-dshm\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.057928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.057745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-home\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.057928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.057776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-model-cache\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.057928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.057812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fhbf\" (UniqueName: \"kubernetes.io/projected/00c2d656-5b86-4df3-8491-fa8019e721ae-kube-api-access-6fhbf\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.057928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.057828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00c2d656-5b86-4df3-8491-fa8019e721ae-tls-certs\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.058168 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.057949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-tmp-dir\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.058229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.058183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-model-cache\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.058277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.058222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-home\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.058277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.058267    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-tmp-dir\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.060253 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.060231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-dshm\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.060644 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.060601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00c2d656-5b86-4df3-8491-fa8019e721ae-tls-certs\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.068198 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.068171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fhbf\" (UniqueName: \"kubernetes.io/projected/00c2d656-5b86-4df3-8491-fa8019e721ae-kube-api-access-6fhbf\") pod \"test-model-12afdd-kserve-764ffc7485-cpwfw\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") " pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.100008 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.099980    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:49.359023 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.358935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:49.381806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:49.381782    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"]
Sep 18 14:02:49.383336 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:02:49.383312    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00c2d656_5b86_4df3_8491_fa8019e721ae.slice/crio-3550da358a48da4c2e7a64a53c06ae3b7d6dae8bec055ad40f3758c29ffb7ad8 WatchSource:0}: Error finding container 3550da358a48da4c2e7a64a53c06ae3b7d6dae8bec055ad40f3758c29ffb7ad8: Status 404 returned error can't find the container with id 3550da358a48da4c2e7a64a53c06ae3b7d6dae8bec055ad40f3758c29ffb7ad8
Sep 18 14:02:50.009192 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:50.009157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw" event={"ID":"00c2d656-5b86-4df3-8491-fa8019e721ae","Type":"ContainerStarted","Data":"6d65e37e8c713ac9828a7579dae36d26b1fbffbaebc94ccec0ca09442fb329c9"}
Sep 18 14:02:50.009573 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:50.009201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw" event={"ID":"00c2d656-5b86-4df3-8491-fa8019e721ae","Type":"ContainerStarted","Data":"3550da358a48da4c2e7a64a53c06ae3b7d6dae8bec055ad40f3758c29ffb7ad8"}
Sep 18 14:02:50.029951 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:50.029902    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw" podStartSLOduration=2.029886122 podStartE2EDuration="2.029886122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:02:50.027951208 +0000 UTC m=+1118.719822803" watchObservedRunningTime="2026-09-18 14:02:50.029886122 +0000 UTC m=+1118.721757717"
Sep 18 14:02:55.711627 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:55.711578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:55.812257 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:55.812225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:55.933339 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:55.933301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:56.278783 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:56.278749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:56.468993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:56.468956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:02:59.100532 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:59.100499    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:59.100944 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:59.100546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:02:59.113383 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:02:59.113355    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:03:00.071312 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:00.071283    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:03:02.806560 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:02.806525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:02.906476 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:02.906443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:03.733834 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:03.733801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:04.706519 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:04.706483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:05.437731 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:05.437695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:06.177439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:06.177402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:07.036980 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:07.036943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:07.114598 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:07.114554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:07.233725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:07.233685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:07.532933 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:07.532902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:07.632336 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:07.632299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:22.784741 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:22.784701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:29.531043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:29.531008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:30.726018 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:30.725979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:31.512892 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:31.512859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:32.221291 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:32.221258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:32.762382 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:32.762352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:33.026192 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:33.026115    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:33.450437 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:33.450407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:33.557296 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:33.557264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:33.857373 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:33.857288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:34.351548 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:34.351517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:35.312749 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:35.312709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:39.260358 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:39.260321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:39.361328 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:39.361296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:39.831978 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:39.831949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:39.932995 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:39.932965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:41.222263 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:41.222220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:41.912526 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:41.912486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:42.614880 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:42.614835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:43.432119 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:43.432089    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:44.234712 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:44.234681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:45.182929 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:45.182892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:45.929624 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:45.929584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:47.132406 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:47.132347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:48.117870 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:48.117839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:50.414128 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:50.414041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:51.038327 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:51.038286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:51.139030 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:51.138990    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:51.254819 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:51.254789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:51.426180 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:51.426075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:51.642278 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:51.642239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:51.810499 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:51.810467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:52.612803 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:52.612768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:53.346031 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:53.345998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:54.217876 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:54.217844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:54.937979 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:54.937944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:55.814392 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:55.814364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:57.636325 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:57.636289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:57.737452 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:57.737424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:57.889437 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:57.889354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:58.272563 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:58.272530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:58.370486 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:58.370455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:58.470754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:58.470725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:58.545509 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:58.545426    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:03:59.256577 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:03:59.256545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:00.221396 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:00.221356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:01.001198 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:01.001165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:01.790004 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:01.789970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:02.427775 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:02.427741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:02.835278 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:02.835247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:03.776788 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:03.776750    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:04.620487 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:04.620459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:05.095516 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:05.095482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:05.209378 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:05.209350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:05.296048 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:05.296002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:05.435802 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:05.435773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:08.033278 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:08.033241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:08.134224 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:08.134186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:08.915760 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:08.915727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:09.016856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:09.016823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:09.319229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:09.319189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:09.420251 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:09.420218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:10.302321 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:10.302289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:11.075981 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:11.075945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:11.908149 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:11.908053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:12.172808 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:12.172718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:12.272201 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:12.272162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:12.718665 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:12.718628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:13.035854 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:13.035766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:13.321783 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:13.321690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:13.507320 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:13.507284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:14.388421 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:14.388389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:15.367339 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:15.367307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:16.006717 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:16.006681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:16.101338 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:16.101304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:16.328946 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:16.328836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:17.172412 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:17.172378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:18.183873 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:18.183841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:19.015589 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:19.015554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:19.910213 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:19.910181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:20.010235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:20.010199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:20.303633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:20.303576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:20.406506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:20.406478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:20.505419 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:20.505388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:21.211232 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:21.211201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:21.435403 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:21.435370    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"]
Sep 18 14:04:21.435678 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:21.435651    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy" containerID="cri-o://22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719" gracePeriod=30
Sep 18 14:04:21.467798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:21.467726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:21.868111 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:21.868026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:22.147473 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.147386    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"]
Sep 18 14:04:22.151434 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.151412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.156861 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.156834    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-3b3206-openshift-default-dockercfg-b4rzh\""
Sep 18 14:04:22.165334 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.165309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"]
Sep 18 14:04:22.182468 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.182444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:22.282229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.282170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:22.326351 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-data\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326351 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-credential-socket\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326641 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-certs\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326641 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-token\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326641 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istiod-ca-cert\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326641 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clrpr\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-kube-api-access-clrpr\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-podinfo\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-socket\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.326823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.326771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-envoy\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.427659 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-credential-socket\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.427659 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-certs\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.427659 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-token\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.427958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istiod-ca-cert\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.427958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clrpr\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-kube-api-access-clrpr\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.427958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-podinfo\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.427958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-socket\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.428184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.427989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-envoy\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.428184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.428021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-certs\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.428184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.428086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-credential-socket\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.428184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.428094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-data\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.428402 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.428253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-socket\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.428460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.428419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-data\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.428460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.428448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istiod-ca-cert\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.430274 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.430253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-envoy\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.430506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.430488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-podinfo\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.437218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.437198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clrpr\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-kube-api-access-clrpr\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.440064 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.440043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-token\") pod \"e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") " pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.463191 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.463170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:22.743306 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.743283    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"]
Sep 18 14:04:22.745077 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:04:22.745049    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf247c75e_b3b5_4b0b_a09a_a2277e6d584c.slice/crio-5023f7ca3b80704da6a45a29ca7e9a58ed60a7259bb7132032de2544f3517794 WatchSource:0}: Error finding container 5023f7ca3b80704da6a45a29ca7e9a58ed60a7259bb7132032de2544f3517794: Status 404 returned error can't find the container with id 5023f7ca3b80704da6a45a29ca7e9a58ed60a7259bb7132032de2544f3517794
Sep 18 14:04:22.747334 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.747301    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:22.747416 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.747376    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:22.747416 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:22.747404    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:23.492594 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:23.492557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp" event={"ID":"f247c75e-b3b5-4b0b-a09a-a2277e6d584c","Type":"ContainerStarted","Data":"828b7a57ea2a9346d45ab71e903cd5a514751b2227b3906898389ce00b6694a9"}
Sep 18 14:04:23.493000 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:23.492639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp" event={"ID":"f247c75e-b3b5-4b0b-a09a-a2277e6d584c","Type":"ContainerStarted","Data":"5023f7ca3b80704da6a45a29ca7e9a58ed60a7259bb7132032de2544f3517794"}
Sep 18 14:04:23.517481 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:23.517436    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp" podStartSLOduration=1.517420606 podStartE2EDuration="1.517420606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:04:23.516656043 +0000 UTC m=+1212.208527637" watchObservedRunningTime="2026-09-18 14:04:23.517420606 +0000 UTC m=+1212.209292201"
Sep 18 14:04:23.769840 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:23.769757    2578 patch_prober.go:28] interesting pod/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:04:23.769840 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:23.769820    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:04:23.805743 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:23.805708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:23.905629 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:23.905580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:24.004927 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:24.004890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:24.464312 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:24.464276    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:24.470024 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:24.469998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:24.497108 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:24.497074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:24.497902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:24.497881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:04:26.685473 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.685448    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:04:26.767155 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.767076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:26.778180 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778155    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-envoy\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778285 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778192    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-credential-socket\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778285 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778238    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-certs\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778285 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778255    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istiod-ca-cert\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778285 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778277    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-socket\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778480 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-podinfo\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778480 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778357    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-token\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778589 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778497    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7wdq\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-kube-api-access-f7wdq\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778589 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:26.778589 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778553    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:26.778798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778589    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-data\") pod \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\" (UID: \"5d1f859a-ac1e-4418-9a0d-51ab341107bc\") "
Sep 18 14:04:26.778798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778717    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:26.778798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.778763    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:04:26.779044 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.779017    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:26.779198 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.779176    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.779246 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.779207    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.779246 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.779222    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.779246 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.779237    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.779367 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.779251    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.780519 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.780499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:04:26.780953 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.780935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-kube-api-access-f7wdq" (OuterVolumeSpecName: "kube-api-access-f7wdq") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "kube-api-access-f7wdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:04:26.781204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.781188    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:04:26.781254 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.781205    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d1f859a-ac1e-4418-9a0d-51ab341107bc" (UID: "5d1f859a-ac1e-4418-9a0d-51ab341107bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:04:26.880540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.880508    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.880540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.880535    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.880540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.880544    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7wdq\" (UniqueName: \"kubernetes.io/projected/5d1f859a-ac1e-4418-9a0d-51ab341107bc-kube-api-access-f7wdq\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:26.880780 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:26.880554    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1f859a-ac1e-4418-9a0d-51ab341107bc-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:04:27.514105 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.514068    2578 generic.go:356] "Generic (PLEG): container finished" podID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerID="22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719" exitCode=0
Sep 18 14:04:27.514313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.514113    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"
Sep 18 14:04:27.514313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.514122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" event={"ID":"5d1f859a-ac1e-4418-9a0d-51ab341107bc","Type":"ContainerDied","Data":"22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719"}
Sep 18 14:04:27.514313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.514181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg" event={"ID":"5d1f859a-ac1e-4418-9a0d-51ab341107bc","Type":"ContainerDied","Data":"60efb16428d9e31b87826f583d60cb7d57015f6ec37b83779a42412393aa3272"}
Sep 18 14:04:27.514313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.514210    2578 scope.go:117] "RemoveContainer" containerID="22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719"
Sep 18 14:04:27.524362 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.524346    2578 scope.go:117] "RemoveContainer" containerID="54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666"
Sep 18 14:04:27.532324 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.532305    2578 scope.go:117] "RemoveContainer" containerID="22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719"
Sep 18 14:04:27.532576 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:04:27.532558    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719\": container with ID starting with 22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719 not found: ID does not exist" containerID="22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719"
Sep 18 14:04:27.532643 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.532585    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719"} err="failed to get container status \"22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719\": rpc error: code = NotFound desc = could not find container \"22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719\": container with ID starting with 22acba33878aa97f326cc330a49f464c5798bbcdb8c8d6662816306dc6a66719 not found: ID does not exist"
Sep 18 14:04:27.532643 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.532618    2578 scope.go:117] "RemoveContainer" containerID="54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666"
Sep 18 14:04:27.532845 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:04:27.532830    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666\": container with ID starting with 54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666 not found: ID does not exist" containerID="54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666"
Sep 18 14:04:27.532887 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.532849    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666"} err="failed to get container status \"54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666\": rpc error: code = NotFound desc = could not find container \"54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666\": container with ID starting with 54b129aaa4b6139691b08c77bea68ecf86d2ff19e7cfb7fe708402e123fd3666 not found: ID does not exist"
Sep 18 14:04:27.538130 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.538108    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"]
Sep 18 14:04:27.540563 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.540544    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-ec85d5-openshift-default-55d4b885b8-wjljg"]
Sep 18 14:04:27.851433 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:27.851343    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" path="/var/lib/kubelet/pods/5d1f859a-ac1e-4418-9a0d-51ab341107bc/volumes"
Sep 18 14:04:42.007666 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:42.007625    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:42.830104 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:42.830070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:43.503186 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.503143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:43.758537 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.758444    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"]
Sep 18 14:04:43.758957 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.758938    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy"
Sep 18 14:04:43.759054 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.758960    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy"
Sep 18 14:04:43.759111 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.759066    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy"
Sep 18 14:04:43.761973 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.761953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.764892 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.764872    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"e2e-conflict-a-344168c3-kserve-self-signed-certs\""
Sep 18 14:04:43.773429 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.773407    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"]
Sep 18 14:04:43.838888 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.838865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tls-certs\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.839032 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.838926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-model-cache\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.839032 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.838971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-home\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.839032 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.838989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-dshm\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.839032 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.839009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpxph\" (UniqueName: \"kubernetes.io/projected/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-kube-api-access-mpxph\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.839325 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.839093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tmp-dir\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.874722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.874691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:43.939998 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.939971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tls-certs\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940128 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-model-cache\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940128 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-home\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940128 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-dshm\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940128 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpxph\" (UniqueName: \"kubernetes.io/projected/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-kube-api-access-mpxph\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940340 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tmp-dir\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940627 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-home\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940731 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tmp-dir\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.940731 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.940653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-model-cache\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.942513 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.942488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-dshm\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.942769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.942753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tls-certs\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:43.956356 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:43.956332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpxph\" (UniqueName: \"kubernetes.io/projected/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-kube-api-access-mpxph\") pod \"e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:44.071777 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:44.071711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:44.355875 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:44.355845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"]
Sep 18 14:04:44.357862 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:04:44.357831    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc8ca07_0525_4ed5_8247_7bf0e35f177d.slice/crio-c6df4abafed295c12ec87f39bcf5c7df29f66b29d3fb5821e7ceb610750b4e60 WatchSource:0}: Error finding container c6df4abafed295c12ec87f39bcf5c7df29f66b29d3fb5821e7ceb610750b4e60: Status 404 returned error can't find the container with id c6df4abafed295c12ec87f39bcf5c7df29f66b29d3fb5821e7ceb610750b4e60
Sep 18 14:04:44.417587 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:44.417549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:44.603996 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:44.603958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb" event={"ID":"6bc8ca07-0525-4ed5-8247-7bf0e35f177d","Type":"ContainerStarted","Data":"eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe"}
Sep 18 14:04:44.604375 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:44.604007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb" event={"ID":"6bc8ca07-0525-4ed5-8247-7bf0e35f177d","Type":"ContainerStarted","Data":"c6df4abafed295c12ec87f39bcf5c7df29f66b29d3fb5821e7ceb610750b4e60"}
Sep 18 14:04:44.622191 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:44.622107    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb" podStartSLOduration=1.622092501 podStartE2EDuration="1.622092501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:04:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:04:44.621397572 +0000 UTC m=+1233.313269168" watchObservedRunningTime="2026-09-18 14:04:44.622092501 +0000 UTC m=+1233.313964096"
Sep 18 14:04:45.228219 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:45.228169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:45.938646 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:45.938590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:46.040240 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.040212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:46.357726 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.357634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:46.629348 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.629269    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"]
Sep 18 14:04:46.629709 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.629694    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy"
Sep 18 14:04:46.629771 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.629711    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy"
Sep 18 14:04:46.629817 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.629802    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1f859a-ac1e-4418-9a0d-51ab341107bc" containerName="istio-proxy"
Sep 18 14:04:46.632950 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.632925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.636009 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.635985    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-75dcf1-openshift-default-dockercfg-clnlj\""
Sep 18 14:04:46.645163 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.645141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"]
Sep 18 14:04:46.661246 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.661218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:46.769621 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.769583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-data\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.769796 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.769663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-envoy\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.769796 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.769756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-certs\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.769901 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.769809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-credential-socket\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.769901 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.769863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-podinfo\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.769971 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.769926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdvl\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-kube-api-access-xgdvl\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.770013 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.769999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-socket\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.770052 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.770021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb495ec4-1121-4dec-8dae-b82f47246f11-istiod-ca-cert\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.770052 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.770036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-token\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.870956 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.870926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdvl\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-kube-api-access-xgdvl\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871125 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.870971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-socket\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871125 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.870989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb495ec4-1121-4dec-8dae-b82f47246f11-istiod-ca-cert\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871125 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871102    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-token\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871328 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-data\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871328 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-envoy\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871328 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-certs\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871328 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-credential-socket\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871328 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-socket\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871648 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-podinfo\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871648 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-data\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871771 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-certs\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871771 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871676    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-credential-socket\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.871845 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.871824    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb495ec4-1121-4dec-8dae-b82f47246f11-istiod-ca-cert\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.873713 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.873689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-envoy\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.873904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.873889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-podinfo\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.879928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.879871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-token\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.880148 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.880129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdvl\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-kube-api-access-xgdvl\") pod \"e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") " pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:46.928243 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.928193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:46.945201 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:46.945184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:47.230906 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.230877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"]
Sep 18 14:04:47.232238 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:04:47.232206    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb495ec4_1121_4dec_8dae_b82f47246f11.slice/crio-a3426652f6c975a5e24427346fa74aa4e9db372dc76dc7cfd14e105774785214 WatchSource:0}: Error finding container a3426652f6c975a5e24427346fa74aa4e9db372dc76dc7cfd14e105774785214: Status 404 returned error can't find the container with id a3426652f6c975a5e24427346fa74aa4e9db372dc76dc7cfd14e105774785214
Sep 18 14:04:47.234857 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.234819    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:47.234941 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.234910    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:47.234981 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.234959    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:04:47.622648 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.622544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" event={"ID":"bb495ec4-1121-4dec-8dae-b82f47246f11","Type":"ContainerStarted","Data":"cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba"}
Sep 18 14:04:47.622648 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.622592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" event={"ID":"bb495ec4-1121-4dec-8dae-b82f47246f11","Type":"ContainerStarted","Data":"a3426652f6c975a5e24427346fa74aa4e9db372dc76dc7cfd14e105774785214"}
Sep 18 14:04:47.645707 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.645657    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podStartSLOduration=1.645637644 podStartE2EDuration="1.645637644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:04:47.644979296 +0000 UTC m=+1236.336850892" watchObservedRunningTime="2026-09-18 14:04:47.645637644 +0000 UTC m=+1236.337509241"
Sep 18 14:04:47.945909 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:47.945884    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:48.825182 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:48.825147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:48.951167 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:48.951139    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:49.563903 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:49.563872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:49.632355 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:49.632326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:49.633217 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:49.633199    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:04:49.658654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:49.658579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:50.106679 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:50.106641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:50.907533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:50.907501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:51.740023 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:51.739988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:52.579893 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:52.579845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:53.409894 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:53.409860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:54.072459 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.072418    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:54.072729 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.072481    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:54.091601 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.091561    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:54.407838 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.407733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:54.511170 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.511137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:54.672467 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.672387    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:04:54.679632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.679591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:54.912336 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:54.912307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:55.055562 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:55.055534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:55.348477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:55.348351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:04:56.106866 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:04:56.106833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:05.766622 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:05.766466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:16.731787 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:16.731747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:18.130742 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:18.130703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:18.304579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:18.304544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:19.027127 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:19.027099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:19.566291 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:19.566253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:19.871246 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:19.871166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:20.308276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.308239    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7429-311cda"]
Sep 18 14:05:20.311938 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.311917    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:20.315501 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.315477    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mwrqv\""
Sep 18 14:05:20.318253 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.318228    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-311cda"]
Sep 18 14:05:20.401064 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.401023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrtck\" (UniqueName: \"kubernetes.io/projected/594891ba-563f-437d-8d0d-1a1c8a67640c-kube-api-access-vrtck\") pod \"test-curl-7429-311cda\" (UID: \"594891ba-563f-437d-8d0d-1a1c8a67640c\") " pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:20.501597 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.501564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrtck\" (UniqueName: \"kubernetes.io/projected/594891ba-563f-437d-8d0d-1a1c8a67640c-kube-api-access-vrtck\") pod \"test-curl-7429-311cda\" (UID: \"594891ba-563f-437d-8d0d-1a1c8a67640c\") " pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:20.511461 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.511432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrtck\" (UniqueName: \"kubernetes.io/projected/594891ba-563f-437d-8d0d-1a1c8a67640c-kube-api-access-vrtck\") pod \"test-curl-7429-311cda\" (UID: \"594891ba-563f-437d-8d0d-1a1c8a67640c\") " pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:20.623325 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.623235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:20.673828 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.673777    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 14:05:20.673980 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.673858    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 14:05:20.726180 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.726140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:20.896910 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:20.896883    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-311cda"]
Sep 18 14:05:20.899241 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:05:20.899216    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod594891ba_563f_437d_8d0d_1a1c8a67640c.slice/crio-1b144b7f9e3c312218f05b9e35f49ddf5de4d773776e9dfb9fcfcea14423edc3 WatchSource:0}: Error finding container 1b144b7f9e3c312218f05b9e35f49ddf5de4d773776e9dfb9fcfcea14423edc3: Status 404 returned error can't find the container with id 1b144b7f9e3c312218f05b9e35f49ddf5de4d773776e9dfb9fcfcea14423edc3
Sep 18 14:05:21.615574 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.615547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:21.811938 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.811844    2578 generic.go:356] "Generic (PLEG): container finished" podID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerID="cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba" exitCode=0
Sep 18 14:05:21.811938 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.811922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" event={"ID":"bb495ec4-1121-4dec-8dae-b82f47246f11","Type":"ContainerDied","Data":"cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba"}
Sep 18 14:05:21.812404 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.812394    2578 scope.go:117] "RemoveContainer" containerID="cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba"
Sep 18 14:05:21.813670 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.813634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-311cda" event={"ID":"594891ba-563f-437d-8d0d-1a1c8a67640c","Type":"ContainerStarted","Data":"ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22"}
Sep 18 14:05:21.813807 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.813682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-311cda" event={"ID":"594891ba-563f-437d-8d0d-1a1c8a67640c","Type":"ContainerStarted","Data":"1b144b7f9e3c312218f05b9e35f49ddf5de4d773776e9dfb9fcfcea14423edc3"}
Sep 18 14:05:21.813807 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.813700    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:05:21.813807 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.813762    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:05:21.813807 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.813792    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:05:21.850399 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:21.850216    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7429-311cda" podStartSLOduration=1.850197598 podStartE2EDuration="1.850197598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:21.847827469 +0000 UTC m=+1270.539699065" watchObservedRunningTime="2026-09-18 14:05:21.850197598 +0000 UTC m=+1270.542069193"
Sep 18 14:05:22.413721 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.413681    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7429-311cda"]
Sep 18 14:05:22.417670 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.417636    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7429-311cda"]
Sep 18 14:05:22.522884 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.522800    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7429-43137c"]
Sep 18 14:05:22.523184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.523171    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594891ba-563f-437d-8d0d-1a1c8a67640c" containerName="test-curl-7429-311cda"
Sep 18 14:05:22.523230 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.523185    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="594891ba-563f-437d-8d0d-1a1c8a67640c" containerName="test-curl-7429-311cda"
Sep 18 14:05:22.523269 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.523246    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="594891ba-563f-437d-8d0d-1a1c8a67640c" containerName="test-curl-7429-311cda"
Sep 18 14:05:22.525292 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.525276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:22.531424 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.531399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-43137c"]
Sep 18 14:05:22.622924 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.622889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkj42\" (UniqueName: \"kubernetes.io/projected/a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1-kube-api-access-rkj42\") pod \"test-curl-7429-43137c\" (UID: \"a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1\") " pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:22.723676 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.723644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkj42\" (UniqueName: \"kubernetes.io/projected/a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1-kube-api-access-rkj42\") pod \"test-curl-7429-43137c\" (UID: \"a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1\") " pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:22.734054 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.734027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkj42\" (UniqueName: \"kubernetes.io/projected/a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1-kube-api-access-rkj42\") pod \"test-curl-7429-43137c\" (UID: \"a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1\") " pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:22.820925 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.820819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" event={"ID":"bb495ec4-1121-4dec-8dae-b82f47246f11","Type":"ContainerStarted","Data":"44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0"}
Sep 18 14:05:22.821350 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:22.820992    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7429-311cda" container="test-curl-7429-311cda"
Sep 18 14:05:22.836234 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.836212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:22.946196 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.946170    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:05:22.946397 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.946376    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 18 14:05:22.946446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:22.946423    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 18 14:05:23.131727 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:23.131704    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-43137c"]
Sep 18 14:05:23.133788 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:05:23.133754    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda21b39a9_9cbb_44b8_aa8a_048b0d4fe7c1.slice/crio-854f2450637d41f92413b76de4213b5cb186f583657aecf4005e9d47501f9b66 WatchSource:0}: Error finding container 854f2450637d41f92413b76de4213b5cb186f583657aecf4005e9d47501f9b66: Status 404 returned error can't find the container with id 854f2450637d41f92413b76de4213b5cb186f583657aecf4005e9d47501f9b66
Sep 18 14:05:23.828109 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:23.828072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-43137c" event={"ID":"a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1","Type":"ContainerStarted","Data":"9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b"}
Sep 18 14:05:23.828109 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:23.828116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-43137c" event={"ID":"a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1","Type":"ContainerStarted","Data":"854f2450637d41f92413b76de4213b5cb186f583657aecf4005e9d47501f9b66"}
Sep 18 14:05:23.828567 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:23.828511    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7429-311cda" podUID="594891ba-563f-437d-8d0d-1a1c8a67640c" containerName="test-curl-7429-311cda" containerID="cri-o://ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22" gracePeriod=2
Sep 18 14:05:23.844578 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:23.844532    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7429-43137c" podStartSLOduration=1.844518895 podStartE2EDuration="1.844518895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:23.842574054 +0000 UTC m=+1272.534445648" watchObservedRunningTime="2026-09-18 14:05:23.844518895 +0000 UTC m=+1272.536390490"
Sep 18 14:05:23.845177 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:23.845154    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-311cda\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="594891ba-563f-437d-8d0d-1a1c8a67640c" pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:23.946593 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:23.946559    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 18 14:05:23.946771 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:23.946634    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 18 14:05:24.517140 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.517055    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7429-43137c"]
Sep 18 14:05:24.524161 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.524133    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7429-43137c"]
Sep 18 14:05:24.633209 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.633177    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7429-ad38ab"]
Sep 18 14:05:24.633574 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.633561    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" containerName="test-curl-7429-43137c"
Sep 18 14:05:24.633647 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.633576    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" containerName="test-curl-7429-43137c"
Sep 18 14:05:24.633685 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.633679    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" containerName="test-curl-7429-43137c"
Sep 18 14:05:24.635587 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.635569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:24.642427 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.642406    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-ad38ab"]
Sep 18 14:05:24.742301 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.742266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbmnt\" (UniqueName: \"kubernetes.io/projected/8ed6b031-32c1-4397-9483-d258deab74f5-kube-api-access-zbmnt\") pod \"test-curl-7429-ad38ab\" (UID: \"8ed6b031-32c1-4397-9483-d258deab74f5\") " pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:24.833813 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:24.833721    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7429-43137c" container="test-curl-7429-43137c"
Sep 18 14:05:24.842936 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.842912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbmnt\" (UniqueName: \"kubernetes.io/projected/8ed6b031-32c1-4397-9483-d258deab74f5-kube-api-access-zbmnt\") pod \"test-curl-7429-ad38ab\" (UID: \"8ed6b031-32c1-4397-9483-d258deab74f5\") " pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:24.862200 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.862165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbmnt\" (UniqueName: \"kubernetes.io/projected/8ed6b031-32c1-4397-9483-d258deab74f5-kube-api-access-zbmnt\") pod \"test-curl-7429-ad38ab\" (UID: \"8ed6b031-32c1-4397-9483-d258deab74f5\") " pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:24.946100 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.946070    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:24.946348 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.946325    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 18 14:05:24.946447 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:24.946379    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 18 14:05:25.235666 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:25.235640    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-ad38ab"]
Sep 18 14:05:25.237066 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:05:25.237034    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ed6b031_32c1_4397_9483_d258deab74f5.slice/crio-877709c0b0c126c975822a619e70875bdcd7593cc7026554e430999fe56f976d WatchSource:0}: Error finding container 877709c0b0c126c975822a619e70875bdcd7593cc7026554e430999fe56f976d: Status 404 returned error can't find the container with id 877709c0b0c126c975822a619e70875bdcd7593cc7026554e430999fe56f976d
Sep 18 14:05:25.841229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:25.841195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-ad38ab" event={"ID":"8ed6b031-32c1-4397-9483-d258deab74f5","Type":"ContainerStarted","Data":"d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99"}
Sep 18 14:05:25.841567 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:25.841247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-ad38ab" event={"ID":"8ed6b031-32c1-4397-9483-d258deab74f5","Type":"ContainerStarted","Data":"877709c0b0c126c975822a619e70875bdcd7593cc7026554e430999fe56f976d"}
Sep 18 14:05:25.841567 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:25.841331    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7429-43137c" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" containerName="test-curl-7429-43137c" containerID="cri-o://9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b" gracePeriod=2
Sep 18 14:05:25.859101 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:25.859043    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7429-ad38ab" podStartSLOduration=1.8590225820000001 podStartE2EDuration="1.859022582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:25.856337364 +0000 UTC m=+1274.548208962" watchObservedRunningTime="2026-09-18 14:05:25.859022582 +0000 UTC m=+1274.550894172"
Sep 18 14:05:25.860900 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:25.860864    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-43137c\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:25.946483 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:25.946457    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 18 14:05:25.946620 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:25.946512    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 18 14:05:26.025991 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.025889    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:26.157439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.157345    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrtck\" (UniqueName: \"kubernetes.io/projected/594891ba-563f-437d-8d0d-1a1c8a67640c-kube-api-access-vrtck\") pod \"594891ba-563f-437d-8d0d-1a1c8a67640c\" (UID: \"594891ba-563f-437d-8d0d-1a1c8a67640c\") "
Sep 18 14:05:26.170757 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.170720    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594891ba-563f-437d-8d0d-1a1c8a67640c-kube-api-access-vrtck" (OuterVolumeSpecName: "kube-api-access-vrtck") pod "594891ba-563f-437d-8d0d-1a1c8a67640c" (UID: "594891ba-563f-437d-8d0d-1a1c8a67640c"). InnerVolumeSpecName "kube-api-access-vrtck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:26.259034 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.258996    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrtck\" (UniqueName: \"kubernetes.io/projected/594891ba-563f-437d-8d0d-1a1c8a67640c-kube-api-access-vrtck\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:26.450848 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.450817    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7429-ad38ab"]
Sep 18 14:05:26.456869 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.456834    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7429-ad38ab"]
Sep 18 14:05:26.574635 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.574112    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7429-dcdecf"]
Sep 18 14:05:26.574841 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.574719    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" containerName="test-curl-7429-ad38ab"
Sep 18 14:05:26.574841 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.574741    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" containerName="test-curl-7429-ad38ab"
Sep 18 14:05:26.574841 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.574826    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" containerName="test-curl-7429-ad38ab"
Sep 18 14:05:26.578123 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.578025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:26.581231 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.581207    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-dcdecf"]
Sep 18 14:05:26.669359 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.669192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmwks\" (UniqueName: \"kubernetes.io/projected/fcd30639-6c29-4b13-985e-a5b415c1624d-kube-api-access-cmwks\") pod \"test-curl-7429-dcdecf\" (UID: \"fcd30639-6c29-4b13-985e-a5b415c1624d\") " pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:26.770783 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.770262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmwks\" (UniqueName: \"kubernetes.io/projected/fcd30639-6c29-4b13-985e-a5b415c1624d-kube-api-access-cmwks\") pod \"test-curl-7429-dcdecf\" (UID: \"fcd30639-6c29-4b13-985e-a5b415c1624d\") " pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:26.780124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.780091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmwks\" (UniqueName: \"kubernetes.io/projected/fcd30639-6c29-4b13-985e-a5b415c1624d-kube-api-access-cmwks\") pod \"test-curl-7429-dcdecf\" (UID: \"fcd30639-6c29-4b13-985e-a5b415c1624d\") " pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:26.847347 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.847319    2578 generic.go:356] "Generic (PLEG): container finished" podID="594891ba-563f-437d-8d0d-1a1c8a67640c" containerID="ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22" exitCode=137
Sep 18 14:05:26.847347 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.847349    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:26.847792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.847401    2578 scope.go:117] "RemoveContainer" containerID="ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22"
Sep 18 14:05:26.847792 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:26.847739    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7429-ad38ab" container="test-curl-7429-ad38ab"
Sep 18 14:05:26.866557 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.866531    2578 scope.go:117] "RemoveContainer" containerID="ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22"
Sep 18 14:05:26.868231 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:26.868169    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22\": container with ID starting with ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22 not found: ID does not exist" containerID="ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22"
Sep 18 14:05:26.868231 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.868220    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22"} err="failed to get container status \"ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22\": rpc error: code = NotFound desc = could not find container \"ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22\": container with ID starting with ba48ee8ce2dc1e2da5e98d194fc0a151861dfc6867ee9d1eb3b872200348fa22 not found: ID does not exist"
Sep 18 14:05:26.874659 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:26.874623    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-311cda\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="594891ba-563f-437d-8d0d-1a1c8a67640c" pod="opendatahub/test-curl-7429-311cda"
Sep 18 14:05:26.889698 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.889678    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:26.946945 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.946918    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 18 14:05:26.947175 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:26.947130    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 18 14:05:27.163190 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.163162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7429-dcdecf"]
Sep 18 14:05:27.853184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.853147    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594891ba-563f-437d-8d0d-1a1c8a67640c" path="/var/lib/kubelet/pods/594891ba-563f-437d-8d0d-1a1c8a67640c/volumes"
Sep 18 14:05:27.864192 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.863383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-dcdecf" event={"ID":"fcd30639-6c29-4b13-985e-a5b415c1624d","Type":"ContainerStarted","Data":"ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551"}
Sep 18 14:05:27.864192 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.863433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7429-dcdecf" event={"ID":"fcd30639-6c29-4b13-985e-a5b415c1624d","Type":"ContainerStarted","Data":"a33a4985ba91effdd302015cc3e7c83fd561c0e0585628b71c9b5ec56a5b6fdf"}
Sep 18 14:05:27.868629 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.865464    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7429-ad38ab" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" containerName="test-curl-7429-ad38ab" containerID="cri-o://d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99" gracePeriod=2
Sep 18 14:05:27.881589 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.881503    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7429-dcdecf" podStartSLOduration=1.881481651 podStartE2EDuration="1.881481651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:27.880237095 +0000 UTC m=+1276.572108691" watchObservedRunningTime="2026-09-18 14:05:27.881481651 +0000 UTC m=+1276.573353246"
Sep 18 14:05:27.946495 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.946460    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 18 14:05:27.946644 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:27.946529    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 18 14:05:28.024993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.024972    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:28.089856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.089829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkj42\" (UniqueName: \"kubernetes.io/projected/a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1-kube-api-access-rkj42\") pod \"a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1\" (UID: \"a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1\") "
Sep 18 14:05:28.092159 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.092128    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1-kube-api-access-rkj42" (OuterVolumeSpecName: "kube-api-access-rkj42") pod "a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" (UID: "a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1"). InnerVolumeSpecName "kube-api-access-rkj42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:28.191111 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.191070    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkj42\" (UniqueName: \"kubernetes.io/projected/a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1-kube-api-access-rkj42\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:28.440653 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.440593    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7429-dcdecf"]
Sep 18 14:05:28.444452 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.444429    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7429-dcdecf"]
Sep 18 14:05:28.871964 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.871871    2578 generic.go:356] "Generic (PLEG): container finished" podID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" containerID="9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b" exitCode=137
Sep 18 14:05:28.871964 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.871911    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:28.872479 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.871969    2578 scope.go:117] "RemoveContainer" containerID="9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b"
Sep 18 14:05:28.872479 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:28.872327    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7429-dcdecf" container="test-curl-7429-dcdecf"
Sep 18 14:05:28.880988 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.880972    2578 scope.go:117] "RemoveContainer" containerID="9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b"
Sep 18 14:05:28.881257 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:28.881240    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b\": container with ID starting with 9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b not found: ID does not exist" containerID="9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b"
Sep 18 14:05:28.881318 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.881269    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b"} err="failed to get container status \"9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b\": rpc error: code = NotFound desc = could not find container \"9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b\": container with ID starting with 9713d5f22675fecdded12b6abb6107d9491f14571769e7bcb139626ba4a8850b not found: ID does not exist"
Sep 18 14:05:28.882657 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:28.882629    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-43137c\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:28.949230 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.949209    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:05:28.949665 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.949647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:05:28.950274 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:28.950259    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:05:28.975095 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:28.975066    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-43137c\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:29.002493 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:29.002466    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-43137c\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:29.005978 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.005954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:29.290489 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.290449    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"]
Sep 18 14:05:29.290961 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.290941    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd30639-6c29-4b13-985e-a5b415c1624d" containerName="test-curl-7429-dcdecf"
Sep 18 14:05:29.291067 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.290962    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd30639-6c29-4b13-985e-a5b415c1624d" containerName="test-curl-7429-dcdecf"
Sep 18 14:05:29.291067 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.291060    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd30639-6c29-4b13-985e-a5b415c1624d" containerName="test-curl-7429-dcdecf"
Sep 18 14:05:29.293445 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.293425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.296679 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.296657    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-31cca2d1-openshift-default-dockercfg-v9fsk\""
Sep 18 14:05:29.310823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.310803    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"]
Sep 18 14:05:29.316895 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.316871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:29.326133 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:29.326108    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-43137c\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" pod="opendatahub/test-curl-7429-43137c"
Sep 18 14:05:29.404442 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-certs\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.404754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-credential-socket\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.404754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-data\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.404754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c058d-debf-4139-86bc-2727fc7c8121-istiod-ca-cert\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.404754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-socket\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.404754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c058d-debf-4139-86bc-2727fc7c8121-istio-podinfo\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.404754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-istio-token\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.405118 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfkf\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-kube-api-access-pmfkf\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.405118 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.404826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-envoy\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.450223 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.450190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:29.506226 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.506189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfkf\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-kube-api-access-pmfkf\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.506464 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.506261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-envoy\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.506464 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.506340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-certs\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.506464 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.506368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-credential-socket\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507279 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.507003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-data\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.507316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c058d-debf-4139-86bc-2727fc7c8121-istiod-ca-cert\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.506938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-credential-socket\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.507234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-data\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507602 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.506832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-certs\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507724 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.507697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-socket\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507812 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.507761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c058d-debf-4139-86bc-2727fc7c8121-istio-podinfo\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.507915 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.507836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-istio-token\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.508116 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.508084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-socket\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.508348 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.508317    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c058d-debf-4139-86bc-2727fc7c8121-istiod-ca-cert\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.509250 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.509225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-envoy\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.510505 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.510485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c058d-debf-4139-86bc-2727fc7c8121-istio-podinfo\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.516100 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.516076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfkf\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-kube-api-access-pmfkf\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.516955 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.516933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-istio-token\") pod \"e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") " pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.603316 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.603243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:29.851679 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.851644    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1" path="/var/lib/kubelet/pods/a21b39a9-9cbb-44b8-aa8a-048b0d4fe7c1/volumes"
Sep 18 14:05:29.879369 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.879287    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7429-dcdecf" podUID="fcd30639-6c29-4b13-985e-a5b415c1624d" containerName="test-curl-7429-dcdecf" containerID="cri-o://ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551" gracePeriod=2
Sep 18 14:05:29.881620 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.881586    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"]
Sep 18 14:05:29.883306 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:05:29.883277    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98c058d_debf_4139_86bc_2727fc7c8121.slice/crio-7dd4cfe3da5c8f2c35719417c30a4782228b9cc765de260dd6254690c7bb5c3c WatchSource:0}: Error finding container 7dd4cfe3da5c8f2c35719417c30a4782228b9cc765de260dd6254690c7bb5c3c: Status 404 returned error can't find the container with id 7dd4cfe3da5c8f2c35719417c30a4782228b9cc765de260dd6254690c7bb5c3c
Sep 18 14:05:29.928432 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.928400    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:05:29.928533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.928467    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:05:29.928533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:29.928494    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:05:30.056475 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.056450    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:30.214151 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.214112    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbmnt\" (UniqueName: \"kubernetes.io/projected/8ed6b031-32c1-4397-9483-d258deab74f5-kube-api-access-zbmnt\") pod \"8ed6b031-32c1-4397-9483-d258deab74f5\" (UID: \"8ed6b031-32c1-4397-9483-d258deab74f5\") "
Sep 18 14:05:30.216339 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.216307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed6b031-32c1-4397-9483-d258deab74f5-kube-api-access-zbmnt" (OuterVolumeSpecName: "kube-api-access-zbmnt") pod "8ed6b031-32c1-4397-9483-d258deab74f5" (UID: "8ed6b031-32c1-4397-9483-d258deab74f5"). InnerVolumeSpecName "kube-api-access-zbmnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:30.315171 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.315143    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbmnt\" (UniqueName: \"kubernetes.io/projected/8ed6b031-32c1-4397-9483-d258deab74f5-kube-api-access-zbmnt\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:30.885391 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.885288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" event={"ID":"d98c058d-debf-4139-86bc-2727fc7c8121","Type":"ContainerStarted","Data":"6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f"}
Sep 18 14:05:30.885391 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.885347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" event={"ID":"d98c058d-debf-4139-86bc-2727fc7c8121","Type":"ContainerStarted","Data":"7dd4cfe3da5c8f2c35719417c30a4782228b9cc765de260dd6254690c7bb5c3c"}
Sep 18 14:05:30.886658 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.886632    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ed6b031-32c1-4397-9483-d258deab74f5" containerID="d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99" exitCode=137
Sep 18 14:05:30.886781 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.886660    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:30.886781 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.886685    2578 scope.go:117] "RemoveContainer" containerID="d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99"
Sep 18 14:05:30.895678 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.895662    2578 scope.go:117] "RemoveContainer" containerID="d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99"
Sep 18 14:05:30.895911 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:30.895895    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99\": container with ID starting with d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99 not found: ID does not exist" containerID="d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99"
Sep 18 14:05:30.895952 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.895919    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99"} err="failed to get container status \"d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99\": rpc error: code = NotFound desc = could not find container \"d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99\": container with ID starting with d982d974f70c4407722277687b12f18c0258e4bad212f0e91c751439b5184b99 not found: ID does not exist"
Sep 18 14:05:30.908450 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:30.908391    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podStartSLOduration=1.908376093 podStartE2EDuration="1.908376093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:05:30.9069108 +0000 UTC m=+1279.598782398" watchObservedRunningTime="2026-09-18 14:05:30.908376093 +0000 UTC m=+1279.600247688"
Sep 18 14:05:30.909259 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:30.909237    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-ad38ab\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:31.604242 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:31.604205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:31.609546 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:31.609518    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:31.612439 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:31.612413    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-ad38ab\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:31.849769 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:31.849726    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-ad38ab\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" pod="opendatahub/test-curl-7429-ad38ab"
Sep 18 14:05:31.851140 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:31.851109    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed6b031-32c1-4397-9483-d258deab74f5" path="/var/lib/kubelet/pods/8ed6b031-32c1-4397-9483-d258deab74f5/volumes"
Sep 18 14:05:31.894057 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:31.894033    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:31.894986 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:31.894969    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:05:32.054369 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.054346    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:32.132971 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.132944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmwks\" (UniqueName: \"kubernetes.io/projected/fcd30639-6c29-4b13-985e-a5b415c1624d-kube-api-access-cmwks\") pod \"fcd30639-6c29-4b13-985e-a5b415c1624d\" (UID: \"fcd30639-6c29-4b13-985e-a5b415c1624d\") "
Sep 18 14:05:32.135149 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.135094    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd30639-6c29-4b13-985e-a5b415c1624d-kube-api-access-cmwks" (OuterVolumeSpecName: "kube-api-access-cmwks") pod "fcd30639-6c29-4b13-985e-a5b415c1624d" (UID: "fcd30639-6c29-4b13-985e-a5b415c1624d"). InnerVolumeSpecName "kube-api-access-cmwks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:32.207941 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.207904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:32.234199 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.234172    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmwks\" (UniqueName: \"kubernetes.io/projected/fcd30639-6c29-4b13-985e-a5b415c1624d-kube-api-access-cmwks\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:32.795217 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.795179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:32.885829 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.885800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:32.899890 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.899860    2578 generic.go:356] "Generic (PLEG): container finished" podID="fcd30639-6c29-4b13-985e-a5b415c1624d" containerID="ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551" exitCode=137
Sep 18 14:05:32.900308 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.899905    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:32.900308 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.899960    2578 scope.go:117] "RemoveContainer" containerID="ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551"
Sep 18 14:05:32.909135 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.909119    2578 scope.go:117] "RemoveContainer" containerID="ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551"
Sep 18 14:05:32.909410 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:32.909393    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551\": container with ID starting with ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551 not found: ID does not exist" containerID="ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551"
Sep 18 14:05:32.909460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:32.909420    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551"} err="failed to get container status \"ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551\": rpc error: code = NotFound desc = could not find container \"ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551\": container with ID starting with ab3dff9e776c758f3d0be5d1d4e7dd8c98485c929e34f8e2af1e0755f18c6551 not found: ID does not exist"
Sep 18 14:05:32.910097 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:05:32.910076    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7429-dcdecf\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="fcd30639-6c29-4b13-985e-a5b415c1624d" pod="opendatahub/test-curl-7429-dcdecf"
Sep 18 14:05:33.221880 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:33.221845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:33.851390 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:33.851345    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd30639-6c29-4b13-985e-a5b415c1624d" path="/var/lib/kubelet/pods/fcd30639-6c29-4b13-985e-a5b415c1624d/volumes"
Sep 18 14:05:34.224351 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:34.224322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:34.975193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:34.975155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:35.826967 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:35.826936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:36.527527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:36.527493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:36.790411 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:36.790326    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"]
Sep 18 14:05:36.790564 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:36.790538    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp" podUID="f247c75e-b3b5-4b0b-a09a-a2277e6d584c" containerName="istio-proxy" containerID="cri-o://828b7a57ea2a9346d45ab71e903cd5a514751b2227b3906898389ce00b6694a9" gracePeriod=30
Sep 18 14:05:36.812410 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:36.812379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:37.025513 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:37.025477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:37.126085 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:37.126009    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:37.306770 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:37.306741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:38.210542 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:38.210514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:38.312943 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:38.312905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:38.411195 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:38.411164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:38.720850 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:38.720820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:38.818411 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:38.818374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:39.499931 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:39.499892    2578 patch_prober.go:28] interesting pod/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:05:39.500279 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:39.499955    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp" podUID="f247c75e-b3b5-4b0b-a09a-a2277e6d584c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:05:41.956167 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:41.956133    2578 generic.go:356] "Generic (PLEG): container finished" podID="f247c75e-b3b5-4b0b-a09a-a2277e6d584c" containerID="828b7a57ea2a9346d45ab71e903cd5a514751b2227b3906898389ce00b6694a9" exitCode=0
Sep 18 14:05:41.956520 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:41.956218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp" event={"ID":"f247c75e-b3b5-4b0b-a09a-a2277e6d584c","Type":"ContainerDied","Data":"828b7a57ea2a9346d45ab71e903cd5a514751b2227b3906898389ce00b6694a9"}
Sep 18 14:05:42.032971 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.032949    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:05:42.128193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128114    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-certs\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128152    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-envoy\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-token\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128419 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128203    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-podinfo\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128419 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128315    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-data\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clrpr\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-kube-api-access-clrpr\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128487    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-credential-socket\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:42.128728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-socket\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:42.128728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128636    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istiod-ca-cert\") pod \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\" (UID: \"f247c75e-b3b5-4b0b-a09a-a2277e6d584c\") "
Sep 18 14:05:42.128912 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128813    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:42.128912 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.128805    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:42.129405 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.129385    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.129588 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.129566    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.129588 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.129589    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.129806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.129622    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.129806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.129416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:05:42.130882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.130856    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:42.131022 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.131003    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:05:42.131150 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.131133    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:05:42.131521 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.131499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-kube-api-access-clrpr" (OuterVolumeSpecName: "kube-api-access-clrpr") pod "f247c75e-b3b5-4b0b-a09a-a2277e6d584c" (UID: "f247c75e-b3b5-4b0b-a09a-a2277e6d584c"). InnerVolumeSpecName "kube-api-access-clrpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:05:42.187754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.187722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:42.231134 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.231108    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clrpr\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-kube-api-access-clrpr\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.231134 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.231132    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.231272 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.231142    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.231272 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.231151    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.231272 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.231159    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f247c75e-b3b5-4b0b-a09a-a2277e6d584c-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:05:42.963018 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.962982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp" event={"ID":"f247c75e-b3b5-4b0b-a09a-a2277e6d584c","Type":"ContainerDied","Data":"5023f7ca3b80704da6a45a29ca7e9a58ed60a7259bb7132032de2544f3517794"}
Sep 18 14:05:42.963018 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.963001    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"
Sep 18 14:05:42.963524 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.963051    2578 scope.go:117] "RemoveContainer" containerID="828b7a57ea2a9346d45ab71e903cd5a514751b2227b3906898389ce00b6694a9"
Sep 18 14:05:42.985589 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.985557    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"]
Sep 18 14:05:42.988661 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:42.988640    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-3b3206-openshift-default-5bb749758d-tnqlp"]
Sep 18 14:05:43.851265 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:43.851237    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f247c75e-b3b5-4b0b-a09a-a2277e6d584c" path="/var/lib/kubelet/pods/f247c75e-b3b5-4b0b-a09a-a2277e6d584c/volumes"
Sep 18 14:05:53.109158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:53.109124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:53.899601 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:53.899571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:54.624100 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:54.624067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:55.489887 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:55.489857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:56.227047 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:56.227003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:57.218914 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:57.218882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:57.693792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:57.693755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:58.116330 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:58.116233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:58.863187 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:58.863154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:05:59.615213 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:05:59.615179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:00.430000 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:00.429970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:01.410489 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:01.410450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:02.336223 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:02.336180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:03.054576 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:03.054529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:03.913320 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:03.913283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:04.656965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:04.656924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:04.677183 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:04.677150    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"]
Sep 18 14:06:04.677474 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:04.677425    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt" podUID="0d2ba86a-7c74-4e11-b655-178fccf94d4a" containerName="payload-processing" containerID="cri-o://6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7" gracePeriod=30
Sep 18 14:06:04.726991 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:04.726923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:04.830697 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:04.830657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:04.933294 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:04.930405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:04.960387 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:04.960359    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 14:06:05.044948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.044912    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2ba86a-7c74-4e11-b655-178fccf94d4a-plugins-config-volume\") pod \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") "
Sep 18 14:06:05.045155 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.045069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs2bz\" (UniqueName: \"kubernetes.io/projected/0d2ba86a-7c74-4e11-b655-178fccf94d4a-kube-api-access-fs2bz\") pod \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\" (UID: \"0d2ba86a-7c74-4e11-b655-178fccf94d4a\") "
Sep 18 14:06:05.045984 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.045884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d2ba86a-7c74-4e11-b655-178fccf94d4a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d2ba86a-7c74-4e11-b655-178fccf94d4a" (UID: "0d2ba86a-7c74-4e11-b655-178fccf94d4a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:05.047922 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.047892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2ba86a-7c74-4e11-b655-178fccf94d4a-kube-api-access-fs2bz" (OuterVolumeSpecName: "kube-api-access-fs2bz") pod "0d2ba86a-7c74-4e11-b655-178fccf94d4a" (UID: "0d2ba86a-7c74-4e11-b655-178fccf94d4a"). InnerVolumeSpecName "kube-api-access-fs2bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:05.085576 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.085546    2578 generic.go:356] "Generic (PLEG): container finished" podID="0d2ba86a-7c74-4e11-b655-178fccf94d4a" containerID="6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7" exitCode=0
Sep 18 14:06:05.085776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.085652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt" event={"ID":"0d2ba86a-7c74-4e11-b655-178fccf94d4a","Type":"ContainerDied","Data":"6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7"}
Sep 18 14:06:05.085776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.085682    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"
Sep 18 14:06:05.085776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.085708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt" event={"ID":"0d2ba86a-7c74-4e11-b655-178fccf94d4a","Type":"ContainerDied","Data":"2b576481a68f756a2cf425e83d7dfa8b38bf60c48080b8e14d608fb98c539dfa"}
Sep 18 14:06:05.085776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.085737    2578 scope.go:117] "RemoveContainer" containerID="6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7"
Sep 18 14:06:05.099922 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.099898    2578 scope.go:117] "RemoveContainer" containerID="6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7"
Sep 18 14:06:05.100273 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:06:05.100231    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7\": container with ID starting with 6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7 not found: ID does not exist" containerID="6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7"
Sep 18 14:06:05.100369 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.100271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7"} err="failed to get container status \"6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7\": rpc error: code = NotFound desc = could not find container \"6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7\": container with ID starting with 6b0be46a1dbe66cc68e1f3470ded7210e49538c23ed2302679bcba722ca76ec7 not found: ID does not exist"
Sep 18 14:06:05.109093 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.109070    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"]
Sep 18 14:06:05.113739 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.113719    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-036fc2-567d6f6f6f-xmmxt"]
Sep 18 14:06:05.146831 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.146801    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d2ba86a-7c74-4e11-b655-178fccf94d4a-plugins-config-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:05.146831 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.146827    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs2bz\" (UniqueName: \"kubernetes.io/projected/0d2ba86a-7c74-4e11-b655-178fccf94d4a-kube-api-access-fs2bz\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:05.192749 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.192686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:05.292332 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.292305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:05.852043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.852008    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d2ba86a-7c74-4e11-b655-178fccf94d4a" path="/var/lib/kubelet/pods/0d2ba86a-7c74-4e11-b655-178fccf94d4a/volumes"
Sep 18 14:06:05.931680 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:05.931644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:06.714298 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:06.714267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:07.100060 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:07.099977    2578 generic.go:356] "Generic (PLEG): container finished" podID="d98c058d-debf-4139-86bc-2727fc7c8121" containerID="6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f" exitCode=0
Sep 18 14:06:07.100204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:07.100051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" event={"ID":"d98c058d-debf-4139-86bc-2727fc7c8121","Type":"ContainerDied","Data":"6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f"}
Sep 18 14:06:07.100445 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:07.100429    2578 scope.go:117] "RemoveContainer" containerID="6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f"
Sep 18 14:06:07.101651 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:07.101596    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:06:07.101712 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:07.101698    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:06:07.101756 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:07.101734    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:06:07.611948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:07.611909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:08.107285 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:08.107251    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" event={"ID":"d98c058d-debf-4139-86bc-2727fc7c8121","Type":"ContainerStarted","Data":"aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f"}
Sep 18 14:06:08.334378 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:08.334340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:08.604015 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:08.603979    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:06:08.604319 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:08.604298    2578 patch_prober.go:28] interesting pod/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 18 14:06:08.604368 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:08.604347    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 18 14:06:09.072271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:09.072236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:09.604580 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:09.604547    2578 patch_prober.go:28] interesting pod/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 18 14:06:09.605008 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:09.604602    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 18 14:06:09.929475 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:09.929386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:10.284794 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:10.284759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:10.603947 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:10.603863    2578 patch_prober.go:28] interesting pod/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 18 14:06:10.603947 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:10.603923    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 18 14:06:11.604379 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:11.604338    2578 patch_prober.go:28] interesting pod/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 18 14:06:11.604914 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:11.604447    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 18 14:06:11.915901 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:11.915822    2578 scope.go:117] "RemoveContainer" containerID="f712a1d7dd11c7be1041c195a62c26ddfc0bc637eef1dbe625c0f8a48cce4d51"
Sep 18 14:06:12.604082 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:12.604051    2578 patch_prober.go:28] interesting pod/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 18 14:06:12.604290 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:12.604109    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 18 14:06:13.604204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:13.604161    2578 patch_prober.go:28] interesting pod/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 18 14:06:13.604728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:13.604265    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 18 14:06:13.840659 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:13.840622    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:14.608164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:14.608133    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:06:14.608531 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:14.608500    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:06:14.609230 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:14.609213    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:06:16.470754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:16.470718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:17.075050 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:17.075019    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"]
Sep 18 14:06:17.131628 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:17.131581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:19.345658 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:19.345600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:24.466139 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.466106    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"]
Sep 18 14:06:24.466581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.466474    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d2ba86a-7c74-4e11-b655-178fccf94d4a" containerName="payload-processing"
Sep 18 14:06:24.466581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.466486    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d2ba86a-7c74-4e11-b655-178fccf94d4a" containerName="payload-processing"
Sep 18 14:06:24.466581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.466497    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f247c75e-b3b5-4b0b-a09a-a2277e6d584c" containerName="istio-proxy"
Sep 18 14:06:24.466581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.466502    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f247c75e-b3b5-4b0b-a09a-a2277e6d584c" containerName="istio-proxy"
Sep 18 14:06:24.466581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.466564    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f247c75e-b3b5-4b0b-a09a-a2277e6d584c" containerName="istio-proxy"
Sep 18 14:06:24.466581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.466573    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d2ba86a-7c74-4e11-b655-178fccf94d4a" containerName="payload-processing"
Sep 18 14:06:24.469425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.469394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.472404 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.472383    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-40970f\"/\"distinct-2-w0-40970f-kserve-self-signed-certs\""
Sep 18 14:06:24.479657 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.479630    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"]
Sep 18 14:06:24.499549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.499518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:24.541831 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.541789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-home\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.542019 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.541853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-dshm\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.542019 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.541926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-model-cache\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.542019 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.541959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26w8p\" (UniqueName: \"kubernetes.io/projected/401027ba-7ef0-4c9f-996d-b7c4c92353b1-kube-api-access-26w8p\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.542019 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.542011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tmp-dir\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.542166 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.542029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tls-certs\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.642926 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.642882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26w8p\" (UniqueName: \"kubernetes.io/projected/401027ba-7ef0-4c9f-996d-b7c4c92353b1-kube-api-access-26w8p\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.642971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tmp-dir\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.643001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tls-certs\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.643020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-home\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.643066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-dshm\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.643125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-model-cache\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643399 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.643328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tmp-dir\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643399 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.643387    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-home\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.643505 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.643442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-model-cache\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.645389 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.645368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-dshm\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.645661 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.645643    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tls-certs\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.651722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.651701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26w8p\" (UniqueName: \"kubernetes.io/projected/401027ba-7ef0-4c9f-996d-b7c4c92353b1-kube-api-access-26w8p\") pod \"distinct-2-w0-40970f-kserve-7b596459f8-6h7b8\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") " pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:24.781533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:24.781445    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:25.056423 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:25.056398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"]
Sep 18 14:06:25.058445 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:06:25.058422    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod401027ba_7ef0_4c9f_996d_b7c4c92353b1.slice/crio-71f57c410e7c49f11fbf3f224caf8fe049130cec1d6afe94075ccf0e68e26979 WatchSource:0}: Error finding container 71f57c410e7c49f11fbf3f224caf8fe049130cec1d6afe94075ccf0e68e26979: Status 404 returned error can't find the container with id 71f57c410e7c49f11fbf3f224caf8fe049130cec1d6afe94075ccf0e68e26979
Sep 18 14:06:25.194010 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:25.193969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8" event={"ID":"401027ba-7ef0-4c9f-996d-b7c4c92353b1","Type":"ContainerStarted","Data":"44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126"}
Sep 18 14:06:25.194171 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:25.194021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8" event={"ID":"401027ba-7ef0-4c9f-996d-b7c4c92353b1","Type":"ContainerStarted","Data":"71f57c410e7c49f11fbf3f224caf8fe049130cec1d6afe94075ccf0e68e26979"}
Sep 18 14:06:25.212527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:25.212482    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8" podStartSLOduration=1.212465985 podStartE2EDuration="1.212465985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:06:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:06:25.211351485 +0000 UTC m=+1333.903223081" watchObservedRunningTime="2026-09-18 14:06:25.212465985 +0000 UTC m=+1333.904337581"
Sep 18 14:06:30.351089 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:30.351047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:32.094358 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.094316    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw" podUID="00c2d656-5b86-4df3-8491-fa8019e721ae" containerName="main" containerID="cri-o://6d65e37e8c713ac9828a7579dae36d26b1fbffbaebc94ccec0ca09442fb329c9" gracePeriod=45
Sep 18 14:06:32.232705 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.232659    2578 generic.go:356] "Generic (PLEG): container finished" podID="00c2d656-5b86-4df3-8491-fa8019e721ae" containerID="6d65e37e8c713ac9828a7579dae36d26b1fbffbaebc94ccec0ca09442fb329c9" exitCode=0
Sep 18 14:06:32.232875 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.232705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw" event={"ID":"00c2d656-5b86-4df3-8491-fa8019e721ae","Type":"ContainerDied","Data":"6d65e37e8c713ac9828a7579dae36d26b1fbffbaebc94ccec0ca09442fb329c9"}
Sep 18 14:06:32.342800 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.342778    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:06:32.518212 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-model-cache\") pod \"00c2d656-5b86-4df3-8491-fa8019e721ae\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") "
Sep 18 14:06:32.518379 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518226    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-home\") pod \"00c2d656-5b86-4df3-8491-fa8019e721ae\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") "
Sep 18 14:06:32.518379 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-tmp-dir\") pod \"00c2d656-5b86-4df3-8491-fa8019e721ae\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") "
Sep 18 14:06:32.518379 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518307    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00c2d656-5b86-4df3-8491-fa8019e721ae-tls-certs\") pod \"00c2d656-5b86-4df3-8491-fa8019e721ae\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") "
Sep 18 14:06:32.518379 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fhbf\" (UniqueName: \"kubernetes.io/projected/00c2d656-5b86-4df3-8491-fa8019e721ae-kube-api-access-6fhbf\") pod \"00c2d656-5b86-4df3-8491-fa8019e721ae\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") "
Sep 18 14:06:32.518575 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518398    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-dshm\") pod \"00c2d656-5b86-4df3-8491-fa8019e721ae\" (UID: \"00c2d656-5b86-4df3-8491-fa8019e721ae\") "
Sep 18 14:06:32.518575 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518540    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "00c2d656-5b86-4df3-8491-fa8019e721ae" (UID: "00c2d656-5b86-4df3-8491-fa8019e721ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:32.518723 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "00c2d656-5b86-4df3-8491-fa8019e721ae" (UID: "00c2d656-5b86-4df3-8491-fa8019e721ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:32.518723 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-home" (OuterVolumeSpecName: "home") pod "00c2d656-5b86-4df3-8491-fa8019e721ae" (UID: "00c2d656-5b86-4df3-8491-fa8019e721ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:32.518879 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518857    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:32.518879 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518877    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:32.518879 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.518885    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:32.520793 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.520765    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-dshm" (OuterVolumeSpecName: "dshm") pod "00c2d656-5b86-4df3-8491-fa8019e721ae" (UID: "00c2d656-5b86-4df3-8491-fa8019e721ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:06:32.520888 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.520791    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c2d656-5b86-4df3-8491-fa8019e721ae-kube-api-access-6fhbf" (OuterVolumeSpecName: "kube-api-access-6fhbf") pod "00c2d656-5b86-4df3-8491-fa8019e721ae" (UID: "00c2d656-5b86-4df3-8491-fa8019e721ae"). InnerVolumeSpecName "kube-api-access-6fhbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:32.520888 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.520803    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00c2d656-5b86-4df3-8491-fa8019e721ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00c2d656-5b86-4df3-8491-fa8019e721ae" (UID: "00c2d656-5b86-4df3-8491-fa8019e721ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:06:32.620095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.620035    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00c2d656-5b86-4df3-8491-fa8019e721ae-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:32.620095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.620059    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fhbf\" (UniqueName: \"kubernetes.io/projected/00c2d656-5b86-4df3-8491-fa8019e721ae-kube-api-access-6fhbf\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:32.620095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:32.620069    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00c2d656-5b86-4df3-8491-fa8019e721ae-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:33.238876 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:33.238845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"
Sep 18 14:06:33.239365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:33.238893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw" event={"ID":"00c2d656-5b86-4df3-8491-fa8019e721ae","Type":"ContainerDied","Data":"3550da358a48da4c2e7a64a53c06ae3b7d6dae8bec055ad40f3758c29ffb7ad8"}
Sep 18 14:06:33.239365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:33.238951    2578 scope.go:117] "RemoveContainer" containerID="6d65e37e8c713ac9828a7579dae36d26b1fbffbaebc94ccec0ca09442fb329c9"
Sep 18 14:06:33.260910 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:33.260884    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"]
Sep 18 14:06:33.263805 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:33.263785    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-12afdd/test-model-12afdd-kserve-764ffc7485-cpwfw"]
Sep 18 14:06:33.850673 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:33.850638    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00c2d656-5b86-4df3-8491-fa8019e721ae" path="/var/lib/kubelet/pods/00c2d656-5b86-4df3-8491-fa8019e721ae/volumes"
Sep 18 14:06:34.409712 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:34.409678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:34.781836 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:34.781809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:34.782116 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:34.782100    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:34.793827 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:34.793795    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:35.260759 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:35.260733    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:06:36.876500 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:36.876471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:40.875066 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.875025    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"]
Sep 18 14:06:40.875644 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.875602    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00c2d656-5b86-4df3-8491-fa8019e721ae" containerName="main"
Sep 18 14:06:40.875644 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.875645    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="00c2d656-5b86-4df3-8491-fa8019e721ae" containerName="main"
Sep 18 14:06:40.875801 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.875780    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="00c2d656-5b86-4df3-8491-fa8019e721ae" containerName="main"
Sep 18 14:06:40.877774 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.877753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:40.880292 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.880274    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"e2e-conflict-b-344168c3-kserve-self-signed-certs\""
Sep 18 14:06:40.887252 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.887230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"]
Sep 18 14:06:40.902338 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.902311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-home\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:40.902465 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.902434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1309be4-9c72-4f29-a6ed-01e6751e772f-tls-certs\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:40.902535 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.902504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-tmp-dir\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:40.902535 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.902530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-model-cache\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:40.902770 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.902585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjksz\" (UniqueName: \"kubernetes.io/projected/a1309be4-9c72-4f29-a6ed-01e6751e772f-kube-api-access-tjksz\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:40.902770 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.902663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-dshm\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:40.972498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:40.972464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:41.003215 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-home\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003354 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1309be4-9c72-4f29-a6ed-01e6751e772f-tls-certs\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003354 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-tmp-dir\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003354 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-model-cache\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003354 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjksz\" (UniqueName: \"kubernetes.io/projected/a1309be4-9c72-4f29-a6ed-01e6751e772f-kube-api-access-tjksz\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003588 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-dshm\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003685 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-home\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003767 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-model-cache\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.003879 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.003854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-tmp-dir\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.005761 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.005737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-dshm\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.005958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.005941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1309be4-9c72-4f29-a6ed-01e6751e772f-tls-certs\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.015068 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.015043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjksz\" (UniqueName: \"kubernetes.io/projected/a1309be4-9c72-4f29-a6ed-01e6751e772f-kube-api-access-tjksz\") pod \"e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") " pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.187137 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.187107    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:41.465440 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:41.465410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"]
Sep 18 14:06:41.468025 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:06:41.467980    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1309be4_9c72_4f29_a6ed_01e6751e772f.slice/crio-f0c26d6c487db768fc76eb2acc4b63dcde9ef81253508102bba471a8d28397e5 WatchSource:0}: Error finding container f0c26d6c487db768fc76eb2acc4b63dcde9ef81253508102bba471a8d28397e5: Status 404 returned error can't find the container with id f0c26d6c487db768fc76eb2acc4b63dcde9ef81253508102bba471a8d28397e5
Sep 18 14:06:42.285673 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:42.285631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4" event={"ID":"a1309be4-9c72-4f29-a6ed-01e6751e772f","Type":"ContainerStarted","Data":"38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740"}
Sep 18 14:06:42.286093 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:42.285691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4" event={"ID":"a1309be4-9c72-4f29-a6ed-01e6751e772f","Type":"ContainerStarted","Data":"f0c26d6c487db768fc76eb2acc4b63dcde9ef81253508102bba471a8d28397e5"}
Sep 18 14:06:42.305231 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:42.305184    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4" podStartSLOduration=2.305168585 podStartE2EDuration="2.305168585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:06:42.30443388 +0000 UTC m=+1350.996305475" watchObservedRunningTime="2026-09-18 14:06:42.305168585 +0000 UTC m=+1350.997040180"
Sep 18 14:06:47.537553 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:47.537515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:47.835267 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:47.835180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:48.486330 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:48.486292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:49.537400 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:49.537361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:50.404345 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:50.404251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:51.187452 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:51.187425    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:51.187916 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:51.187701    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:51.192251 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:51.192225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:51.200508 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:51.200489    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:51.345718 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:51.345687    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:06:52.009457 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:52.009400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:52.741808 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:52.741758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:53.496407 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:53.496374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:54.191049 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:54.191013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:58.683540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.683503    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"]
Sep 18 14:06:58.684102 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.683767    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" podUID="097b3363-b590-4a2e-ac05-1643691c44f1" containerName="maas-api" containerID="cri-o://85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1" gracePeriod=30
Sep 18 14:06:58.723068 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.723042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:58.723875 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.723740    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"]
Sep 18 14:06:58.725600 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.725580    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-12afdd-29829000-f2n4v"]
Sep 18 14:06:58.775180 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.775150    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"]
Sep 18 14:06:58.775443 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.775411    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk" podUID="073b9169-afb6-4a76-ad12-495b9d46ec0d" containerName="payload-pre-processing" containerID="cri-o://0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142" gracePeriod=30
Sep 18 14:06:58.806537 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.806513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:58.868741 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.868702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:58.970582 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:58.970520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:59.019383 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.019361    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 14:06:59.045738 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.045697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:59.049288 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.049265    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 14:06:59.182048 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182017    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073b9169-afb6-4a76-ad12-495b9d46ec0d-plugins-config-volume\") pod \"073b9169-afb6-4a76-ad12-495b9d46ec0d\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") "
Sep 18 14:06:59.182229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182055    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/097b3363-b590-4a2e-ac05-1643691c44f1-openshift-service-ca\") pod \"097b3363-b590-4a2e-ac05-1643691c44f1\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") "
Sep 18 14:06:59.182229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-metrics-certs\") pod \"097b3363-b590-4a2e-ac05-1643691c44f1\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") "
Sep 18 14:06:59.182229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182124    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pdmr\" (UniqueName: \"kubernetes.io/projected/073b9169-afb6-4a76-ad12-495b9d46ec0d-kube-api-access-9pdmr\") pod \"073b9169-afb6-4a76-ad12-495b9d46ec0d\" (UID: \"073b9169-afb6-4a76-ad12-495b9d46ec0d\") "
Sep 18 14:06:59.182395 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182229    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg98p\" (UniqueName: \"kubernetes.io/projected/097b3363-b590-4a2e-ac05-1643691c44f1-kube-api-access-bg98p\") pod \"097b3363-b590-4a2e-ac05-1643691c44f1\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") "
Sep 18 14:06:59.182395 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182332    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls\") pod \"097b3363-b590-4a2e-ac05-1643691c44f1\" (UID: \"097b3363-b590-4a2e-ac05-1643691c44f1\") "
Sep 18 14:06:59.182511 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182482    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/097b3363-b590-4a2e-ac05-1643691c44f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "097b3363-b590-4a2e-ac05-1643691c44f1" (UID: "097b3363-b590-4a2e-ac05-1643691c44f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:59.182576 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/073b9169-afb6-4a76-ad12-495b9d46ec0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "073b9169-afb6-4a76-ad12-495b9d46ec0d" (UID: "073b9169-afb6-4a76-ad12-495b9d46ec0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:06:59.182822 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182766    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/073b9169-afb6-4a76-ad12-495b9d46ec0d-plugins-config-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.182822 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.182793    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/097b3363-b590-4a2e-ac05-1643691c44f1-openshift-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.184537 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.184509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073b9169-afb6-4a76-ad12-495b9d46ec0d-kube-api-access-9pdmr" (OuterVolumeSpecName: "kube-api-access-9pdmr") pod "073b9169-afb6-4a76-ad12-495b9d46ec0d" (UID: "073b9169-afb6-4a76-ad12-495b9d46ec0d"). InnerVolumeSpecName "kube-api-access-9pdmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:59.184671 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.184639    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "097b3363-b590-4a2e-ac05-1643691c44f1" (UID: "097b3363-b590-4a2e-ac05-1643691c44f1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:06:59.184671 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.184640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/097b3363-b590-4a2e-ac05-1643691c44f1-kube-api-access-bg98p" (OuterVolumeSpecName: "kube-api-access-bg98p") pod "097b3363-b590-4a2e-ac05-1643691c44f1" (UID: "097b3363-b590-4a2e-ac05-1643691c44f1"). InnerVolumeSpecName "kube-api-access-bg98p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:06:59.184765 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.184663    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "097b3363-b590-4a2e-ac05-1643691c44f1" (UID: "097b3363-b590-4a2e-ac05-1643691c44f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:06:59.283633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.283550    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg98p\" (UniqueName: \"kubernetes.io/projected/097b3363-b590-4a2e-ac05-1643691c44f1-kube-api-access-bg98p\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.283633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.283573    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-maas-api-tls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.283633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.283582    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/097b3363-b590-4a2e-ac05-1643691c44f1-metrics-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.283633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.283591    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pdmr\" (UniqueName: \"kubernetes.io/projected/073b9169-afb6-4a76-ad12-495b9d46ec0d-kube-api-access-9pdmr\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:06:59.364095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.364071    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:59.376172 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.376144    2578 generic.go:356] "Generic (PLEG): container finished" podID="097b3363-b590-4a2e-ac05-1643691c44f1" containerID="85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1" exitCode=0
Sep 18 14:06:59.376277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.376199    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"
Sep 18 14:06:59.376277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.376220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" event={"ID":"097b3363-b590-4a2e-ac05-1643691c44f1","Type":"ContainerDied","Data":"85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1"}
Sep 18 14:06:59.376277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.376272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv" event={"ID":"097b3363-b590-4a2e-ac05-1643691c44f1","Type":"ContainerDied","Data":"027a02859db0d8e913e967094f1ca60f6858b96c4fbcb9bf593eab21d6f17dca"}
Sep 18 14:06:59.376428 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.376296    2578 scope.go:117] "RemoveContainer" containerID="85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1"
Sep 18 14:06:59.377658 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.377631    2578 generic.go:356] "Generic (PLEG): container finished" podID="073b9169-afb6-4a76-ad12-495b9d46ec0d" containerID="0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142" exitCode=0
Sep 18 14:06:59.377780 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.377674    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"
Sep 18 14:06:59.377780 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.377708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk" event={"ID":"073b9169-afb6-4a76-ad12-495b9d46ec0d","Type":"ContainerDied","Data":"0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142"}
Sep 18 14:06:59.377780 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.377748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk" event={"ID":"073b9169-afb6-4a76-ad12-495b9d46ec0d","Type":"ContainerDied","Data":"e2af26eefc5467eccdae6d8f1ea543a0648da322c059e86abeee14e83f08a500"}
Sep 18 14:06:59.385500 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.385476    2578 scope.go:117] "RemoveContainer" containerID="85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1"
Sep 18 14:06:59.385863 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:06:59.385834    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1\": container with ID starting with 85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1 not found: ID does not exist" containerID="85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1"
Sep 18 14:06:59.385945 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.385877    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1"} err="failed to get container status \"85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1\": rpc error: code = NotFound desc = could not find container \"85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1\": container with ID starting with 85e34390792bcc70558ca25bcbceffaab89b9ae491f24711c3d5e7a95b594fa1 not found: ID does not exist"
Sep 18 14:06:59.385945 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.385902    2578 scope.go:117] "RemoveContainer" containerID="0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142"
Sep 18 14:06:59.394094 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.394067    2578 scope.go:117] "RemoveContainer" containerID="0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142"
Sep 18 14:06:59.394324 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:06:59.394305    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142\": container with ID starting with 0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142 not found: ID does not exist" containerID="0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142"
Sep 18 14:06:59.394406 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.394330    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142"} err="failed to get container status \"0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142\": rpc error: code = NotFound desc = could not find container \"0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142\": container with ID starting with 0e69c8c00ae0b88b8cafd52d690dcf4b85bfabe2260194ebfbdae06558b0f142 not found: ID does not exist"
Sep 18 14:06:59.408546 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.408527    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"]
Sep 18 14:06:59.412144 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.412125    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12afdd-9bdf8bf75-8xkzv"]
Sep 18 14:06:59.427596 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.427574    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"]
Sep 18 14:06:59.433015 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.432996    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-12afdd-546644b6c4-tz2hk"]
Sep 18 14:06:59.447997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.447963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:06:59.851882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.851852    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="073b9169-afb6-4a76-ad12-495b9d46ec0d" path="/var/lib/kubelet/pods/073b9169-afb6-4a76-ad12-495b9d46ec0d/volumes"
Sep 18 14:06:59.852253 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.852245    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="097b3363-b590-4a2e-ac05-1643691c44f1" path="/var/lib/kubelet/pods/097b3363-b590-4a2e-ac05-1643691c44f1/volumes"
Sep 18 14:06:59.852494 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:06:59.852480    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93417303-0ad4-4733-a609-c429c0da88ba" path="/var/lib/kubelet/pods/93417303-0ad4-4733-a609-c429c0da88ba/volumes"
Sep 18 14:07:00.223136 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:00.223103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:01.202199 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:01.202159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:02.208431 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:02.208382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:02.929592 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:02.929560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:03.820441 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:03.820407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:05.267540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:05.267499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:05.369112 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:05.369075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:05.512296 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:05.512265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:06.027022 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:06.026988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:06.343135 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:06.343044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:06.725559 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:06.725522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:08.464436 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:08.464394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:09.229452 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:09.229413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:09.316756 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:09.316729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:10.240459 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:10.240428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:11.028820 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:11.028784    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:11.917238 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:11.917197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:11.964496 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:11.964468    2578 scope.go:117] "RemoveContainer" containerID="be678b6bd9d81dfef0e6149910761d07acbbba368c11fc9a262e58203b809b28"
Sep 18 14:07:12.820175 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:12.820145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:13.488131 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.488095    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"]
Sep 18 14:07:13.488634 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.488464    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073b9169-afb6-4a76-ad12-495b9d46ec0d" containerName="payload-pre-processing"
Sep 18 14:07:13.488634 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.488475    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="073b9169-afb6-4a76-ad12-495b9d46ec0d" containerName="payload-pre-processing"
Sep 18 14:07:13.488634 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.488484    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097b3363-b590-4a2e-ac05-1643691c44f1" containerName="maas-api"
Sep 18 14:07:13.488634 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.488490    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="097b3363-b590-4a2e-ac05-1643691c44f1" containerName="maas-api"
Sep 18 14:07:13.488634 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.488594    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="073b9169-afb6-4a76-ad12-495b9d46ec0d" containerName="payload-pre-processing"
Sep 18 14:07:13.488634 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.488618    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="097b3363-b590-4a2e-ac05-1643691c44f1" containerName="maas-api"
Sep 18 14:07:13.493194 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.493162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.497211 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.497185    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 14:07:13.497482 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.497187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-d25bfb-serving-cert\""
Sep 18 14:07:13.497572 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.497187    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5jwtb\""
Sep 18 14:07:13.497572 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.497208    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 14:07:13.497572 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.497261    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 14:07:13.504788 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.504696    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"]
Sep 18 14:07:13.535367 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.535315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:13.621878 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.621845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4257cbb9-23f5-401f-8028-a0639db14471-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.622093 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.621932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2m2f\" (UniqueName: \"kubernetes.io/projected/4257cbb9-23f5-401f-8028-a0639db14471-kube-api-access-t2m2f\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.622156 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.622092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.622156 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.622123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.639495 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.639462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:13.723372 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.723322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.723372 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.723371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.723660 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.723393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4257cbb9-23f5-401f-8028-a0639db14471-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.723660 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.723439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2m2f\" (UniqueName: \"kubernetes.io/projected/4257cbb9-23f5-401f-8028-a0639db14471-kube-api-access-t2m2f\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.724177 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.724154    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4257cbb9-23f5-401f-8028-a0639db14471-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.726093 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.726073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.726197 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.726110    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.732307 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.732279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2m2f\" (UniqueName: \"kubernetes.io/projected/4257cbb9-23f5-401f-8028-a0639db14471-kube-api-access-t2m2f\") pod \"maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:13.733427 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.733333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:13.806392 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:13.806308    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:14.013346 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:14.013306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:14.082696 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:14.082664    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"]
Sep 18 14:07:14.085280 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:07:14.085232    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4257cbb9_23f5_401f_8028_a0639db14471.slice/crio-04750d7fbf41621b19293a64d5a0f12d05c83b6cddbe101b8add9f897a51be57 WatchSource:0}: Error finding container 04750d7fbf41621b19293a64d5a0f12d05c83b6cddbe101b8add9f897a51be57: Status 404 returned error can't find the container with id 04750d7fbf41621b19293a64d5a0f12d05c83b6cddbe101b8add9f897a51be57
Sep 18 14:07:14.085437 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:14.085266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:14.086807 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:14.086789    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 14:07:14.457934 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:14.457899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz" event={"ID":"4257cbb9-23f5-401f-8028-a0639db14471","Type":"ContainerStarted","Data":"04750d7fbf41621b19293a64d5a0f12d05c83b6cddbe101b8add9f897a51be57"}
Sep 18 14:07:15.464218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:15.464183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz" event={"ID":"4257cbb9-23f5-401f-8028-a0639db14471","Type":"ContainerStarted","Data":"e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e"}
Sep 18 14:07:15.464632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:15.464341    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:15.481973 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:15.481912    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz" podStartSLOduration=1.94188697 podStartE2EDuration="2.481889308s" totalImagesPullingTime="540.002338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:15.481405232 +0000 UTC m=+1384.173276830" watchObservedRunningTime="2026-09-18 14:07:15.481889308 +0000 UTC m=+1384.173760906"
Sep 18 14:07:21.475940 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:21.475912    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:07:23.776011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:23.775977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:35.717624 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:35.717586    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:36.505402 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:36.505369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:37.509340 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:37.509307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:38.315815 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:38.315778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:39.150866 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.150835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:39.269190 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.269155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:39.587904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.587871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:39.887863 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.887782    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"]
Sep 18 14:07:39.891665 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.891647    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.894572 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.894548    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-d634d2-openshift-default-dockercfg-g679k\""
Sep 18 14:07:39.901897 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.901874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"]
Sep 18 14:07:39.913571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.913531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:39.971629 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-credential-socket\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.971778 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-podinfo\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.971778 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-certs\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.971778 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a84b12a-89ba-4ec4-98b5-48558481e52a-istiod-ca-cert\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.971778 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-data\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.972003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-socket\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.972003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-envoy\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.972003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-token\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:39.972003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:39.971902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkcm\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-kube-api-access-gjkcm\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.023562 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.023529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:40.072903 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.072870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a84b12a-89ba-4ec4-98b5-48558481e52a-istiod-ca-cert\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.072943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-data\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.072975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-socket\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-envoy\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-token\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkcm\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-kube-api-access-gjkcm\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-credential-socket\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-podinfo\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073453 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-certs\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.073678 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a84b12a-89ba-4ec4-98b5-48558481e52a-istiod-ca-cert\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.074075 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-data\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.074075 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.073935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-socket\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.074075 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.074033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-credential-socket\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.074075 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.074058    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-certs\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.076571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.076545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-envoy\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.076789 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.076768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-podinfo\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.086801 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.086236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-token\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.087036 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.086985    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkcm\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-kube-api-access-gjkcm\") pod \"e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") " pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.182859 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.182826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:40.204066 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.204038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:40.485201 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.485174    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"]
Sep 18 14:07:40.487728 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:07:40.487696    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a84b12a_89ba_4ec4_98b5_48558481e52a.slice/crio-a03e00ca116791d0653f23382ac288f417cbdca3562c52cef456b60cffe9e291 WatchSource:0}: Error finding container a03e00ca116791d0653f23382ac288f417cbdca3562c52cef456b60cffe9e291: Status 404 returned error can't find the container with id a03e00ca116791d0653f23382ac288f417cbdca3562c52cef456b60cffe9e291
Sep 18 14:07:40.490467 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.490427    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:40.490556 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.490512    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:40.490600 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.490554    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:07:40.599420 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.599373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" event={"ID":"3a84b12a-89ba-4ec4-98b5-48558481e52a","Type":"ContainerStarted","Data":"ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303"}
Sep 18 14:07:40.599590 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.599445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" event={"ID":"3a84b12a-89ba-4ec4-98b5-48558481e52a","Type":"ContainerStarted","Data":"a03e00ca116791d0653f23382ac288f417cbdca3562c52cef456b60cffe9e291"}
Sep 18 14:07:40.621479 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.621411    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" podStartSLOduration=1.62139049 podStartE2EDuration="1.62139049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:07:40.620110315 +0000 UTC m=+1409.311981910" watchObservedRunningTime="2026-09-18 14:07:40.62139049 +0000 UTC m=+1409.313262086"
Sep 18 14:07:40.903250 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:40.903152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:41.204675 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:41.204648    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:41.209429 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:41.209409    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:41.605823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:41.605740    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:41.606783 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:41.606763    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:07:42.088944 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:42.088898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:42.536069 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:42.536026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:42.633685 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:42.633654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:42.934817 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:42.934771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:44.354416 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:44.354378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:45.216044 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:45.216007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:46.211275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:46.211242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:47.004086 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:47.004053    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:47.742928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:47.742892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:48.372653 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:48.372621    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"]
Sep 18 14:07:48.392282 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:48.392253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:48.722342 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:48.722312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:48.823722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:48.823691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:49.045731 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:49.045637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:49.348897 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:49.348818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:49.451877 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:49.451844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:54.507444 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:54.507397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:55.400330 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:55.400281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:56.159828 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:56.159786    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"]
Sep 18 14:07:56.171590 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:56.171554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:56.424353 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:56.424268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:57.172919 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:57.172884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:58.197006 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:58.196975    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:59.015811 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:59.015777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:07:59.743473 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:07:59.743433    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:00.501224 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:00.501189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:01.406365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:01.406332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:02.107448 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:02.107417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:02.392270 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:02.392173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:02.835310 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:02.835275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:03.392477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.392434    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4" podUID="a1309be4-9c72-4f29-a6ed-01e6751e772f" containerName="main" containerID="cri-o://38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740" gracePeriod=45
Sep 18 14:08:03.648831 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.648771    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:08:03.706705 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.706675    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjksz\" (UniqueName: \"kubernetes.io/projected/a1309be4-9c72-4f29-a6ed-01e6751e772f-kube-api-access-tjksz\") pod \"a1309be4-9c72-4f29-a6ed-01e6751e772f\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") "
Sep 18 14:08:03.706855 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.706728    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-tmp-dir\") pod \"a1309be4-9c72-4f29-a6ed-01e6751e772f\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") "
Sep 18 14:08:03.706855 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.706778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1309be4-9c72-4f29-a6ed-01e6751e772f-tls-certs\") pod \"a1309be4-9c72-4f29-a6ed-01e6751e772f\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") "
Sep 18 14:08:03.706855 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.706830    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-home\") pod \"a1309be4-9c72-4f29-a6ed-01e6751e772f\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") "
Sep 18 14:08:03.706855 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.706853    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-model-cache\") pod \"a1309be4-9c72-4f29-a6ed-01e6751e772f\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") "
Sep 18 14:08:03.707077 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.706900    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-dshm\") pod \"a1309be4-9c72-4f29-a6ed-01e6751e772f\" (UID: \"a1309be4-9c72-4f29-a6ed-01e6751e772f\") "
Sep 18 14:08:03.707077 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.707066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a1309be4-9c72-4f29-a6ed-01e6751e772f" (UID: "a1309be4-9c72-4f29-a6ed-01e6751e772f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:03.707199 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.707093    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-home" (OuterVolumeSpecName: "home") pod "a1309be4-9c72-4f29-a6ed-01e6751e772f" (UID: "a1309be4-9c72-4f29-a6ed-01e6751e772f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:03.707199 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.707134    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-model-cache" (OuterVolumeSpecName: "model-cache") pod "a1309be4-9c72-4f29-a6ed-01e6751e772f" (UID: "a1309be4-9c72-4f29-a6ed-01e6751e772f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:03.707345 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.707322    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:03.707590 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.707359    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:03.707590 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.707374    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:03.709159 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.709138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-dshm" (OuterVolumeSpecName: "dshm") pod "a1309be4-9c72-4f29-a6ed-01e6751e772f" (UID: "a1309be4-9c72-4f29-a6ed-01e6751e772f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:03.709263 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.709203    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1309be4-9c72-4f29-a6ed-01e6751e772f-kube-api-access-tjksz" (OuterVolumeSpecName: "kube-api-access-tjksz") pod "a1309be4-9c72-4f29-a6ed-01e6751e772f" (UID: "a1309be4-9c72-4f29-a6ed-01e6751e772f"). InnerVolumeSpecName "kube-api-access-tjksz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:03.709263 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.709225    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1309be4-9c72-4f29-a6ed-01e6751e772f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a1309be4-9c72-4f29-a6ed-01e6751e772f" (UID: "a1309be4-9c72-4f29-a6ed-01e6751e772f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:08:03.720350 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.720328    2578 generic.go:356] "Generic (PLEG): container finished" podID="a1309be4-9c72-4f29-a6ed-01e6751e772f" containerID="38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740" exitCode=0
Sep 18 14:08:03.720458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.720380    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"
Sep 18 14:08:03.720458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.720411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4" event={"ID":"a1309be4-9c72-4f29-a6ed-01e6751e772f","Type":"ContainerDied","Data":"38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740"}
Sep 18 14:08:03.720458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.720452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4" event={"ID":"a1309be4-9c72-4f29-a6ed-01e6751e772f","Type":"ContainerDied","Data":"f0c26d6c487db768fc76eb2acc4b63dcde9ef81253508102bba471a8d28397e5"}
Sep 18 14:08:03.720654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.720469    2578 scope.go:117] "RemoveContainer" containerID="38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740"
Sep 18 14:08:03.732713 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.732697    2578 scope.go:117] "RemoveContainer" containerID="38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740"
Sep 18 14:08:03.732979 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:08:03.732962    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740\": container with ID starting with 38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740 not found: ID does not exist" containerID="38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740"
Sep 18 14:08:03.733036 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.732987    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740"} err="failed to get container status \"38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740\": rpc error: code = NotFound desc = could not find container \"38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740\": container with ID starting with 38d789475c5ac409aac833cd30300ea5acd372eafe7b2dd165a4b51330d13740 not found: ID does not exist"
Sep 18 14:08:03.749568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.749545    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"]
Sep 18 14:08:03.751381 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.751363    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-b-344168c3-kserve-66dbd4fb67-t2ns4"]
Sep 18 14:08:03.777075 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.777049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:03.807855 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.807832    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjksz\" (UniqueName: \"kubernetes.io/projected/a1309be4-9c72-4f29-a6ed-01e6751e772f-kube-api-access-tjksz\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:03.807959 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.807858    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1309be4-9c72-4f29-a6ed-01e6751e772f-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:03.807959 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.807872    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1309be4-9c72-4f29-a6ed-01e6751e772f-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:03.850864 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:03.850834    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1309be4-9c72-4f29-a6ed-01e6751e772f" path="/var/lib/kubelet/pods/a1309be4-9c72-4f29-a6ed-01e6751e772f/volumes"
Sep 18 14:08:09.399928 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:09.399864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:09.482356 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:09.482329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:09.557676 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:09.557644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:09.654263 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:09.654176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:09.732225 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:09.732193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:10.117559 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:10.117515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:10.919395 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:10.919338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:11.179277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.179189    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb" podUID="6bc8ca07-0525-4ed5-8247-7bf0e35f177d" containerName="main" containerID="cri-o://eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe" gracePeriod=45
Sep 18 14:08:11.433145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.433126    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:08:11.481441 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tmp-dir\") pod \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") "
Sep 18 14:08:11.481568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-model-cache\") pod \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") "
Sep 18 14:08:11.481568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481491    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tls-certs\") pod \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") "
Sep 18 14:08:11.481568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-home\") pod \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") "
Sep 18 14:08:11.481725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481665    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6bc8ca07-0525-4ed5-8247-7bf0e35f177d" (UID: "6bc8ca07-0525-4ed5-8247-7bf0e35f177d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:11.481725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481676    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpxph\" (UniqueName: \"kubernetes.io/projected/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-kube-api-access-mpxph\") pod \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") "
Sep 18 14:08:11.481835 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-dshm\") pod \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\" (UID: \"6bc8ca07-0525-4ed5-8247-7bf0e35f177d\") "
Sep 18 14:08:11.481835 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481767    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-model-cache" (OuterVolumeSpecName: "model-cache") pod "6bc8ca07-0525-4ed5-8247-7bf0e35f177d" (UID: "6bc8ca07-0525-4ed5-8247-7bf0e35f177d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:11.481835 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.481794    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-home" (OuterVolumeSpecName: "home") pod "6bc8ca07-0525-4ed5-8247-7bf0e35f177d" (UID: "6bc8ca07-0525-4ed5-8247-7bf0e35f177d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:11.482082 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.482063    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:11.482082 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.482083    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:11.482215 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.482092    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:11.483781 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.483751    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6bc8ca07-0525-4ed5-8247-7bf0e35f177d" (UID: "6bc8ca07-0525-4ed5-8247-7bf0e35f177d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:08:11.483882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.483849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-dshm" (OuterVolumeSpecName: "dshm") pod "6bc8ca07-0525-4ed5-8247-7bf0e35f177d" (UID: "6bc8ca07-0525-4ed5-8247-7bf0e35f177d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:08:11.483949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.483931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-kube-api-access-mpxph" (OuterVolumeSpecName: "kube-api-access-mpxph") pod "6bc8ca07-0525-4ed5-8247-7bf0e35f177d" (UID: "6bc8ca07-0525-4ed5-8247-7bf0e35f177d"). InnerVolumeSpecName "kube-api-access-mpxph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:08:11.582535 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.582503    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:11.582535 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.582532    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpxph\" (UniqueName: \"kubernetes.io/projected/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-kube-api-access-mpxph\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:11.582535 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.582542    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bc8ca07-0525-4ed5-8247-7bf0e35f177d-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:08:11.770895 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.770809    2578 generic.go:356] "Generic (PLEG): container finished" podID="6bc8ca07-0525-4ed5-8247-7bf0e35f177d" containerID="eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe" exitCode=0
Sep 18 14:08:11.770895 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.770858    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"
Sep 18 14:08:11.771124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.770889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb" event={"ID":"6bc8ca07-0525-4ed5-8247-7bf0e35f177d","Type":"ContainerDied","Data":"eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe"}
Sep 18 14:08:11.771124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.770940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb" event={"ID":"6bc8ca07-0525-4ed5-8247-7bf0e35f177d","Type":"ContainerDied","Data":"c6df4abafed295c12ec87f39bcf5c7df29f66b29d3fb5821e7ceb610750b4e60"}
Sep 18 14:08:11.771124 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.770962    2578 scope.go:117] "RemoveContainer" containerID="eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe"
Sep 18 14:08:11.780678 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.780660    2578 scope.go:117] "RemoveContainer" containerID="eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe"
Sep 18 14:08:11.780951 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:08:11.780932    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe\": container with ID starting with eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe not found: ID does not exist" containerID="eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe"
Sep 18 14:08:11.781023 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.780958    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe"} err="failed to get container status \"eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe\": rpc error: code = NotFound desc = could not find container \"eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe\": container with ID starting with eddfcf4e444080e0714c6a64434e77a8267de7ab7474963b70b0eed423204cbe not found: ID does not exist"
Sep 18 14:08:11.795722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.795697    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"]
Sep 18 14:08:11.801099 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.801078    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/e2e-conflict-a-344168c3-kserve-7c7564464f-c4bmb"]
Sep 18 14:08:11.850944 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.850921    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bc8ca07-0525-4ed5-8247-7bf0e35f177d" path="/var/lib/kubelet/pods/6bc8ca07-0525-4ed5-8247-7bf0e35f177d/volumes"
Sep 18 14:08:11.922270 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:11.922242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:12.793106 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:12.793066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:12.948874 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:12.948830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:13.721839 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:13.721804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:14.752324 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:14.752232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:15.709213 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:15.709181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:17.816178 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:17.816140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:23.835564 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:23.835527    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerID="ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303" exitCode=0
Sep 18 14:08:23.836038 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:23.835571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" event={"ID":"3a84b12a-89ba-4ec4-98b5-48558481e52a","Type":"ContainerDied","Data":"ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303"}
Sep 18 14:08:23.836104 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:23.836036    2578 scope.go:117] "RemoveContainer" containerID="ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303"
Sep 18 14:08:23.837320 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:23.837286    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:08:23.837405 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:23.837357    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:08:23.837405 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:23.837389    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:08:24.843233 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:24.843199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" event={"ID":"3a84b12a-89ba-4ec4-98b5-48558481e52a","Type":"ContainerStarted","Data":"811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717"}
Sep 18 14:08:25.204161 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:25.204131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:08:25.205321 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:25.205285    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 18 14:08:25.205443 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:25.205348    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 18 14:08:26.204662 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:26.204598    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 18 14:08:26.205403 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:26.204681    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 18 14:08:26.605816 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:26.605720    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:08:27.205308 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.205276    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 18 14:08:27.205726 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.205334    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 18 14:08:27.309345 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.309311    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"]
Sep 18 14:08:27.309707 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.309695    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1309be4-9c72-4f29-a6ed-01e6751e772f" containerName="main"
Sep 18 14:08:27.309764 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.309709    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1309be4-9c72-4f29-a6ed-01e6751e772f" containerName="main"
Sep 18 14:08:27.309764 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.309728    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bc8ca07-0525-4ed5-8247-7bf0e35f177d" containerName="main"
Sep 18 14:08:27.309764 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.309736    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bc8ca07-0525-4ed5-8247-7bf0e35f177d" containerName="main"
Sep 18 14:08:27.309861 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.309800    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bc8ca07-0525-4ed5-8247-7bf0e35f177d" containerName="main"
Sep 18 14:08:27.309861 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.309808    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1309be4-9c72-4f29-a6ed-01e6751e772f" containerName="main"
Sep 18 14:08:27.312960 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.312941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.315870 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.315849    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a02b2c\"/\"distinct-w4-a02b2c-kserve-self-signed-certs\""
Sep 18 14:08:27.329240 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.329215    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"]
Sep 18 14:08:27.342664 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.342643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-dshm\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.342766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.342673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-home\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.342766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.342688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fef9d91-d3ce-4953-add1-a10028ec017f-tls-certs\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.342766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.342719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-model-cache\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.342897 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.342808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-tmp-dir\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.342897 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.342846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzcs6\" (UniqueName: \"kubernetes.io/projected/2fef9d91-d3ce-4953-add1-a10028ec017f-kube-api-access-pzcs6\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.391382 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.391314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:27.443456 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.443427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-tmp-dir\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.443631 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.443459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzcs6\" (UniqueName: \"kubernetes.io/projected/2fef9d91-d3ce-4953-add1-a10028ec017f-kube-api-access-pzcs6\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.443631 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.443554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-dshm\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.443753 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.443680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-home\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.443753 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.443720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fef9d91-d3ce-4953-add1-a10028ec017f-tls-certs\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.443868 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.443757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-model-cache\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.443868 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.443824    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-tmp-dir\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.444049 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.444030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-home\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.444093 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.444051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-model-cache\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.445903 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.445878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-dshm\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.446148 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.446129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fef9d91-d3ce-4953-add1-a10028ec017f-tls-certs\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.457820 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.457730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzcs6\" (UniqueName: \"kubernetes.io/projected/2fef9d91-d3ce-4953-add1-a10028ec017f-kube-api-access-pzcs6\") pod \"distinct-w4-a02b2c-kserve-65b597d569-vnfnb\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") " pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.622842 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.622798    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:27.921360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:27.921280    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"]
Sep 18 14:08:27.924283 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:08:27.924237    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fef9d91_d3ce_4953_add1_a10028ec017f.slice/crio-ca2e559c9b01c2567d4735a29f63e30a6cc810cce1df0f646bb1a70b413d19e3 WatchSource:0}: Error finding container ca2e559c9b01c2567d4735a29f63e30a6cc810cce1df0f646bb1a70b413d19e3: Status 404 returned error can't find the container with id ca2e559c9b01c2567d4735a29f63e30a6cc810cce1df0f646bb1a70b413d19e3
Sep 18 14:08:28.204690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:28.204662    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 18 14:08:28.204856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:28.204714    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 18 14:08:28.885364 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:28.885326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb" event={"ID":"2fef9d91-d3ce-4953-add1-a10028ec017f","Type":"ContainerStarted","Data":"3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f"}
Sep 18 14:08:28.885796 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:28.885374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb" event={"ID":"2fef9d91-d3ce-4953-add1-a10028ec017f","Type":"ContainerStarted","Data":"ca2e559c9b01c2567d4735a29f63e30a6cc810cce1df0f646bb1a70b413d19e3"}
Sep 18 14:08:28.906035 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:28.905980    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb" podStartSLOduration=1.9059614040000001 podStartE2EDuration="1.905961404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:08:28.904438506 +0000 UTC m=+1457.596310100" watchObservedRunningTime="2026-09-18 14:08:28.905961404 +0000 UTC m=+1457.597832998"
Sep 18 14:08:29.204487 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:29.204455    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 18 14:08:29.204701 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:29.204514    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 18 14:08:30.208893 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:30.208865    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:08:30.209842 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:30.209811    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:08:37.623283 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:37.623233    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:37.623748 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:37.623305    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:37.635887 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:37.635860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:37.942131 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:37.942102    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:08:47.320745 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:47.320702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:48.086755 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:48.086717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:49.025660 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:49.025627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:54.795118 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:54.795084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:08:55.164482 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:08:55.164393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:01.054347 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:01.054316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:37.500921 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:37.500836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:41.399670 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:41.399585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:43.015182 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:43.015151    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"]
Sep 18 14:09:43.015761 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:43.015412    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" containerID="cri-o://aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f" gracePeriod=30
Sep 18 14:09:43.044142 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:43.044101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:44.254644 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:44.254575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:44.356083 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:44.356046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:44.454115 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:44.454077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:44.611660 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:44.611560    2578 patch_prober.go:28] interesting pod/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:09:44.611660 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:44.611633    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:09:45.041333 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:45.041303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:45.142156 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:45.142123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:45.242369 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:45.242318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:46.517810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:46.517762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:48.267683 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.267663    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:09:48.286934 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.286874    2578 generic.go:356] "Generic (PLEG): container finished" podID="d98c058d-debf-4139-86bc-2727fc7c8121" containerID="aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f" exitCode=0
Sep 18 14:09:48.286934 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.286916    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"
Sep 18 14:09:48.287068 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.286947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" event={"ID":"d98c058d-debf-4139-86bc-2727fc7c8121","Type":"ContainerDied","Data":"aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f"}
Sep 18 14:09:48.287068 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.286992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86" event={"ID":"d98c058d-debf-4139-86bc-2727fc7c8121","Type":"ContainerDied","Data":"7dd4cfe3da5c8f2c35719417c30a4782228b9cc765de260dd6254690c7bb5c3c"}
Sep 18 14:09:48.287068 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.287017    2578 scope.go:117] "RemoveContainer" containerID="aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f"
Sep 18 14:09:48.297462 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.297445    2578 scope.go:117] "RemoveContainer" containerID="6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f"
Sep 18 14:09:48.305556 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.305536    2578 scope.go:117] "RemoveContainer" containerID="aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f"
Sep 18 14:09:48.305832 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:09:48.305809    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f\": container with ID starting with aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f not found: ID does not exist" containerID="aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f"
Sep 18 14:09:48.305948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.305842    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f"} err="failed to get container status \"aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f\": rpc error: code = NotFound desc = could not find container \"aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f\": container with ID starting with aa7fa33262e6e11d9dfa9e9d5ea5a79854e9c178653747ebc3563d3c0879619f not found: ID does not exist"
Sep 18 14:09:48.305948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.305865    2578 scope.go:117] "RemoveContainer" containerID="6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f"
Sep 18 14:09:48.306172 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:09:48.306148    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f\": container with ID starting with 6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f not found: ID does not exist" containerID="6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f"
Sep 18 14:09:48.306222 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.306184    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f"} err="failed to get container status \"6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f\": rpc error: code = NotFound desc = could not find container \"6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f\": container with ID starting with 6aebefca85649d95c4145f624913833361d73bb110db19f1d69ffe1fa2adfc1f not found: ID does not exist"
Sep 18 14:09:48.326675 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326652    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c058d-debf-4139-86bc-2727fc7c8121-istio-podinfo\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-data\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326712    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-socket\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326732    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-credential-socket\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326776 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-certs\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326825    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmfkf\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-kube-api-access-pmfkf\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-envoy\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-data" (OuterVolumeSpecName: "istio-data") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:48.326997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326969    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c058d-debf-4139-86bc-2727fc7c8121-istiod-ca-cert\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.326997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.326992    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-istio-token\") pod \"d98c058d-debf-4139-86bc-2727fc7c8121\" (UID: \"d98c058d-debf-4139-86bc-2727fc7c8121\") "
Sep 18 14:09:48.327260 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327066    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:48.327260 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327093    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:48.327549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327246    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:48.327549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327340    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98c058d-debf-4139-86bc-2727fc7c8121-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:09:48.327549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327443    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.327549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327456    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.327549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327465    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.327549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327474    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.327549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.327481    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d98c058d-debf-4139-86bc-2727fc7c8121-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.329017 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.328998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d98c058d-debf-4139-86bc-2727fc7c8121-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:09:48.329150 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.329117    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-kube-api-access-pmfkf" (OuterVolumeSpecName: "kube-api-access-pmfkf") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "kube-api-access-pmfkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:09:48.329621 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.329590    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:09:48.329695 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.329649    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-istio-token" (OuterVolumeSpecName: "istio-token") pod "d98c058d-debf-4139-86bc-2727fc7c8121" (UID: "d98c058d-debf-4139-86bc-2727fc7c8121"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:09:48.428425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.428401    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmfkf\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-kube-api-access-pmfkf\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.428425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.428421    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d98c058d-debf-4139-86bc-2727fc7c8121-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.428555 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.428431    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d98c058d-debf-4139-86bc-2727fc7c8121-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.428555 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.428438    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d98c058d-debf-4139-86bc-2727fc7c8121-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:09:48.609965 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.609935    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"]
Sep 18 14:09:48.614180 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:48.614156    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-31cca2d1-openshift-default-84dd4d9944-59q86"]
Sep 18 14:09:49.850393 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:49.850360    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" path="/var/lib/kubelet/pods/d98c058d-debf-4139-86bc-2727fc7c8121/volumes"
Sep 18 14:09:52.469187 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:52.469154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:52.542543 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:52.538058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:53.116866 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:53.116782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:56.135099 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:56.135065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:56.901233 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:56.901196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:57.003874 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:57.003837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:59.027402 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:59.027354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:59.097908 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:59.097875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:59.210091 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:59.210062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:09:59.304012 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:09:59.303922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:01.849262 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:01.849222    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:01.906319 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:01.906287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:09.772673 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:09.772638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:09.979338 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:09.979303    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:15.049319 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:15.049286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:16.131703 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:16.131674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:18.255720 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:18.255685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:19.762391 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:19.762357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:20.801216 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.801182    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"]
Sep 18 14:10:20.801692 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.801549    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy"
Sep 18 14:10:20.801692 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.801561    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy"
Sep 18 14:10:20.801692 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.801683    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy"
Sep 18 14:10:20.805793 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.805778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:20.808756 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.808737    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-40970f\"/\"embedding-w0-40970f-kserve-self-signed-certs\""
Sep 18 14:10:20.816512 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.816490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"]
Sep 18 14:10:20.828968 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.828942    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:20.934002 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.933960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-model-cache\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:20.934002 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.934002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tls-certs\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:20.934266 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.934123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tmp-dir\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:20.934266 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.934181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-home\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:20.934266 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.934210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-dshm\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:20.934266 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:20.934252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7jvc\" (UniqueName: \"kubernetes.io/projected/9656ec33-7609-4aa5-877a-b81b26eb4f2c-kube-api-access-b7jvc\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035049 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tmp-dir\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035254 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-home\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035254 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-dshm\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035254 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7jvc\" (UniqueName: \"kubernetes.io/projected/9656ec33-7609-4aa5-877a-b81b26eb4f2c-kube-api-access-b7jvc\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035254 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-model-cache\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035254 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tls-certs\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035543 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035500    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tmp-dir\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035857 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035831    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-model-cache\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.035979 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.035963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-home\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.037895 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.037872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tls-certs\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.038144 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.038121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-dshm\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.045908 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.045843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7jvc\" (UniqueName: \"kubernetes.io/projected/9656ec33-7609-4aa5-877a-b81b26eb4f2c-kube-api-access-b7jvc\") pod \"embedding-w0-40970f-kserve-5dbc6f758-hzgbp\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") " pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.115460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.115391    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:21.390061 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.390032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"]
Sep 18 14:10:21.392165 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:10:21.392136    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9656ec33_7609_4aa5_877a_b81b26eb4f2c.slice/crio-94b1bd3204aa2df3027d39a40c188ca5e0f5947b6095bf3e5becb0caa00445c2 WatchSource:0}: Error finding container 94b1bd3204aa2df3027d39a40c188ca5e0f5947b6095bf3e5becb0caa00445c2: Status 404 returned error can't find the container with id 94b1bd3204aa2df3027d39a40c188ca5e0f5947b6095bf3e5becb0caa00445c2
Sep 18 14:10:21.455142 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.455113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp" event={"ID":"9656ec33-7609-4aa5-877a-b81b26eb4f2c","Type":"ContainerStarted","Data":"b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05"}
Sep 18 14:10:21.455260 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.455155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp" event={"ID":"9656ec33-7609-4aa5-877a-b81b26eb4f2c","Type":"ContainerStarted","Data":"94b1bd3204aa2df3027d39a40c188ca5e0f5947b6095bf3e5becb0caa00445c2"}
Sep 18 14:10:21.473237 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:21.473190    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp" podStartSLOduration=1.473173433 podStartE2EDuration="1.473173433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:10:21.472886254 +0000 UTC m=+1570.164757853" watchObservedRunningTime="2026-09-18 14:10:21.473173433 +0000 UTC m=+1570.165045028"
Sep 18 14:10:30.911645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:30.911596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:31.116288 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:31.116257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:31.116457 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:31.116298    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:31.128473 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:31.128449    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:31.514693 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:31.514667    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:10:33.510386 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:33.510353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:37.320209 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.320175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:37.388293 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.388251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:37.655307 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.655212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:37.934338 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.934306    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"]
Sep 18 14:10:37.934710 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.934695    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy"
Sep 18 14:10:37.934783 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.934715    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy"
Sep 18 14:10:37.934837 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.934799    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98c058d-debf-4139-86bc-2727fc7c8121" containerName="istio-proxy"
Sep 18 14:10:37.937973 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.937956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.940798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.940776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7b5a6c-openshift-default-dockercfg-nlvcj\""
Sep 18 14:10:37.954505 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.954475    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"]
Sep 18 14:10:37.973081 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.973025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:37.994466 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-istio-token\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994620 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-certs\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994620 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b94bb119-be42-4091-af29-2a78d23aae99-istio-podinfo\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994620 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b94bb119-be42-4091-af29-2a78d23aae99-istiod-ca-cert\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994736 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-credential-socket\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994736 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-envoy\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpmk\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-kube-api-access-nfpmk\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-data\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:37.994823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:37.994817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-socket\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.075698 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.075658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:38.095907 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.095882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpmk\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-kube-api-access-nfpmk\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.095916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-data\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.095943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-socket\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.095990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-istio-token\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-certs\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b94bb119-be42-4091-af29-2a78d23aae99-istio-podinfo\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096311 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b94bb119-be42-4091-af29-2a78d23aae99-istiod-ca-cert\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096311 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-credential-socket\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096311 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-envoy\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096464 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-socket\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096520 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-certs\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096557 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-credential-socket\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-data\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.096871 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.096855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b94bb119-be42-4091-af29-2a78d23aae99-istiod-ca-cert\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.098585 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.098570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-envoy\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.098835 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.098818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b94bb119-be42-4091-af29-2a78d23aae99-istio-podinfo\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.106003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.105983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-istio-token\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.106164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.106144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpmk\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-kube-api-access-nfpmk\") pod \"e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") " pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.249477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.249380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:38.532380 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.532356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"]
Sep 18 14:10:38.534170 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:10:38.534143    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94bb119_be42_4091_af29_2a78d23aae99.slice/crio-ac2086977d5f9b7c49bce808e844edb1d7d1c62e7a4238a351dcc296d475caec WatchSource:0}: Error finding container ac2086977d5f9b7c49bce808e844edb1d7d1c62e7a4238a351dcc296d475caec: Status 404 returned error can't find the container with id ac2086977d5f9b7c49bce808e844edb1d7d1c62e7a4238a351dcc296d475caec
Sep 18 14:10:38.536700 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.536667    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:10:38.536784 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.536733    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:10:38.536784 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:38.536763    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:10:39.544670 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:39.544630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" event={"ID":"b94bb119-be42-4091-af29-2a78d23aae99","Type":"ContainerStarted","Data":"e3ed9378744596bb79452531ae75714bbfa698774b5feaed54fb521b41ab31bd"}
Sep 18 14:10:39.545054 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:39.544694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" event={"ID":"b94bb119-be42-4091-af29-2a78d23aae99","Type":"ContainerStarted","Data":"ac2086977d5f9b7c49bce808e844edb1d7d1c62e7a4238a351dcc296d475caec"}
Sep 18 14:10:39.566794 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:39.566749    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podStartSLOduration=2.566735308 podStartE2EDuration="2.566735308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:10:39.565289067 +0000 UTC m=+1588.257160662" watchObservedRunningTime="2026-09-18 14:10:39.566735308 +0000 UTC m=+1588.258606902"
Sep 18 14:10:40.250630 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:40.250581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:40.255711 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:40.255681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:40.549838 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:40.549745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:40.550698 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:40.550675    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:10:40.912429 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:40.912341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:41.530054 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:41.530015    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:41.646392 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:41.646362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:41.829121 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:41.829019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:42.727033 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:42.727000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:43.508019 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:43.507978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:44.436472 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:44.436442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:45.148163 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:45.148128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:46.014070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:46.014034    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:46.763746 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:46.763709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:46.865817 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:46.865779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:46.967391 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:46.967363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:47.462749 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.462709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:47.557627 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.557576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:47.653761 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.653733    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"]
Sep 18 14:10:47.657041 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.657024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:47.660927 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.660911    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-7b5a6c-dockercfg-9595n\""
Sep 18 14:10:47.661018 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.660991    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-7b5a6c\""
Sep 18 14:10:47.670907 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.670888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"]
Sep 18 14:10:47.795039 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.794951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59xks\" (UniqueName: \"kubernetes.io/projected/1e9f7c01-af43-40e2-bf88-1da69c5516b6-kube-api-access-59xks\") pod \"payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:47.795195 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.795113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9f7c01-af43-40e2-bf88-1da69c5516b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:47.895873 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.895832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59xks\" (UniqueName: \"kubernetes.io/projected/1e9f7c01-af43-40e2-bf88-1da69c5516b6-kube-api-access-59xks\") pod \"payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:47.896054 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.895948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9f7c01-af43-40e2-bf88-1da69c5516b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:47.896759 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.896737    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9f7c01-af43-40e2-bf88-1da69c5516b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:47.905064 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.905040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59xks\" (UniqueName: \"kubernetes.io/projected/1e9f7c01-af43-40e2-bf88-1da69c5516b6-kube-api-access-59xks\") pod \"payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:47.967619 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:47.967588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:48.245670 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:48.245643    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"]
Sep 18 14:10:48.248315 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:10:48.248287    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9f7c01_af43_40e2_bf88_1da69c5516b6.slice/crio-ca584722673f4d2b5bdd8c3994d47ecececdb881a9e824b6647ae0d9d0a7b00b WatchSource:0}: Error finding container ca584722673f4d2b5bdd8c3994d47ecececdb881a9e824b6647ae0d9d0a7b00b: Status 404 returned error can't find the container with id ca584722673f4d2b5bdd8c3994d47ecececdb881a9e824b6647ae0d9d0a7b00b
Sep 18 14:10:48.591268 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:48.591185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96" event={"ID":"1e9f7c01-af43-40e2-bf88-1da69c5516b6","Type":"ContainerStarted","Data":"24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e"}
Sep 18 14:10:48.591268 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:48.591240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96" event={"ID":"1e9f7c01-af43-40e2-bf88-1da69c5516b6","Type":"ContainerStarted","Data":"ca584722673f4d2b5bdd8c3994d47ecececdb881a9e824b6647ae0d9d0a7b00b"}
Sep 18 14:10:48.591699 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:48.591270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:10:48.610427 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:48.610381    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96" podStartSLOduration=1.610362103 podStartE2EDuration="1.610362103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:10:48.60907461 +0000 UTC m=+1597.300946198" watchObservedRunningTime="2026-09-18 14:10:48.610362103 +0000 UTC m=+1597.302233739"
Sep 18 14:10:59.063321 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:59.063290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:10:59.598254 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:10:59.598229    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:11:09.066427 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:09.066349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:09.815458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:09.815427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:10.536113 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:10.536079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:11.327259 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:11.327225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:11.594457 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:11.594373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:12.051185 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:12.051150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:12.150662 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:12.150631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:12.364053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:12.363971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:12.554568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:12.554530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:13.122948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:13.122911    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:14.017958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:14.017882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:14.836164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:14.836129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:15.634918 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:15.634880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:16.002415 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:16.002385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:16.099941 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:16.099898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:16.610338 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:16.610311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:17.479394 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:17.479350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:18.422955 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:18.422923    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:19.265376 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:19.265329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:20.078161 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:20.078122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:21.028403 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:21.028373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:21.798921 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:21.798833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:22.582789 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.582755    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"]
Sep 18 14:11:22.587060 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.587034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.590140 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.590119    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-3c1586-serving-cert\""
Sep 18 14:11:22.604406 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.604381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"]
Sep 18 14:11:22.629007 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.628969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:22.654871 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.654830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.655061 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.654962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m98qb\" (UniqueName: \"kubernetes.io/projected/a460afcb-0bd2-4cef-8111-57d4477fc832-kube-api-access-m98qb\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.655061 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.655012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-metrics-certs\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.655061 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.655037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a460afcb-0bd2-4cef-8111-57d4477fc832-openshift-service-ca\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.733274 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.733232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:22.755730 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.755689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m98qb\" (UniqueName: \"kubernetes.io/projected/a460afcb-0bd2-4cef-8111-57d4477fc832-kube-api-access-m98qb\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.755935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.755784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-metrics-certs\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.755935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.755826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a460afcb-0bd2-4cef-8111-57d4477fc832-openshift-service-ca\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.755935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.755866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.756116 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:11:22.756028    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-serving-cert: secret "maas-api-e2e-api-b-3c1586-serving-cert" not found
Sep 18 14:11:22.756116 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:11:22.756101    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls podName:a460afcb-0bd2-4cef-8111-57d4477fc832 nodeName:}" failed. No retries permitted until 2026-09-18 14:11:23.256080574 +0000 UTC m=+1631.947952153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls") pod "maas-api-e2e-api-b-3c1586-6448899b86-wwtkf" (UID: "a460afcb-0bd2-4cef-8111-57d4477fc832") : secret "maas-api-e2e-api-b-3c1586-serving-cert" not found
Sep 18 14:11:22.756693 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.756668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a460afcb-0bd2-4cef-8111-57d4477fc832-openshift-service-ca\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.759225 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.759193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-metrics-certs\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.766269 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.766240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m98qb\" (UniqueName: \"kubernetes.io/projected/a460afcb-0bd2-4cef-8111-57d4477fc832-kube-api-access-m98qb\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:22.865588 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:22.865499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:23.261816 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:23.261781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:23.264362 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:23.264331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls\") pod \"maas-api-e2e-api-b-3c1586-6448899b86-wwtkf\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:23.270789 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:23.270746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:23.365100 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:23.365067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:23.499809 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:23.499768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:23.780401 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:23.780345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"]
Sep 18 14:11:23.782870 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:11:23.782842    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda460afcb_0bd2_4cef_8111_57d4477fc832.slice/crio-35896a73111abcc6600471e7926b3f1355f99f36c8e165596790a60c1d37ada4 WatchSource:0}: Error finding container 35896a73111abcc6600471e7926b3f1355f99f36c8e165596790a60c1d37ada4: Status 404 returned error can't find the container with id 35896a73111abcc6600471e7926b3f1355f99f36c8e165596790a60c1d37ada4
Sep 18 14:11:24.774330 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.774295    2578 generic.go:356] "Generic (PLEG): container finished" podID="b94bb119-be42-4091-af29-2a78d23aae99" containerID="e3ed9378744596bb79452531ae75714bbfa698774b5feaed54fb521b41ab31bd" exitCode=0
Sep 18 14:11:24.774513 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.774367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" event={"ID":"b94bb119-be42-4091-af29-2a78d23aae99","Type":"ContainerDied","Data":"e3ed9378744596bb79452531ae75714bbfa698774b5feaed54fb521b41ab31bd"}
Sep 18 14:11:24.774908 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.774880    2578 scope.go:117] "RemoveContainer" containerID="e3ed9378744596bb79452531ae75714bbfa698774b5feaed54fb521b41ab31bd"
Sep 18 14:11:24.776183 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.776142    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:24.776276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.776221    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:24.776276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.776254    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:11:24.776362 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.776290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf" event={"ID":"a460afcb-0bd2-4cef-8111-57d4477fc832","Type":"ContainerStarted","Data":"a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c"}
Sep 18 14:11:24.776362 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.776337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf" event={"ID":"a460afcb-0bd2-4cef-8111-57d4477fc832","Type":"ContainerStarted","Data":"35896a73111abcc6600471e7926b3f1355f99f36c8e165596790a60c1d37ada4"}
Sep 18 14:11:24.776362 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.776361    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:24.826384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:24.826309    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf" podStartSLOduration=2.430589663 podStartE2EDuration="2.826284089s" totalImagesPullingTime="395.694426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:11:24.817548213 +0000 UTC m=+1633.509419810" watchObservedRunningTime="2026-09-18 14:11:24.826284089 +0000 UTC m=+1633.518155685"
Sep 18 14:11:25.550078 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:25.550048    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:11:25.783015 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:25.782982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" event={"ID":"b94bb119-be42-4091-af29-2a78d23aae99","Type":"ContainerStarted","Data":"7b7c4875ea7f57786a51099db1bc156735a57904d3023810821c50ce22b9bffb"}
Sep 18 14:11:26.249563 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:26.249528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:11:26.250779 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:26.250756    2578 patch_prober.go:28] interesting pod/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 18 14:11:26.250841 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:26.250819    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 18 14:11:27.249767 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:27.249733    2578 patch_prober.go:28] interesting pod/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 18 14:11:27.250149 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:27.249789    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 18 14:11:28.250466 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:28.250430    2578 patch_prober.go:28] interesting pod/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 18 14:11:28.250907 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:28.250484    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 18 14:11:29.250710 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:29.250674    2578 patch_prober.go:28] interesting pod/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 18 14:11:29.251121 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:29.250746    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 18 14:11:30.249810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:30.249772    2578 patch_prober.go:28] interesting pod/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 18 14:11:30.250009 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:30.249833    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 18 14:11:30.788235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:30.788207    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:11:31.250506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:31.250474    2578 patch_prober.go:28] interesting pod/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 18 14:11:31.250692 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:31.250542    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 18 14:11:32.254659 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:32.254635    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:11:32.255112 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:32.255020    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:11:32.255573 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:32.255554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:11:45.004278 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:45.004235    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:45.845683 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:45.845636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:45.949481 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:45.949444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:46.810508 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:46.810473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:47.834204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:47.834172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:48.614357 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:48.614329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:49.562942 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:49.562909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:50.571296 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:50.571268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:51.409980 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:51.409943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:52.108689 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:52.108655    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:52.927836 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:52.927803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:53.155416 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:53.155381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:53.830708 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:53.830672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:54.920715 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:54.920678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:55.715596 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:55.715561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:56.587383 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:56.587352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:57.460500 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:57.460464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:58.116621 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:58.116574    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"]
Sep 18 14:11:58.134863 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:58.134827    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"]
Sep 18 14:11:58.157966 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:58.157940    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"]
Sep 18 14:11:58.226681 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:58.226644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:59.143669 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:59.143640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:11:59.996463 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:11:59.996421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:00.730766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:00.730731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:03.415483 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:03.415454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:05.682885 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.682855    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"]
Sep 18 14:12:05.683354 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.683044    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96" podUID="1e9f7c01-af43-40e2-bf88-1da69c5516b6" containerName="payload-pre-processing" containerID="cri-o://24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e" gracePeriod=30
Sep 18 14:12:05.699140 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.699108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:05.811587 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.811556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:05.919520 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.919489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:05.950282 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.950258    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:12:05.995715 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.995684    2578 generic.go:356] "Generic (PLEG): container finished" podID="1e9f7c01-af43-40e2-bf88-1da69c5516b6" containerID="24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e" exitCode=0
Sep 18 14:12:05.995906 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.995747    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"
Sep 18 14:12:05.995906 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.995776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96" event={"ID":"1e9f7c01-af43-40e2-bf88-1da69c5516b6","Type":"ContainerDied","Data":"24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e"}
Sep 18 14:12:05.995906 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.995841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96" event={"ID":"1e9f7c01-af43-40e2-bf88-1da69c5516b6","Type":"ContainerDied","Data":"ca584722673f4d2b5bdd8c3994d47ecececdb881a9e824b6647ae0d9d0a7b00b"}
Sep 18 14:12:05.995906 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:05.995874    2578 scope.go:117] "RemoveContainer" containerID="24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e"
Sep 18 14:12:06.008338 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.008214    2578 scope.go:117] "RemoveContainer" containerID="24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e"
Sep 18 14:12:06.008675 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:12:06.008647    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e\": container with ID starting with 24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e not found: ID does not exist" containerID="24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e"
Sep 18 14:12:06.008790 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.008686    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e"} err="failed to get container status \"24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e\": rpc error: code = NotFound desc = could not find container \"24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e\": container with ID starting with 24577b52fd7558585e0a5bc8861460b4de642f36bc66b470b1f4bc1b50d1174e not found: ID does not exist"
Sep 18 14:12:06.025363 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.025331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:06.075290 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.075258    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59xks\" (UniqueName: \"kubernetes.io/projected/1e9f7c01-af43-40e2-bf88-1da69c5516b6-kube-api-access-59xks\") pod \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") "
Sep 18 14:12:06.075498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.075354    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9f7c01-af43-40e2-bf88-1da69c5516b6-plugins-config-volume\") pod \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\" (UID: \"1e9f7c01-af43-40e2-bf88-1da69c5516b6\") "
Sep 18 14:12:06.075803 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.075781    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e9f7c01-af43-40e2-bf88-1da69c5516b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e9f7c01-af43-40e2-bf88-1da69c5516b6" (UID: "1e9f7c01-af43-40e2-bf88-1da69c5516b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:06.077640 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.077597    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9f7c01-af43-40e2-bf88-1da69c5516b6-kube-api-access-59xks" (OuterVolumeSpecName: "kube-api-access-59xks") pod "1e9f7c01-af43-40e2-bf88-1da69c5516b6" (UID: "1e9f7c01-af43-40e2-bf88-1da69c5516b6"). InnerVolumeSpecName "kube-api-access-59xks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:06.176253 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.176209    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59xks\" (UniqueName: \"kubernetes.io/projected/1e9f7c01-af43-40e2-bf88-1da69c5516b6-kube-api-access-59xks\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:06.176253 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.176251    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9f7c01-af43-40e2-bf88-1da69c5516b6-plugins-config-volume\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:06.328418 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.328384    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"]
Sep 18 14:12:06.330265 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.330244    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-7b5a6c-d9bb859cd-mkq96"]
Sep 18 14:12:06.333739 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.333713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:06.416987 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:06.416958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:07.369755 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:07.369724    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:07.851379 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:07.851345    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9f7c01-af43-40e2-bf88-1da69c5516b6" path="/var/lib/kubelet/pods/1e9f7c01-af43-40e2-bf88-1da69c5516b6/volumes"
Sep 18 14:12:08.265548 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.265517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:08.272158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.272129    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"]
Sep 18 14:12:08.281106 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.281082    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-40970f-29829000-kp77k"]
Sep 18 14:12:08.441319 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.441288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:08.550163 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.550085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:08.649785 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.649754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:08.786278 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.786240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:08.928771 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:08.928672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:09.100571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:09.100517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:09.851059 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:09.851029    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5ea85b9-1a38-4739-a602-9d6132a3d597" path="/var/lib/kubelet/pods/f5ea85b9-1a38-4739-a602-9d6132a3d597/volumes"
Sep 18 14:12:09.971379 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:09.971352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:11.162238 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:11.162203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:12.040069 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:12.040035    2578 scope.go:117] "RemoveContainer" containerID="04d05c5e56c23af9d879bd1c7d9dd25e92cc81cca0cdeacdddd3f7d80bf54ce1"
Sep 18 14:12:12.103165 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:12.103130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:12.918862 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:12.918826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:13.137115 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.137054    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8" podUID="401027ba-7ef0-4c9f-996d-b7c4c92353b1" containerName="main" containerID="cri-o://44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126" gracePeriod=45
Sep 18 14:12:13.154029 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.153965    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp" podUID="9656ec33-7609-4aa5-877a-b81b26eb4f2c" containerName="main" containerID="cri-o://b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05" gracePeriod=45
Sep 18 14:12:13.176761 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.176679    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s" podUID="f2e09651-db03-4c62-9800-94376cb7a2c6" containerName="main" containerID="cri-o://d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41" gracePeriod=45
Sep 18 14:12:13.428115 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.428045    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:12:13.456460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.456427    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:12:13.462915 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.462892    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 14:12:13.552712 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552682    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tmp-dir\") pod \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") "
Sep 18 14:12:13.552902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552722    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tls-certs\") pod \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") "
Sep 18 14:12:13.552902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552758    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-home\") pod \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") "
Sep 18 14:12:13.552902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qpcf\" (UniqueName: \"kubernetes.io/projected/f2e09651-db03-4c62-9800-94376cb7a2c6-kube-api-access-8qpcf\") pod \"f2e09651-db03-4c62-9800-94376cb7a2c6\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") "
Sep 18 14:12:13.552902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-dshm\") pod \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") "
Sep 18 14:12:13.552902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552845    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-tmp-dir\") pod \"f2e09651-db03-4c62-9800-94376cb7a2c6\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") "
Sep 18 14:12:13.552902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552864    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-dshm\") pod \"f2e09651-db03-4c62-9800-94376cb7a2c6\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") "
Sep 18 14:12:13.552902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552893    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e09651-db03-4c62-9800-94376cb7a2c6-tls-certs\") pod \"f2e09651-db03-4c62-9800-94376cb7a2c6\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552911    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-model-cache\") pod \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7jvc\" (UniqueName: \"kubernetes.io/projected/9656ec33-7609-4aa5-877a-b81b26eb4f2c-kube-api-access-b7jvc\") pod \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552970    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tls-certs\") pod \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.552987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-home\") pod \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-home\") pod \"f2e09651-db03-4c62-9800-94376cb7a2c6\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553006    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "401027ba-7ef0-4c9f-996d-b7c4c92353b1" (UID: "401027ba-7ef0-4c9f-996d-b7c4c92353b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-dshm\") pod \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553063    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-home" (OuterVolumeSpecName: "home") pod "401027ba-7ef0-4c9f-996d-b7c4c92353b1" (UID: "401027ba-7ef0-4c9f-996d-b7c4c92353b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-model-cache\") pod \"f2e09651-db03-4c62-9800-94376cb7a2c6\" (UID: \"f2e09651-db03-4c62-9800-94376cb7a2c6\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553146    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26w8p\" (UniqueName: \"kubernetes.io/projected/401027ba-7ef0-4c9f-996d-b7c4c92353b1-kube-api-access-26w8p\") pod \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\" (UID: \"401027ba-7ef0-4c9f-996d-b7c4c92353b1\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-model-cache\") pod \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tmp-dir\") pod \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\" (UID: \"9656ec33-7609-4aa5-877a-b81b26eb4f2c\") "
Sep 18 14:12:13.553275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "401027ba-7ef0-4c9f-996d-b7c4c92353b1" (UID: "401027ba-7ef0-4c9f-996d-b7c4c92353b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f2e09651-db03-4c62-9800-94376cb7a2c6" (UID: "f2e09651-db03-4c62-9800-94376cb7a2c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553622    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553646    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553659    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553671    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.553871    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-home" (OuterVolumeSpecName: "home") pod "9656ec33-7609-4aa5-877a-b81b26eb4f2c" (UID: "9656ec33-7609-4aa5-877a-b81b26eb4f2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.554261    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9656ec33-7609-4aa5-877a-b81b26eb4f2c" (UID: "9656ec33-7609-4aa5-877a-b81b26eb4f2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.554569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.554472    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-model-cache" (OuterVolumeSpecName: "model-cache") pod "9656ec33-7609-4aa5-877a-b81b26eb4f2c" (UID: "9656ec33-7609-4aa5-877a-b81b26eb4f2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.555003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.554868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "f2e09651-db03-4c62-9800-94376cb7a2c6" (UID: "f2e09651-db03-4c62-9800-94376cb7a2c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.555062 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.555038    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-home" (OuterVolumeSpecName: "home") pod "f2e09651-db03-4c62-9800-94376cb7a2c6" (UID: "f2e09651-db03-4c62-9800-94376cb7a2c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.556014 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.555988    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-dshm" (OuterVolumeSpecName: "dshm") pod "9656ec33-7609-4aa5-877a-b81b26eb4f2c" (UID: "9656ec33-7609-4aa5-877a-b81b26eb4f2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.556182 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.556148    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2e09651-db03-4c62-9800-94376cb7a2c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f2e09651-db03-4c62-9800-94376cb7a2c6" (UID: "f2e09651-db03-4c62-9800-94376cb7a2c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:12:13.556430 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.556404    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "401027ba-7ef0-4c9f-996d-b7c4c92353b1" (UID: "401027ba-7ef0-4c9f-996d-b7c4c92353b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:12:13.556733 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.556710    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9656ec33-7609-4aa5-877a-b81b26eb4f2c" (UID: "9656ec33-7609-4aa5-877a-b81b26eb4f2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:12:13.557065 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.557030    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-dshm" (OuterVolumeSpecName: "dshm") pod "f2e09651-db03-4c62-9800-94376cb7a2c6" (UID: "f2e09651-db03-4c62-9800-94376cb7a2c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.557186 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.557168    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9656ec33-7609-4aa5-877a-b81b26eb4f2c-kube-api-access-b7jvc" (OuterVolumeSpecName: "kube-api-access-b7jvc") pod "9656ec33-7609-4aa5-877a-b81b26eb4f2c" (UID: "9656ec33-7609-4aa5-877a-b81b26eb4f2c"). InnerVolumeSpecName "kube-api-access-b7jvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:13.557391 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.557364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2e09651-db03-4c62-9800-94376cb7a2c6-kube-api-access-8qpcf" (OuterVolumeSpecName: "kube-api-access-8qpcf") pod "f2e09651-db03-4c62-9800-94376cb7a2c6" (UID: "f2e09651-db03-4c62-9800-94376cb7a2c6"). InnerVolumeSpecName "kube-api-access-8qpcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:13.557391 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.557370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/401027ba-7ef0-4c9f-996d-b7c4c92353b1-kube-api-access-26w8p" (OuterVolumeSpecName: "kube-api-access-26w8p") pod "401027ba-7ef0-4c9f-996d-b7c4c92353b1" (UID: "401027ba-7ef0-4c9f-996d-b7c4c92353b1"). InnerVolumeSpecName "kube-api-access-26w8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:13.557391 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.557372    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-dshm" (OuterVolumeSpecName: "dshm") pod "401027ba-7ef0-4c9f-996d-b7c4c92353b1" (UID: "401027ba-7ef0-4c9f-996d-b7c4c92353b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:13.654358 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654322    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654358 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654355    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2e09651-db03-4c62-9800-94376cb7a2c6-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654358 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654366    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7jvc\" (UniqueName: \"kubernetes.io/projected/9656ec33-7609-4aa5-877a-b81b26eb4f2c-kube-api-access-b7jvc\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654375    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/401027ba-7ef0-4c9f-996d-b7c4c92353b1-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654383    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654390    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654398    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/401027ba-7ef0-4c9f-996d-b7c4c92353b1-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654405    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2e09651-db03-4c62-9800-94376cb7a2c6-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654414    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26w8p\" (UniqueName: \"kubernetes.io/projected/401027ba-7ef0-4c9f-996d-b7c4c92353b1-kube-api-access-26w8p\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654423    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654431    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654438    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9656ec33-7609-4aa5-877a-b81b26eb4f2c-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654445    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qpcf\" (UniqueName: \"kubernetes.io/projected/f2e09651-db03-4c62-9800-94376cb7a2c6-kube-api-access-8qpcf\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.654645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.654453    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9656ec33-7609-4aa5-877a-b81b26eb4f2c-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:13.676925 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.676900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:13.783469 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.783435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:13.860556 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.860530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:13.901067 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.901032    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"]
Sep 18 14:12:13.901297 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.901273    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" containerID="cri-o://7b7c4875ea7f57786a51099db1bc156735a57904d3023810821c50ce22b9bffb" gracePeriod=30
Sep 18 14:12:13.962560 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:13.962527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:14.042791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.042681    2578 generic.go:356] "Generic (PLEG): container finished" podID="f2e09651-db03-4c62-9800-94376cb7a2c6" containerID="d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41" exitCode=0
Sep 18 14:12:14.042791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.042737    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"
Sep 18 14:12:14.042791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.042769    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s" event={"ID":"f2e09651-db03-4c62-9800-94376cb7a2c6","Type":"ContainerDied","Data":"d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41"}
Sep 18 14:12:14.043110 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.042824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s" event={"ID":"f2e09651-db03-4c62-9800-94376cb7a2c6","Type":"ContainerDied","Data":"d227886d16eff18954aad675832f233165444d61dbb798bbd68e81bff4ec9337"}
Sep 18 14:12:14.043110 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.042851    2578 scope.go:117] "RemoveContainer" containerID="d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41"
Sep 18 14:12:14.044424 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.044403    2578 generic.go:356] "Generic (PLEG): container finished" podID="401027ba-7ef0-4c9f-996d-b7c4c92353b1" containerID="44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126" exitCode=0
Sep 18 14:12:14.044536 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.044507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8" event={"ID":"401027ba-7ef0-4c9f-996d-b7c4c92353b1","Type":"ContainerDied","Data":"44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126"}
Sep 18 14:12:14.044624 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.044556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8" event={"ID":"401027ba-7ef0-4c9f-996d-b7c4c92353b1","Type":"ContainerDied","Data":"71f57c410e7c49f11fbf3f224caf8fe049130cec1d6afe94075ccf0e68e26979"}
Sep 18 14:12:14.044715 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.044693    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"
Sep 18 14:12:14.046071 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.046050    2578 generic.go:356] "Generic (PLEG): container finished" podID="9656ec33-7609-4aa5-877a-b81b26eb4f2c" containerID="b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05" exitCode=0
Sep 18 14:12:14.046170 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.046093    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"
Sep 18 14:12:14.046170 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.046115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp" event={"ID":"9656ec33-7609-4aa5-877a-b81b26eb4f2c","Type":"ContainerDied","Data":"b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05"}
Sep 18 14:12:14.046170 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.046148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp" event={"ID":"9656ec33-7609-4aa5-877a-b81b26eb4f2c","Type":"ContainerDied","Data":"94b1bd3204aa2df3027d39a40c188ca5e0f5947b6095bf3e5becb0caa00445c2"}
Sep 18 14:12:14.052763 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.052746    2578 scope.go:117] "RemoveContainer" containerID="d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41"
Sep 18 14:12:14.053087 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:12:14.053068    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41\": container with ID starting with d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41 not found: ID does not exist" containerID="d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41"
Sep 18 14:12:14.053133 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.053096    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41"} err="failed to get container status \"d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41\": rpc error: code = NotFound desc = could not find container \"d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41\": container with ID starting with d6f454d17900c2de351ec108214f6583a801d1b2cd1c912eb66c8aba0ef1db41 not found: ID does not exist"
Sep 18 14:12:14.053133 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.053112    2578 scope.go:117] "RemoveContainer" containerID="44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126"
Sep 18 14:12:14.061490 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.061472    2578 scope.go:117] "RemoveContainer" containerID="44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126"
Sep 18 14:12:14.061855 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:12:14.061833    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126\": container with ID starting with 44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126 not found: ID does not exist" containerID="44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126"
Sep 18 14:12:14.061942 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.061860    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126"} err="failed to get container status \"44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126\": rpc error: code = NotFound desc = could not find container \"44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126\": container with ID starting with 44aaa4d2ceb246ed7b2cedf411f06c4c2b9eca11933234c739877b6565ce6126 not found: ID does not exist"
Sep 18 14:12:14.061942 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.061877    2578 scope.go:117] "RemoveContainer" containerID="b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05"
Sep 18 14:12:14.067497 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.067467    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"]
Sep 18 14:12:14.071936 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.071911    2578 scope.go:117] "RemoveContainer" containerID="b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05"
Sep 18 14:12:14.072298 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:12:14.072273    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05\": container with ID starting with b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05 not found: ID does not exist" containerID="b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05"
Sep 18 14:12:14.072382 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.072309    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05"} err="failed to get container status \"b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05\": rpc error: code = NotFound desc = could not find container \"b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05\": container with ID starting with b1fb4801e581faa93c2173e939419d280293ae1a7cc9d3b7f9f2f2a51c629b05 not found: ID does not exist"
Sep 18 14:12:14.072632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.072593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/simulator-w0-40970f-kserve-584ffcc4c9-w877s"]
Sep 18 14:12:14.083359 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.083329    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"]
Sep 18 14:12:14.088295 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.088261    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/distinct-2-w0-40970f-kserve-7b596459f8-6h7b8"]
Sep 18 14:12:14.099351 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.099319    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"]
Sep 18 14:12:14.103510 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.103488    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-40970f/embedding-w0-40970f-kserve-5dbc6f758-hzgbp"]
Sep 18 14:12:14.840870 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:14.840835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:15.664456 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:15.664416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:15.850733 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:15.850702    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="401027ba-7ef0-4c9f-996d-b7c4c92353b1" path="/var/lib/kubelet/pods/401027ba-7ef0-4c9f-996d-b7c4c92353b1/volumes"
Sep 18 14:12:15.851138 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:15.851124    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9656ec33-7609-4aa5-877a-b81b26eb4f2c" path="/var/lib/kubelet/pods/9656ec33-7609-4aa5-877a-b81b26eb4f2c/volumes"
Sep 18 14:12:15.851488 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:15.851475    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2e09651-db03-4c62-9800-94376cb7a2c6" path="/var/lib/kubelet/pods/f2e09651-db03-4c62-9800-94376cb7a2c6/volumes"
Sep 18 14:12:16.080274 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:16.080240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:16.179536 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:16.179506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:16.435493 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:16.435458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:16.621445 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:16.621403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:17.257366 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:17.257327    2578 patch_prober.go:28] interesting pod/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:12:17.257769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:17.257398    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:12:17.717632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:17.717577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:18.562441 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:18.562402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:19.077313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.077285    2578 generic.go:356] "Generic (PLEG): container finished" podID="b94bb119-be42-4091-af29-2a78d23aae99" containerID="7b7c4875ea7f57786a51099db1bc156735a57904d3023810821c50ce22b9bffb" exitCode=0
Sep 18 14:12:19.077497 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.077359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" event={"ID":"b94bb119-be42-4091-af29-2a78d23aae99","Type":"ContainerDied","Data":"7b7c4875ea7f57786a51099db1bc156735a57904d3023810821c50ce22b9bffb"}
Sep 18 14:12:19.077497 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.077420    2578 scope.go:117] "RemoveContainer" containerID="e3ed9378744596bb79452531ae75714bbfa698774b5feaed54fb521b41ab31bd"
Sep 18 14:12:19.145435 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.145413    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:12:19.203749 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203718    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b94bb119-be42-4091-af29-2a78d23aae99-istio-podinfo\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.203904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203757    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-envoy\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.203904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203820    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-credential-socket\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.203904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-socket\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.203904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203856    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-certs\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.204114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-istio-token\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.204114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b94bb119-be42-4091-af29-2a78d23aae99-istiod-ca-cert\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.204114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203969    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-data\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.204114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.203999    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfpmk\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-kube-api-access-nfpmk\") pod \"b94bb119-be42-4091-af29-2a78d23aae99\" (UID: \"b94bb119-be42-4091-af29-2a78d23aae99\") "
Sep 18 14:12:19.204322 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:19.204322 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204179    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:19.204322 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204142    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:19.204477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204348    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-data" (OuterVolumeSpecName: "istio-data") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:19.204477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204398    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b94bb119-be42-4091-af29-2a78d23aae99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:19.204477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204422    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.204477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204446    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.204673 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.204479    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.206277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.206249    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b94bb119-be42-4091-af29-2a78d23aae99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:12:19.206277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.206254    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-kube-api-access-nfpmk" (OuterVolumeSpecName: "kube-api-access-nfpmk") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "kube-api-access-nfpmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:19.206684 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.206661    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-istio-token" (OuterVolumeSpecName: "istio-token") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:19.206781 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.206693    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b94bb119-be42-4091-af29-2a78d23aae99" (UID: "b94bb119-be42-4091-af29-2a78d23aae99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:12:19.305574 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.305539    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b94bb119-be42-4091-af29-2a78d23aae99-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.305574 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.305572    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.305574 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.305581    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.305769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.305588    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b94bb119-be42-4091-af29-2a78d23aae99-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.305769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.305596    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b94bb119-be42-4091-af29-2a78d23aae99-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.305769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.305625    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfpmk\" (UniqueName: \"kubernetes.io/projected/b94bb119-be42-4091-af29-2a78d23aae99-kube-api-access-nfpmk\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:19.479914 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:19.479847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:20.084654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:20.084602    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"
Sep 18 14:12:20.084654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:20.084647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8" event={"ID":"b94bb119-be42-4091-af29-2a78d23aae99","Type":"ContainerDied","Data":"ac2086977d5f9b7c49bce808e844edb1d7d1c62e7a4238a351dcc296d475caec"}
Sep 18 14:12:20.085122 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:20.084740    2578 scope.go:117] "RemoveContainer" containerID="7b7c4875ea7f57786a51099db1bc156735a57904d3023810821c50ce22b9bffb"
Sep 18 14:12:20.110348 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:20.110280    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"]
Sep 18 14:12:20.112572 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:20.112546    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7b5a6c-openshift-default-bc6449596-9jpx8"]
Sep 18 14:12:20.239564 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:20.239533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:21.851653 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:21.851598    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b94bb119-be42-4091-af29-2a78d23aae99" path="/var/lib/kubelet/pods/b94bb119-be42-4091-af29-2a78d23aae99/volumes"
Sep 18 14:12:24.500221 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:24.500188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:30.112134 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.112100    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"]
Sep 18 14:12:30.112584 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.112323    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf" podUID="a460afcb-0bd2-4cef-8111-57d4477fc832" containerName="maas-api" containerID="cri-o://a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c" gracePeriod=30
Sep 18 14:12:30.144399 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.144362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:30.244943 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.244911    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:30.352426 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.352371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:30.357101 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.357081    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:12:30.413277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.413215    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls\") pod \"a460afcb-0bd2-4cef-8111-57d4477fc832\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") "
Sep 18 14:12:30.413277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.413276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a460afcb-0bd2-4cef-8111-57d4477fc832-openshift-service-ca\") pod \"a460afcb-0bd2-4cef-8111-57d4477fc832\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") "
Sep 18 14:12:30.413490 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.413295    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m98qb\" (UniqueName: \"kubernetes.io/projected/a460afcb-0bd2-4cef-8111-57d4477fc832-kube-api-access-m98qb\") pod \"a460afcb-0bd2-4cef-8111-57d4477fc832\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") "
Sep 18 14:12:30.413490 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.413379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-metrics-certs\") pod \"a460afcb-0bd2-4cef-8111-57d4477fc832\" (UID: \"a460afcb-0bd2-4cef-8111-57d4477fc832\") "
Sep 18 14:12:30.413667 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.413637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a460afcb-0bd2-4cef-8111-57d4477fc832-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a460afcb-0bd2-4cef-8111-57d4477fc832" (UID: "a460afcb-0bd2-4cef-8111-57d4477fc832"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:12:30.415455 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.415432    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a460afcb-0bd2-4cef-8111-57d4477fc832" (UID: "a460afcb-0bd2-4cef-8111-57d4477fc832"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:12:30.415528 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.415458    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a460afcb-0bd2-4cef-8111-57d4477fc832-kube-api-access-m98qb" (OuterVolumeSpecName: "kube-api-access-m98qb") pod "a460afcb-0bd2-4cef-8111-57d4477fc832" (UID: "a460afcb-0bd2-4cef-8111-57d4477fc832"). InnerVolumeSpecName "kube-api-access-m98qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:12:30.415599 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.415580    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a460afcb-0bd2-4cef-8111-57d4477fc832" (UID: "a460afcb-0bd2-4cef-8111-57d4477fc832"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:12:30.447534 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.447499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:30.515006 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.514971    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-metrics-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:30.515247 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.515232    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a460afcb-0bd2-4cef-8111-57d4477fc832-maas-api-tls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:30.515360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.515344    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a460afcb-0bd2-4cef-8111-57d4477fc832-openshift-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:30.515456 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.515442    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m98qb\" (UniqueName: \"kubernetes.io/projected/a460afcb-0bd2-4cef-8111-57d4477fc832-kube-api-access-m98qb\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:12:30.694994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.694967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:30.825673 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:30.825637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:31.144583 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.144488    2578 generic.go:356] "Generic (PLEG): container finished" podID="a460afcb-0bd2-4cef-8111-57d4477fc832" containerID="a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c" exitCode=0
Sep 18 14:12:31.144583 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.144568    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"
Sep 18 14:12:31.145060 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.144569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf" event={"ID":"a460afcb-0bd2-4cef-8111-57d4477fc832","Type":"ContainerDied","Data":"a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c"}
Sep 18 14:12:31.145060 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.144678    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf" event={"ID":"a460afcb-0bd2-4cef-8111-57d4477fc832","Type":"ContainerDied","Data":"35896a73111abcc6600471e7926b3f1355f99f36c8e165596790a60c1d37ada4"}
Sep 18 14:12:31.145060 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.144712    2578 scope.go:117] "RemoveContainer" containerID="a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c"
Sep 18 14:12:31.154178 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.154155    2578 scope.go:117] "RemoveContainer" containerID="a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c"
Sep 18 14:12:31.154446 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:12:31.154424    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c\": container with ID starting with a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c not found: ID does not exist" containerID="a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c"
Sep 18 14:12:31.154529 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.154453    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c"} err="failed to get container status \"a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c\": rpc error: code = NotFound desc = could not find container \"a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c\": container with ID starting with a69926ad6f2a0065bc94d08c894592a6e48b1e8c2ad0a45ffd0104ea64b0344c not found: ID does not exist"
Sep 18 14:12:31.172766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.172743    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"]
Sep 18 14:12:31.174473 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.174456    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c1586-6448899b86-wwtkf"]
Sep 18 14:12:31.792802 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.792760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:31.853512 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:31.853479    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a460afcb-0bd2-4cef-8111-57d4477fc832" path="/var/lib/kubelet/pods/a460afcb-0bd2-4cef-8111-57d4477fc832/volumes"
Sep 18 14:12:32.657959 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:32.657874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:33.407952 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:33.407925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:34.341141 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:34.341108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:35.242891 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:35.242858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:36.336766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:36.336731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:38.329892 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:38.329837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:38.427024 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:38.426858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:38.527118 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:38.527085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:39.095691 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:39.095657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:39.195425 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:39.195396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:39.346383 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:39.346301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:39.867162 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:39.867134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:40.804121 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:40.804083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:41.709133 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:41.709093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:42.404737 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:42.404692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:43.207048 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:43.207012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:43.919821 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:43.919789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:44.728865 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:44.728828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:50.478162 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:50.478126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:50.578668 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:50.578629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:50.687297 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:50.687256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:50.785540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:50.785441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:51.068027 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:51.067946    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:51.187196 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:51.187157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:51.994029 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:51.993993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:52.903460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:52.903422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:53.595815 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:53.595777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:53.695572 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:53.695538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:54.309151 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:54.309117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:56.848598 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:56.848558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:56.957092 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:56.957050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:57.122770 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:57.122665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:57.646388 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:57.646358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:58.477117 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:58.477084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:12:59.297864 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:12:59.297832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:00.207449 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:00.207413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:01.018057 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:01.018020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:01.917630 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:01.917570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:08.035506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:08.035473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:08.178529 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:08.178493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:08.265302 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:08.265265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:08.336318 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:08.336230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:08.615386 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:08.615293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:08.723367 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:08.723331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:09.508139 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:09.508108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:10.430460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:10.430429    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:11.141225 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:11.141193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:14.785238 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:14.785199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:14.894263 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:14.894231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:15.028461 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:15.028426    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"]
Sep 18 14:13:15.028733 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:15.028706    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy" containerID="cri-o://44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0" gracePeriod=30
Sep 18 14:13:15.040475 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:15.040394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:20.277910 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.277884    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:13:20.379249 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379174    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-data\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379249 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379212    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-podinfo\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379249 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379232    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-socket\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379249 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379253    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-certs\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379273    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-envoy\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379307    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgdvl\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-kube-api-access-xgdvl\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379372    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb495ec4-1121-4dec-8dae-b82f47246f11-istiod-ca-cert\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-credential-socket\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:20.379579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-token\") pod \"bb495ec4-1121-4dec-8dae-b82f47246f11\" (UID: \"bb495ec4-1121-4dec-8dae-b82f47246f11\") "
Sep 18 14:13:20.379579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379560    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:20.379994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379581    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:20.379994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:20.379994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb495ec4-1121-4dec-8dae-b82f47246f11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:13:20.379994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379943    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb495ec4-1121-4dec-8dae-b82f47246f11-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.379994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379963    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.379994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379977    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.379994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.379990    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.380295 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.380001    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.381745 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.381723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:13:20.382272 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.382247    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:13:20.382372 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.382254    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-kube-api-access-xgdvl" (OuterVolumeSpecName: "kube-api-access-xgdvl") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "kube-api-access-xgdvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:13:20.382372 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.382260    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb495ec4-1121-4dec-8dae-b82f47246f11" (UID: "bb495ec4-1121-4dec-8dae-b82f47246f11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:13:20.386675 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.386646    2578 generic.go:356] "Generic (PLEG): container finished" podID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerID="44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0" exitCode=0
Sep 18 14:13:20.386781 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.386716    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"
Sep 18 14:13:20.386781 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.386724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" event={"ID":"bb495ec4-1121-4dec-8dae-b82f47246f11","Type":"ContainerDied","Data":"44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0"}
Sep 18 14:13:20.386897 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.386803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb" event={"ID":"bb495ec4-1121-4dec-8dae-b82f47246f11","Type":"ContainerDied","Data":"a3426652f6c975a5e24427346fa74aa4e9db372dc76dc7cfd14e105774785214"}
Sep 18 14:13:20.386897 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.386825    2578 scope.go:117] "RemoveContainer" containerID="44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0"
Sep 18 14:13:20.401228 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.401209    2578 scope.go:117] "RemoveContainer" containerID="cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba"
Sep 18 14:13:20.409189 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.409173    2578 scope.go:117] "RemoveContainer" containerID="44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0"
Sep 18 14:13:20.409477 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:13:20.409458    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0\": container with ID starting with 44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0 not found: ID does not exist" containerID="44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0"
Sep 18 14:13:20.409547 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.409483    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0"} err="failed to get container status \"44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0\": rpc error: code = NotFound desc = could not find container \"44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0\": container with ID starting with 44878ef407f2efd07042f5e857e151f21397c80e43a27c132469333485f216b0 not found: ID does not exist"
Sep 18 14:13:20.409547 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.409500    2578 scope.go:117] "RemoveContainer" containerID="cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba"
Sep 18 14:13:20.409788 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:13:20.409770    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba\": container with ID starting with cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba not found: ID does not exist" containerID="cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba"
Sep 18 14:13:20.409836 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.409794    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba"} err="failed to get container status \"cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba\": rpc error: code = NotFound desc = could not find container \"cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba\": container with ID starting with cd47c9baeb29d14be3db2bbe3813e6e888d83712aad597fa91312b68cf8e67ba not found: ID does not exist"
Sep 18 14:13:20.414238 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.414205    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"]
Sep 18 14:13:20.418312 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.418293    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-75dcf1-openshift-default-65894767fb-q45pb"]
Sep 18 14:13:20.480836 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.480816    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.480836 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.480836    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.480962 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.480844    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb495ec4-1121-4dec-8dae-b82f47246f11-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:20.480962 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:20.480853    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgdvl\" (UniqueName: \"kubernetes.io/projected/bb495ec4-1121-4dec-8dae-b82f47246f11-kube-api-access-xgdvl\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:13:21.851452 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:21.851419    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" path="/var/lib/kubelet/pods/bb495ec4-1121-4dec-8dae-b82f47246f11/volumes"
Sep 18 14:13:48.999579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:48.999542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:56.809584 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:56.809547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:57.894838 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:57.894803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:58.604362 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:58.604314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:13:59.470760 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:13:59.470723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:00.198735 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:00.198703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:01.807126 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:01.807089    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"]
Sep 18 14:14:01.821270 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:01.821237    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"]
Sep 18 14:14:01.836315 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:01.836290    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"]
Sep 18 14:14:01.895856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:01.895824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:12.685713 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:12.685677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:12.810783 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:12.810749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:13.076334 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:13.076242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:13.209367 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:13.209320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:14.108812 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:14.108779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:14.835848 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:14.835816    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:16.826671 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:16.826594    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb" podUID="2fef9d91-d3ce-4953-add1-a10028ec017f" containerName="main" containerID="cri-o://3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f" gracePeriod=45
Sep 18 14:14:16.850978 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:16.850949    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m" podUID="a8a822e4-40a8-480e-8f34-76c74bf3869a" containerName="main" containerID="cri-o://2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5" gracePeriod=45
Sep 18 14:14:16.856457 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:16.856429    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg" podUID="0d18cdac-2015-4426-9238-97fe10262ef4" containerName="main" containerID="cri-o://381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021" gracePeriod=45
Sep 18 14:14:17.122128 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.122094    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:14:17.146154 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.146125    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:14:17.150536 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.150510    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 14:14:17.296555 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-dshm\") pod \"2fef9d91-d3ce-4953-add1-a10028ec017f\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") "
Sep 18 14:14:17.296769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296572    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-home\") pod \"2fef9d91-d3ce-4953-add1-a10028ec017f\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") "
Sep 18 14:14:17.296769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296593    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18cdac-2015-4426-9238-97fe10262ef4-tls-certs\") pod \"0d18cdac-2015-4426-9238-97fe10262ef4\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") "
Sep 18 14:14:17.296769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296634    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-tmp-dir\") pod \"2fef9d91-d3ce-4953-add1-a10028ec017f\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") "
Sep 18 14:14:17.296769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-home\") pod \"a8a822e4-40a8-480e-8f34-76c74bf3869a\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") "
Sep 18 14:14:17.296769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296672    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fef9d91-d3ce-4953-add1-a10028ec017f-tls-certs\") pod \"2fef9d91-d3ce-4953-add1-a10028ec017f\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") "
Sep 18 14:14:17.296769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296718    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-dshm\") pod \"0d18cdac-2015-4426-9238-97fe10262ef4\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") "
Sep 18 14:14:17.296769 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296746    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-tmp-dir\") pod \"a8a822e4-40a8-480e-8f34-76c74bf3869a\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-model-cache\") pod \"a8a822e4-40a8-480e-8f34-76c74bf3869a\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-989g5\" (UniqueName: \"kubernetes.io/projected/a8a822e4-40a8-480e-8f34-76c74bf3869a-kube-api-access-989g5\") pod \"a8a822e4-40a8-480e-8f34-76c74bf3869a\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296848    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-home" (OuterVolumeSpecName: "home") pod "2fef9d91-d3ce-4953-add1-a10028ec017f" (UID: "2fef9d91-d3ce-4953-add1-a10028ec017f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296867    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-home\") pod \"0d18cdac-2015-4426-9238-97fe10262ef4\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.296919    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2fef9d91-d3ce-4953-add1-a10028ec017f" (UID: "2fef9d91-d3ce-4953-add1-a10028ec017f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297034    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-home" (OuterVolumeSpecName: "home") pod "0d18cdac-2015-4426-9238-97fe10262ef4" (UID: "0d18cdac-2015-4426-9238-97fe10262ef4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-model-cache\") pod \"2fef9d91-d3ce-4953-add1-a10028ec017f\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-tmp-dir\") pod \"0d18cdac-2015-4426-9238-97fe10262ef4\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-dshm\") pod \"a8a822e4-40a8-480e-8f34-76c74bf3869a\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s8gh\" (UniqueName: \"kubernetes.io/projected/0d18cdac-2015-4426-9238-97fe10262ef4-kube-api-access-6s8gh\") pod \"0d18cdac-2015-4426-9238-97fe10262ef4\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a822e4-40a8-480e-8f34-76c74bf3869a-tls-certs\") pod \"a8a822e4-40a8-480e-8f34-76c74bf3869a\" (UID: \"a8a822e4-40a8-480e-8f34-76c74bf3869a\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzcs6\" (UniqueName: \"kubernetes.io/projected/2fef9d91-d3ce-4953-add1-a10028ec017f-kube-api-access-pzcs6\") pod \"2fef9d91-d3ce-4953-add1-a10028ec017f\" (UID: \"2fef9d91-d3ce-4953-add1-a10028ec017f\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297221    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-home" (OuterVolumeSpecName: "home") pod "a8a822e4-40a8-480e-8f34-76c74bf3869a" (UID: "a8a822e4-40a8-480e-8f34-76c74bf3869a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297275    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-model-cache\") pod \"0d18cdac-2015-4426-9238-97fe10262ef4\" (UID: \"0d18cdac-2015-4426-9238-97fe10262ef4\") "
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8a822e4-40a8-480e-8f34-76c74bf3869a" (UID: "a8a822e4-40a8-480e-8f34-76c74bf3869a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297582    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297597    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297645    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.300417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297659    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297670    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.297892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d18cdac-2015-4426-9238-97fe10262ef4" (UID: "0d18cdac-2015-4426-9238-97fe10262ef4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.299679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8a822e4-40a8-480e-8f34-76c74bf3869a" (UID: "a8a822e4-40a8-480e-8f34-76c74bf3869a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.299834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-dshm" (OuterVolumeSpecName: "dshm") pod "a8a822e4-40a8-480e-8f34-76c74bf3869a" (UID: "a8a822e4-40a8-480e-8f34-76c74bf3869a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.299854    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a822e4-40a8-480e-8f34-76c74bf3869a-kube-api-access-989g5" (OuterVolumeSpecName: "kube-api-access-989g5") pod "a8a822e4-40a8-480e-8f34-76c74bf3869a" (UID: "a8a822e4-40a8-480e-8f34-76c74bf3869a"). InnerVolumeSpecName "kube-api-access-989g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.299882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2fef9d91-d3ce-4953-add1-a10028ec017f" (UID: "2fef9d91-d3ce-4953-add1-a10028ec017f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.300045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d18cdac-2015-4426-9238-97fe10262ef4" (UID: "0d18cdac-2015-4426-9238-97fe10262ef4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.301043    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fef9d91-d3ce-4953-add1-a10028ec017f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2fef9d91-d3ce-4953-add1-a10028ec017f" (UID: "2fef9d91-d3ce-4953-add1-a10028ec017f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.301102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-dshm" (OuterVolumeSpecName: "dshm") pod "2fef9d91-d3ce-4953-add1-a10028ec017f" (UID: "2fef9d91-d3ce-4953-add1-a10028ec017f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.301137    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d18cdac-2015-4426-9238-97fe10262ef4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d18cdac-2015-4426-9238-97fe10262ef4" (UID: "0d18cdac-2015-4426-9238-97fe10262ef4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.301212    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-dshm" (OuterVolumeSpecName: "dshm") pod "0d18cdac-2015-4426-9238-97fe10262ef4" (UID: "0d18cdac-2015-4426-9238-97fe10262ef4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:17.301719 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.301364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d18cdac-2015-4426-9238-97fe10262ef4-kube-api-access-6s8gh" (OuterVolumeSpecName: "kube-api-access-6s8gh") pod "0d18cdac-2015-4426-9238-97fe10262ef4" (UID: "0d18cdac-2015-4426-9238-97fe10262ef4"). InnerVolumeSpecName "kube-api-access-6s8gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:17.302348 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.302100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fef9d91-d3ce-4953-add1-a10028ec017f-kube-api-access-pzcs6" (OuterVolumeSpecName: "kube-api-access-pzcs6") pod "2fef9d91-d3ce-4953-add1-a10028ec017f" (UID: "2fef9d91-d3ce-4953-add1-a10028ec017f"). InnerVolumeSpecName "kube-api-access-pzcs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:17.302408 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.302392    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a822e4-40a8-480e-8f34-76c74bf3869a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8a822e4-40a8-480e-8f34-76c74bf3869a" (UID: "a8a822e4-40a8-480e-8f34-76c74bf3869a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398901    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398927    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398938    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-989g5\" (UniqueName: \"kubernetes.io/projected/a8a822e4-40a8-480e-8f34-76c74bf3869a-kube-api-access-989g5\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398946    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398956    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398963    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8a822e4-40a8-480e-8f34-76c74bf3869a-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398971    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s8gh\" (UniqueName: \"kubernetes.io/projected/0d18cdac-2015-4426-9238-97fe10262ef4-kube-api-access-6s8gh\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398979    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8a822e4-40a8-480e-8f34-76c74bf3869a-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.398982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398988    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzcs6\" (UniqueName: \"kubernetes.io/projected/2fef9d91-d3ce-4953-add1-a10028ec017f-kube-api-access-pzcs6\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.399365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.398996    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d18cdac-2015-4426-9238-97fe10262ef4-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.399365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.399004    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fef9d91-d3ce-4953-add1-a10028ec017f-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.399365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.399010    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d18cdac-2015-4426-9238-97fe10262ef4-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.399365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.399017    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fef9d91-d3ce-4953-add1-a10028ec017f-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:17.674237 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.674147    2578 generic.go:356] "Generic (PLEG): container finished" podID="2fef9d91-d3ce-4953-add1-a10028ec017f" containerID="3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f" exitCode=0
Sep 18 14:14:17.674237 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.674194    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"
Sep 18 14:14:17.674437 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.674248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb" event={"ID":"2fef9d91-d3ce-4953-add1-a10028ec017f","Type":"ContainerDied","Data":"3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f"}
Sep 18 14:14:17.674437 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.674292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb" event={"ID":"2fef9d91-d3ce-4953-add1-a10028ec017f","Type":"ContainerDied","Data":"ca2e559c9b01c2567d4735a29f63e30a6cc810cce1df0f646bb1a70b413d19e3"}
Sep 18 14:14:17.674437 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.674307    2578 scope.go:117] "RemoveContainer" containerID="3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f"
Sep 18 14:14:17.675732 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.675645    2578 generic.go:356] "Generic (PLEG): container finished" podID="0d18cdac-2015-4426-9238-97fe10262ef4" containerID="381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021" exitCode=0
Sep 18 14:14:17.675732 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.675692    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"
Sep 18 14:14:17.675732 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.675716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg" event={"ID":"0d18cdac-2015-4426-9238-97fe10262ef4","Type":"ContainerDied","Data":"381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021"}
Sep 18 14:14:17.675898 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.675755    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg" event={"ID":"0d18cdac-2015-4426-9238-97fe10262ef4","Type":"ContainerDied","Data":"f250f780700f50d5fbe660d409a9c13f2b2817562018eb179eba60c18a369923"}
Sep 18 14:14:17.677065 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.677016    2578 generic.go:356] "Generic (PLEG): container finished" podID="a8a822e4-40a8-480e-8f34-76c74bf3869a" containerID="2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5" exitCode=0
Sep 18 14:14:17.677065 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.677051    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"
Sep 18 14:14:17.677229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.677045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m" event={"ID":"a8a822e4-40a8-480e-8f34-76c74bf3869a","Type":"ContainerDied","Data":"2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5"}
Sep 18 14:14:17.677229 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.677170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m" event={"ID":"a8a822e4-40a8-480e-8f34-76c74bf3869a","Type":"ContainerDied","Data":"9bdc597350132ea93d663602af3ae55d7e83d1723fe06dfc070fa12ac1b6afb9"}
Sep 18 14:14:17.685523 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.685506    2578 scope.go:117] "RemoveContainer" containerID="3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f"
Sep 18 14:14:17.685855 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:17.685835    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f\": container with ID starting with 3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f not found: ID does not exist" containerID="3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f"
Sep 18 14:14:17.685935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.685860    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f"} err="failed to get container status \"3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f\": rpc error: code = NotFound desc = could not find container \"3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f\": container with ID starting with 3cebda231ae2796e8e14c93881f33886144d384826128af8749ffb58afa6e00f not found: ID does not exist"
Sep 18 14:14:17.685935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.685877    2578 scope.go:117] "RemoveContainer" containerID="381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021"
Sep 18 14:14:17.693740 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.693725    2578 scope.go:117] "RemoveContainer" containerID="381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021"
Sep 18 14:14:17.693988 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:17.693971    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021\": container with ID starting with 381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021 not found: ID does not exist" containerID="381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021"
Sep 18 14:14:17.694025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.693995    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021"} err="failed to get container status \"381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021\": rpc error: code = NotFound desc = could not find container \"381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021\": container with ID starting with 381906f36d50e5fcea1c43d8c491c8503138a113980193eb2e4017579997c021 not found: ID does not exist"
Sep 18 14:14:17.694025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.694008    2578 scope.go:117] "RemoveContainer" containerID="2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5"
Sep 18 14:14:17.699978 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.699953    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"]
Sep 18 14:14:17.701948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.701928    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/distinct-w4-a02b2c-kserve-65b597d569-vnfnb"]
Sep 18 14:14:17.702164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.702148    2578 scope.go:117] "RemoveContainer" containerID="2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5"
Sep 18 14:14:17.702458 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:17.702417    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5\": container with ID starting with 2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5 not found: ID does not exist" containerID="2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5"
Sep 18 14:14:17.702551 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.702463    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5"} err="failed to get container status \"2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5\": rpc error: code = NotFound desc = could not find container \"2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5\": container with ID starting with 2177fccf3354fedb1c40b92ce7e1a56e37bd2e2602f89151c042355e1c6b7df5 not found: ID does not exist"
Sep 18 14:14:17.712522 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.712501    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"]
Sep 18 14:14:17.717028 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.717011    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/simulator-w4-a02b2c-kserve-6f56764d5f-h59fg"]
Sep 18 14:14:17.726946 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.726927    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"]
Sep 18 14:14:17.731256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.731229    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a02b2c/premium-w4-a02b2c-kserve-8687f86d98-q4m7m"]
Sep 18 14:14:17.851087 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.851056    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d18cdac-2015-4426-9238-97fe10262ef4" path="/var/lib/kubelet/pods/0d18cdac-2015-4426-9238-97fe10262ef4/volumes"
Sep 18 14:14:17.851460 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.851449    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fef9d91-d3ce-4953-add1-a10028ec017f" path="/var/lib/kubelet/pods/2fef9d91-d3ce-4953-add1-a10028ec017f/volumes"
Sep 18 14:14:17.851808 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:17.851795    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a822e4-40a8-480e-8f34-76c74bf3869a" path="/var/lib/kubelet/pods/a8a822e4-40a8-480e-8f34-76c74bf3869a/volumes"
Sep 18 14:14:18.333310 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:18.333274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:19.072112 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:19.072062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:19.175247 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:19.175215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:19.352497 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:19.352415    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"]
Sep 18 14:14:19.352661 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:19.352639    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" containerID="cri-o://48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6" gracePeriod=30
Sep 18 14:14:19.399191 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:19.399165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:19.952754 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:19.952718    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 14:14:19.952920 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:19.952786    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 14:14:24.597282 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.597259    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 14:14:24.664864 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.664789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-certs\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.664864 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.664833    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-credential-socket\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.664862    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20d1afd-878b-40e7-9d2a-086731db4732-istio-podinfo\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.664889    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-envoy\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.664907    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-istio-token\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.664931    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20d1afd-878b-40e7-9d2a-086731db4732-istiod-ca-cert\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.664970    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-data\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665008    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-socket\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665070 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665060    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rq6k\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-kube-api-access-2rq6k\") pod \"a20d1afd-878b-40e7-9d2a-086731db4732\" (UID: \"a20d1afd-878b-40e7-9d2a-086731db4732\") "
Sep 18 14:14:24.665439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665089    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:24.665439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:24.665439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:24.665439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665353    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.665439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665376    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.665439 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665397    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20d1afd-878b-40e7-9d2a-086731db4732-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:14:24.665957 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.665506    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-data" (OuterVolumeSpecName: "istio-data") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:24.667247 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.667218    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:14:24.667364 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.667246    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a20d1afd-878b-40e7-9d2a-086731db4732-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:14:24.667798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.667767    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-istio-token" (OuterVolumeSpecName: "istio-token") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:24.667893 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.667796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-kube-api-access-2rq6k" (OuterVolumeSpecName: "kube-api-access-2rq6k") pod "a20d1afd-878b-40e7-9d2a-086731db4732" (UID: "a20d1afd-878b-40e7-9d2a-086731db4732"). InnerVolumeSpecName "kube-api-access-2rq6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:24.720685 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.720654    2578 generic.go:356] "Generic (PLEG): container finished" podID="a20d1afd-878b-40e7-9d2a-086731db4732" containerID="48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6" exitCode=0
Sep 18 14:14:24.720806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.720709    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"
Sep 18 14:14:24.720806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.720711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" event={"ID":"a20d1afd-878b-40e7-9d2a-086731db4732","Type":"ContainerDied","Data":"48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6"}
Sep 18 14:14:24.720880 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.720823    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc" event={"ID":"a20d1afd-878b-40e7-9d2a-086731db4732","Type":"ContainerDied","Data":"c5c728f47f327f54d03896c995977a3cdeffaef1d7a7e665e8c1ac6229b78d45"}
Sep 18 14:14:24.720880 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.720853    2578 scope.go:117] "RemoveContainer" containerID="48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6"
Sep 18 14:14:24.734767 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.734560    2578 scope.go:117] "RemoveContainer" containerID="932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee"
Sep 18 14:14:24.742694 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.742677    2578 scope.go:117] "RemoveContainer" containerID="48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6"
Sep 18 14:14:24.742989 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:24.742968    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6\": container with ID starting with 48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6 not found: ID does not exist" containerID="48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6"
Sep 18 14:14:24.743050 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.742997    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6"} err="failed to get container status \"48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6\": rpc error: code = NotFound desc = could not find container \"48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6\": container with ID starting with 48fe482174b6d010b209566c70f0f955a8cb55afccba39f342737f65c7f28ea6 not found: ID does not exist"
Sep 18 14:14:24.743050 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.743015    2578 scope.go:117] "RemoveContainer" containerID="932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee"
Sep 18 14:14:24.743278 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:24.743256    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee\": container with ID starting with 932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee not found: ID does not exist" containerID="932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee"
Sep 18 14:14:24.743330 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.743289    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee"} err="failed to get container status \"932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee\": rpc error: code = NotFound desc = could not find container \"932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee\": container with ID starting with 932fd0927b880ab2bf597b328960f392f1717a8fd327966faa32fa7015501eee not found: ID does not exist"
Sep 18 14:14:24.751855 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.751832    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"]
Sep 18 14:14:24.756150 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.756128    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-a02b2c-openshift-default-5599fcbf68-bx6rc"]
Sep 18 14:14:24.765949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.765929    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.766011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.765951    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rq6k\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-kube-api-access-2rq6k\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.766011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.765962    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a20d1afd-878b-40e7-9d2a-086731db4732-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.766011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.765970    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.766011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.765978    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a20d1afd-878b-40e7-9d2a-086731db4732-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.766011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.765986    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a20d1afd-878b-40e7-9d2a-086731db4732-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:24.766011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:24.765993    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a20d1afd-878b-40e7-9d2a-086731db4732-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:25.849955 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:25.849919    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" path="/var/lib/kubelet/pods/a20d1afd-878b-40e7-9d2a-086731db4732/volumes"
Sep 18 14:14:34.497172 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497136    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7432-321ed5"]
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497469    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2e09651-db03-4c62-9800-94376cb7a2c6" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497482    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2e09651-db03-4c62-9800-94376cb7a2c6" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497496    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497504    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497510    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401027ba-7ef0-4c9f-996d-b7c4c92353b1" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497516    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="401027ba-7ef0-4c9f-996d-b7c4c92353b1" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497525    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497530    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497538    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d18cdac-2015-4426-9238-97fe10262ef4" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497543    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d18cdac-2015-4426-9238-97fe10262ef4" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497550    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9656ec33-7609-4aa5-877a-b81b26eb4f2c" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497555    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9656ec33-7609-4aa5-877a-b81b26eb4f2c" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497567    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a822e4-40a8-480e-8f34-76c74bf3869a" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497576    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a822e4-40a8-480e-8f34-76c74bf3869a" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497583    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fef9d91-d3ce-4953-add1-a10028ec017f" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497588    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fef9d91-d3ce-4953-add1-a10028ec017f" containerName="main"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497593    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9f7c01-af43-40e2-bf88-1da69c5516b6" containerName="payload-pre-processing"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497598    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9f7c01-af43-40e2-bf88-1da69c5516b6" containerName="payload-pre-processing"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497616    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a460afcb-0bd2-4cef-8111-57d4477fc832" containerName="maas-api"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497622    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a460afcb-0bd2-4cef-8111-57d4477fc832" containerName="maas-api"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497631    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy"
Sep 18 14:14:34.497690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497637    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497709    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9656ec33-7609-4aa5-877a-b81b26eb4f2c" containerName="main"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497719    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fef9d91-d3ce-4953-add1-a10028ec017f" containerName="main"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497728    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497737    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497745    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d18cdac-2015-4426-9238-97fe10262ef4" containerName="main"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497751    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497755    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="401027ba-7ef0-4c9f-996d-b7c4c92353b1" containerName="main"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497760    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497765    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2e09651-db03-4c62-9800-94376cb7a2c6" containerName="main"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497769    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497773    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a822e4-40a8-480e-8f34-76c74bf3869a" containerName="main"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497779    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9f7c01-af43-40e2-bf88-1da69c5516b6" containerName="payload-pre-processing"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497783    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy"
Sep 18 14:14:34.498360 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.497788    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a460afcb-0bd2-4cef-8111-57d4477fc832" containerName="maas-api"
Sep 18 14:14:34.502135 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.502108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:34.504866 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.504839    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7432-321ed5"]
Sep 18 14:14:34.505049 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.505024    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mwrqv\""
Sep 18 14:14:34.551948 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.551925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnsg\" (UniqueName: \"kubernetes.io/projected/bf0182be-e80b-4855-bc26-5805e31b0269-kube-api-access-8jnsg\") pod \"test-curl-7432-321ed5\" (UID: \"bf0182be-e80b-4855-bc26-5805e31b0269\") " pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:34.652760 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.652736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnsg\" (UniqueName: \"kubernetes.io/projected/bf0182be-e80b-4855-bc26-5805e31b0269-kube-api-access-8jnsg\") pod \"test-curl-7432-321ed5\" (UID: \"bf0182be-e80b-4855-bc26-5805e31b0269\") " pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:34.661104 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.661078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnsg\" (UniqueName: \"kubernetes.io/projected/bf0182be-e80b-4855-bc26-5805e31b0269-kube-api-access-8jnsg\") pod \"test-curl-7432-321ed5\" (UID: \"bf0182be-e80b-4855-bc26-5805e31b0269\") " pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:34.812945 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:34.812852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:35.084936 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:35.084853    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7432-321ed5"]
Sep 18 14:14:35.088250 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:14:35.088214    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf0182be_e80b_4855_bc26_5805e31b0269.slice/crio-378fac70f6b4244857882aca895e0cde96c9df1f0f0ab806d14df2bb717af6aa WatchSource:0}: Error finding container 378fac70f6b4244857882aca895e0cde96c9df1f0f0ab806d14df2bb717af6aa: Status 404 returned error can't find the container with id 378fac70f6b4244857882aca895e0cde96c9df1f0f0ab806d14df2bb717af6aa
Sep 18 14:14:35.772904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:35.772867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7432-321ed5" event={"ID":"bf0182be-e80b-4855-bc26-5805e31b0269","Type":"ContainerStarted","Data":"037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73"}
Sep 18 14:14:35.772904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:35.772910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7432-321ed5" event={"ID":"bf0182be-e80b-4855-bc26-5805e31b0269","Type":"ContainerStarted","Data":"378fac70f6b4244857882aca895e0cde96c9df1f0f0ab806d14df2bb717af6aa"}
Sep 18 14:14:35.789326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:35.789283    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7432-321ed5" podStartSLOduration=1.7892701880000002 podStartE2EDuration="1.789270188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:14:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:14:35.788533096 +0000 UTC m=+1824.480404692" watchObservedRunningTime="2026-09-18 14:14:35.789270188 +0000 UTC m=+1824.481141783"
Sep 18 14:14:36.389592 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:36.389555    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7432-321ed5"]
Sep 18 14:14:36.394410 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:36.394384    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7432-321ed5"]
Sep 18 14:14:36.777807 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:36.777778    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7432-321ed5" container="test-curl-7432-321ed5"
Sep 18 14:14:37.784277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:37.784229    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7432-321ed5" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" containerName="test-curl-7432-321ed5" containerID="cri-o://037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73" gracePeriod=2
Sep 18 14:14:37.786810 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:37.786772    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7432-321ed5\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:37.807988 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:37.807957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:38.049208 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:38.049110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:38.149363 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:38.149330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:39.621882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:39.621851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:39.951914 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:39.951889    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:39.999770 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:39.999737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jnsg\" (UniqueName: \"kubernetes.io/projected/bf0182be-e80b-4855-bc26-5805e31b0269-kube-api-access-8jnsg\") pod \"bf0182be-e80b-4855-bc26-5805e31b0269\" (UID: \"bf0182be-e80b-4855-bc26-5805e31b0269\") "
Sep 18 14:14:40.001912 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:40.001883    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf0182be-e80b-4855-bc26-5805e31b0269-kube-api-access-8jnsg" (OuterVolumeSpecName: "kube-api-access-8jnsg") pod "bf0182be-e80b-4855-bc26-5805e31b0269" (UID: "bf0182be-e80b-4855-bc26-5805e31b0269"). InnerVolumeSpecName "kube-api-access-8jnsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:14:40.100438 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:40.100403    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jnsg\" (UniqueName: \"kubernetes.io/projected/bf0182be-e80b-4855-bc26-5805e31b0269-kube-api-access-8jnsg\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:14:40.799861 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:40.799815    2578 generic.go:356] "Generic (PLEG): container finished" podID="bf0182be-e80b-4855-bc26-5805e31b0269" containerID="037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73" exitCode=137
Sep 18 14:14:40.800276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:40.799900    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:40.800276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:40.799921    2578 scope.go:117] "RemoveContainer" containerID="037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73"
Sep 18 14:14:40.808726 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:40.808706    2578 scope.go:117] "RemoveContainer" containerID="037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73"
Sep 18 14:14:40.811420 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:40.809736    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73\": container with ID starting with 037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73 not found: ID does not exist" containerID="037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73"
Sep 18 14:14:40.811420 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:40.809778    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73"} err="failed to get container status \"037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73\": rpc error: code = NotFound desc = could not find container \"037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73\": container with ID starting with 037cef7abd3c600ba00ab26509ebbeeca94f62f33a30d0245aa094d9f7f99b73 not found: ID does not exist"
Sep 18 14:14:40.811420 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:40.810748    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7432-321ed5\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:41.848739 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:14:41.848693    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7432-321ed5\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" pod="opendatahub/test-curl-7432-321ed5"
Sep 18 14:14:41.849795 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:41.849774    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" path="/var/lib/kubelet/pods/bf0182be-e80b-4855-bc26-5805e31b0269/volumes"
Sep 18 14:14:56.913193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:56.913158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:14:58.053450 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:14:58.053418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:15:00.170657 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"]
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170933    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy"
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170944    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20d1afd-878b-40e7-9d2a-086731db4732" containerName="istio-proxy"
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170953    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" containerName="test-curl-7432-321ed5"
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170958    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" containerName="test-curl-7432-321ed5"
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170973    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy"
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170978    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb495ec4-1121-4dec-8dae-b82f47246f11" containerName="istio-proxy"
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170985    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy"
Sep 18 14:15:00.171025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.170992    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94bb119-be42-4091-af29-2a78d23aae99" containerName="istio-proxy"
Sep 18 14:15:00.171276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.171049    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf0182be-e80b-4855-bc26-5805e31b0269" containerName="test-curl-7432-321ed5"
Sep 18 14:15:00.173869 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.173853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"
Sep 18 14:15:00.178815 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.178789    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:15:00.183126 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.183110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"
Sep 18 14:15:00.192797 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.192772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"]
Sep 18 14:15:00.459680 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.459642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"]
Sep 18 14:15:00.462767 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:15:00.462739    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde0879e6_4875_42e6_81d0_c8fdc2bb41e3.slice/crio-bc812fe3bf8ebe2a1a4e51a2a4293e1affc4f20f5d96ac73f1cf8bcc116568fd WatchSource:0}: Error finding container bc812fe3bf8ebe2a1a4e51a2a4293e1affc4f20f5d96ac73f1cf8bcc116568fd: Status 404 returned error can't find the container with id bc812fe3bf8ebe2a1a4e51a2a4293e1affc4f20f5d96ac73f1cf8bcc116568fd
Sep 18 14:15:00.900891 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.900849    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7" event={"ID":"de0879e6-4875-42e6-81d0-c8fdc2bb41e3","Type":"ContainerStarted","Data":"41cad1ee7cef834a5196a645fb0c14a6939994ef283b12e2ffd04adc7c11dbb7"}
Sep 18 14:15:00.901045 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.900914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7" event={"ID":"de0879e6-4875-42e6-81d0-c8fdc2bb41e3","Type":"ContainerStarted","Data":"bc812fe3bf8ebe2a1a4e51a2a4293e1affc4f20f5d96ac73f1cf8bcc116568fd"}
Sep 18 14:15:00.916732 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:00.916683    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7" podStartSLOduration=0.916668279 podStartE2EDuration="916.668279ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:15:00.916384619 +0000 UTC m=+1849.608256227" watchObservedRunningTime="2026-09-18 14:15:00.916668279 +0000 UTC m=+1849.608539874"
Sep 18 14:15:01.907499 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:01.907461    2578 generic.go:356] "Generic (PLEG): container finished" podID="de0879e6-4875-42e6-81d0-c8fdc2bb41e3" containerID="41cad1ee7cef834a5196a645fb0c14a6939994ef283b12e2ffd04adc7c11dbb7" exitCode=0
Sep 18 14:15:01.907981 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:01.907507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7" event={"ID":"de0879e6-4875-42e6-81d0-c8fdc2bb41e3","Type":"ContainerDied","Data":"41cad1ee7cef834a5196a645fb0c14a6939994ef283b12e2ffd04adc7c11dbb7"}
Sep 18 14:15:03.047825 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:03.047796    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"
Sep 18 14:15:03.215774 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:03.215736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:15:03.924235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:03.924201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7" event={"ID":"de0879e6-4875-42e6-81d0-c8fdc2bb41e3","Type":"ContainerDied","Data":"bc812fe3bf8ebe2a1a4e51a2a4293e1affc4f20f5d96ac73f1cf8bcc116568fd"}
Sep 18 14:15:03.924235 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:03.924233    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"
Sep 18 14:15:03.924427 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:03.924258    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc812fe3bf8ebe2a1a4e51a2a4293e1affc4f20f5d96ac73f1cf8bcc116568fd"
Sep 18 14:15:07.668018 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.667980    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"]
Sep 18 14:15:07.668654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.668295    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de0879e6-4875-42e6-81d0-c8fdc2bb41e3" containerName="cleanup"
Sep 18 14:15:07.668654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.668305    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="de0879e6-4875-42e6-81d0-c8fdc2bb41e3" containerName="cleanup"
Sep 18 14:15:07.668654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.668372    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="de0879e6-4875-42e6-81d0-c8fdc2bb41e3" containerName="cleanup"
Sep 18 14:15:07.671454 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.671433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.675533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.675509    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"sub-test-model-d25bfb-kserve-self-signed-certs\""
Sep 18 14:15:07.675713 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.675508    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"default-dockercfg-zxc6l\""
Sep 18 14:15:07.675713 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.675519    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"openshift-service-ca.crt\""
Sep 18 14:15:07.675713 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.675549    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d25bfb\"/\"kube-root-ca.crt\""
Sep 18 14:15:07.683223 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.683202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"]
Sep 18 14:15:07.706789 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.706760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:15:07.739091 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.739069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-model-cache\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.739188 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.739102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-home\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.739188 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.739129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tls-certs\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.739188 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.739154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-dshm\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.739306 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.739254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tmp-dir\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.739306 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.739285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpdlv\" (UniqueName: \"kubernetes.io/projected/c24fbbf0-31cb-4f92-abdb-58b39b53621a-kube-api-access-tpdlv\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.839738 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.839708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-model-cache\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.839857 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.839749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-home\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.839857 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.839774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tls-certs\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.839971 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.839878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-dshm\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.839971 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.839950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tmp-dir\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.840077 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.839977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpdlv\" (UniqueName: \"kubernetes.io/projected/c24fbbf0-31cb-4f92-abdb-58b39b53621a-kube-api-access-tpdlv\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.840163 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.840142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-home\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.840222 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.840161    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-model-cache\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.840344 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.840325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tmp-dir\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.842708 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.842664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-dshm\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.842892 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.842874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tls-certs\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.848989 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.848964    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpdlv\" (UniqueName: \"kubernetes.io/projected/c24fbbf0-31cb-4f92-abdb-58b39b53621a-kube-api-access-tpdlv\") pod \"sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") " pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:07.981170 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:07.981120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:08.256274 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:08.256194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"]
Sep 18 14:15:08.260145 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:15:08.260104    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc24fbbf0_31cb_4f92_abdb_58b39b53621a.slice/crio-ae68e9073a593b2e47450a7a78a17f40903fb94e5155c0332102a3164d29c5a9 WatchSource:0}: Error finding container ae68e9073a593b2e47450a7a78a17f40903fb94e5155c0332102a3164d29c5a9: Status 404 returned error can't find the container with id ae68e9073a593b2e47450a7a78a17f40903fb94e5155c0332102a3164d29c5a9
Sep 18 14:15:08.951016 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:08.950979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m" event={"ID":"c24fbbf0-31cb-4f92-abdb-58b39b53621a","Type":"ContainerStarted","Data":"ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e"}
Sep 18 14:15:08.951451 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:08.951030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m" event={"ID":"c24fbbf0-31cb-4f92-abdb-58b39b53621a","Type":"ContainerStarted","Data":"ae68e9073a593b2e47450a7a78a17f40903fb94e5155c0332102a3164d29c5a9"}
Sep 18 14:15:08.968690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:08.968646    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m" podStartSLOduration=1.96860295 podStartE2EDuration="1.96860295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:15:08.967566634 +0000 UTC m=+1857.659438228" watchObservedRunningTime="2026-09-18 14:15:08.96860295 +0000 UTC m=+1857.660497187"
Sep 18 14:15:17.982195 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:17.982159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:17.982636 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:17.982216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:17.994885 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:17.994861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:18.007736 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:18.007709    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:15:41.310882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:41.310800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:15:55.619915 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:55.619878    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:15:55.675931 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:15:55.675902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:11.193630 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.193575    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7432-922d96"]
Sep 18 14:16:11.196850 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.196831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:11.199826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.199799    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mwrqv\""
Sep 18 14:16:11.204455 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.204427    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7432-922d96"]
Sep 18 14:16:11.290788 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.290753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ds6h\" (UniqueName: \"kubernetes.io/projected/ba6b0460-cf7b-4d97-aa51-fcc48e35ab96-kube-api-access-6ds6h\") pod \"test-curl-7432-922d96\" (UID: \"ba6b0460-cf7b-4d97-aa51-fcc48e35ab96\") " pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:11.392170 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.392136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ds6h\" (UniqueName: \"kubernetes.io/projected/ba6b0460-cf7b-4d97-aa51-fcc48e35ab96-kube-api-access-6ds6h\") pod \"test-curl-7432-922d96\" (UID: \"ba6b0460-cf7b-4d97-aa51-fcc48e35ab96\") " pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:11.402069 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.402045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ds6h\" (UniqueName: \"kubernetes.io/projected/ba6b0460-cf7b-4d97-aa51-fcc48e35ab96-kube-api-access-6ds6h\") pod \"test-curl-7432-922d96\" (UID: \"ba6b0460-cf7b-4d97-aa51-fcc48e35ab96\") " pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:11.507195 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.507115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:11.777152 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:11.777128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7432-922d96"]
Sep 18 14:16:11.779195 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:16:11.779165    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba6b0460_cf7b_4d97_aa51_fcc48e35ab96.slice/crio-6161a2c5ce29a4255265c9c1858e2f3e1c529f9cd2f7577b25a698e95cdd5fb7 WatchSource:0}: Error finding container 6161a2c5ce29a4255265c9c1858e2f3e1c529f9cd2f7577b25a698e95cdd5fb7: Status 404 returned error can't find the container with id 6161a2c5ce29a4255265c9c1858e2f3e1c529f9cd2f7577b25a698e95cdd5fb7
Sep 18 14:16:12.246257 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.246220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7432-922d96" event={"ID":"ba6b0460-cf7b-4d97-aa51-fcc48e35ab96","Type":"ContainerStarted","Data":"f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978"}
Sep 18 14:16:12.246718 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.246268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7432-922d96" event={"ID":"ba6b0460-cf7b-4d97-aa51-fcc48e35ab96","Type":"ContainerStarted","Data":"6161a2c5ce29a4255265c9c1858e2f3e1c529f9cd2f7577b25a698e95cdd5fb7"}
Sep 18 14:16:12.261285 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.261230    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7432-922d96" podStartSLOduration=1.26121284 podStartE2EDuration="1.26121284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:16:12.260382723 +0000 UTC m=+1920.952254319" watchObservedRunningTime="2026-09-18 14:16:12.26121284 +0000 UTC m=+1920.953084434"
Sep 18 14:16:12.801631 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.801567    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7432-922d96"]
Sep 18 14:16:12.805517 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.805485    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7432-922d96"]
Sep 18 14:16:12.921089 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.921009    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7432-f662c4"]
Sep 18 14:16:12.921350 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.921337    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" containerName="test-curl-7432-922d96"
Sep 18 14:16:12.921397 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.921352    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" containerName="test-curl-7432-922d96"
Sep 18 14:16:12.921432 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.921408    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" containerName="test-curl-7432-922d96"
Sep 18 14:16:12.924240 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.924225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:12.931219 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:12.930959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7432-f662c4"]
Sep 18 14:16:13.003378 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:13.003339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwl9\" (UniqueName: \"kubernetes.io/projected/410115d2-f92f-4d99-b8f4-f74bfe6c8512-kube-api-access-knwl9\") pod \"test-curl-7432-f662c4\" (UID: \"410115d2-f92f-4d99-b8f4-f74bfe6c8512\") " pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:13.104689 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:13.104652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwl9\" (UniqueName: \"kubernetes.io/projected/410115d2-f92f-4d99-b8f4-f74bfe6c8512-kube-api-access-knwl9\") pod \"test-curl-7432-f662c4\" (UID: \"410115d2-f92f-4d99-b8f4-f74bfe6c8512\") " pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:13.114093 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:13.114071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwl9\" (UniqueName: \"kubernetes.io/projected/410115d2-f92f-4d99-b8f4-f74bfe6c8512-kube-api-access-knwl9\") pod \"test-curl-7432-f662c4\" (UID: \"410115d2-f92f-4d99-b8f4-f74bfe6c8512\") " pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:13.234263 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:13.234235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:13.252087 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:16:13.252062    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7432-922d96" container="test-curl-7432-922d96"
Sep 18 14:16:13.503723 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:13.503699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7432-f662c4"]
Sep 18 14:16:13.505757 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:16:13.505729    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410115d2_f92f_4d99_b8f4_f74bfe6c8512.slice/crio-6025b8b8364308cecca0f494e9ee5c657c3cbb6f3cbc5652856c063d53d70c49 WatchSource:0}: Error finding container 6025b8b8364308cecca0f494e9ee5c657c3cbb6f3cbc5652856c063d53d70c49: Status 404 returned error can't find the container with id 6025b8b8364308cecca0f494e9ee5c657c3cbb6f3cbc5652856c063d53d70c49
Sep 18 14:16:14.258007 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:14.257969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7432-f662c4" event={"ID":"410115d2-f92f-4d99-b8f4-f74bfe6c8512","Type":"ContainerStarted","Data":"1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792"}
Sep 18 14:16:14.258469 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:14.258016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7432-f662c4" event={"ID":"410115d2-f92f-4d99-b8f4-f74bfe6c8512","Type":"ContainerStarted","Data":"6025b8b8364308cecca0f494e9ee5c657c3cbb6f3cbc5652856c063d53d70c49"}
Sep 18 14:16:14.258469 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:14.258043    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7432-922d96" podUID="ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" containerName="test-curl-7432-922d96" containerID="cri-o://f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978" gracePeriod=2
Sep 18 14:16:14.274415 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:14.274368    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7432-f662c4" podStartSLOduration=2.274355094 podStartE2EDuration="2.274355094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:16:14.272397041 +0000 UTC m=+1922.964268636" watchObservedRunningTime="2026-09-18 14:16:14.274355094 +0000 UTC m=+1922.966226689"
Sep 18 14:16:14.816935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:14.816894    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7432-f662c4"]
Sep 18 14:16:14.820867 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:14.820836    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7432-f662c4"]
Sep 18 14:16:15.262928 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:16:15.262891    2578 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7432-f662c4" container="test-curl-7432-f662c4"
Sep 18 14:16:16.267751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:16.267706    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7432-f662c4" podUID="410115d2-f92f-4d99-b8f4-f74bfe6c8512" containerName="test-curl-7432-f662c4" containerID="cri-o://1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792" gracePeriod=2
Sep 18 14:16:16.402571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:16.402545    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:16.431876 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:16.431854    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ds6h\" (UniqueName: \"kubernetes.io/projected/ba6b0460-cf7b-4d97-aa51-fcc48e35ab96-kube-api-access-6ds6h\") pod \"ba6b0460-cf7b-4d97-aa51-fcc48e35ab96\" (UID: \"ba6b0460-cf7b-4d97-aa51-fcc48e35ab96\") "
Sep 18 14:16:16.433992 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:16.433972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba6b0460-cf7b-4d97-aa51-fcc48e35ab96-kube-api-access-6ds6h" (OuterVolumeSpecName: "kube-api-access-6ds6h") pod "ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" (UID: "ba6b0460-cf7b-4d97-aa51-fcc48e35ab96"). InnerVolumeSpecName "kube-api-access-6ds6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:16:16.532444 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:16.532389    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ds6h\" (UniqueName: \"kubernetes.io/projected/ba6b0460-cf7b-4d97-aa51-fcc48e35ab96-kube-api-access-6ds6h\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:16.789011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:16.788939    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"]
Sep 18 14:16:16.812675 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:16.812644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:17.274277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:17.274241    2578 generic.go:356] "Generic (PLEG): container finished" podID="ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" containerID="f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978" exitCode=137
Sep 18 14:16:17.274737 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:17.274307    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:17.274737 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:17.274343    2578 scope.go:117] "RemoveContainer" containerID="f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978"
Sep 18 14:16:17.283120 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:17.283102    2578 scope.go:117] "RemoveContainer" containerID="f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978"
Sep 18 14:16:17.283393 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:16:17.283375    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978\": container with ID starting with f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978 not found: ID does not exist" containerID="f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978"
Sep 18 14:16:17.283455 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:17.283402    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978"} err="failed to get container status \"f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978\": rpc error: code = NotFound desc = could not find container \"f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978\": container with ID starting with f6e68dead9d304dc6e299f41fd9af667beba896ee96764e4f422dd0fc032c978 not found: ID does not exist"
Sep 18 14:16:17.284410 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:16:17.284384    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7432-922d96\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" pod="opendatahub/test-curl-7432-922d96"
Sep 18 14:16:17.807339 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:17.807304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:17.849951 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:17.849922    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba6b0460-cf7b-4d97-aa51-fcc48e35ab96" path="/var/lib/kubelet/pods/ba6b0460-cf7b-4d97-aa51-fcc48e35ab96/volumes"
Sep 18 14:16:18.437860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:18.437838    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:18.548271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:18.548175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knwl9\" (UniqueName: \"kubernetes.io/projected/410115d2-f92f-4d99-b8f4-f74bfe6c8512-kube-api-access-knwl9\") pod \"410115d2-f92f-4d99-b8f4-f74bfe6c8512\" (UID: \"410115d2-f92f-4d99-b8f4-f74bfe6c8512\") "
Sep 18 14:16:18.550548 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:18.550522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410115d2-f92f-4d99-b8f4-f74bfe6c8512-kube-api-access-knwl9" (OuterVolumeSpecName: "kube-api-access-knwl9") pod "410115d2-f92f-4d99-b8f4-f74bfe6c8512" (UID: "410115d2-f92f-4d99-b8f4-f74bfe6c8512"). InnerVolumeSpecName "kube-api-access-knwl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:16:18.649883 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:18.649847    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knwl9\" (UniqueName: \"kubernetes.io/projected/410115d2-f92f-4d99-b8f4-f74bfe6c8512-kube-api-access-knwl9\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:19.287417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:19.287385    2578 generic.go:356] "Generic (PLEG): container finished" podID="410115d2-f92f-4d99-b8f4-f74bfe6c8512" containerID="1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792" exitCode=137
Sep 18 14:16:19.287624 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:19.287435    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:19.287624 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:19.287452    2578 scope.go:117] "RemoveContainer" containerID="1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792"
Sep 18 14:16:19.295950 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:19.295931    2578 scope.go:117] "RemoveContainer" containerID="1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792"
Sep 18 14:16:19.296221 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:16:19.296200    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792\": container with ID starting with 1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792 not found: ID does not exist" containerID="1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792"
Sep 18 14:16:19.296265 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:19.296230    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792"} err="failed to get container status \"1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792\": rpc error: code = NotFound desc = could not find container \"1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792\": container with ID starting with 1b1e6d10e8284630b4e0e364b681ec3b9d5fd1bcb1697ccfe05fd5fee40d9792 not found: ID does not exist"
Sep 18 14:16:19.297857 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:16:19.297837    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7432-f662c4\" is forbidden: User \"system:node:ip-10-0-132-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-244.ec2.internal' and this object" podUID="410115d2-f92f-4d99-b8f4-f74bfe6c8512" pod="opendatahub/test-curl-7432-f662c4"
Sep 18 14:16:19.849888 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:19.849853    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410115d2-f92f-4d99-b8f4-f74bfe6c8512" path="/var/lib/kubelet/pods/410115d2-f92f-4d99-b8f4-f74bfe6c8512/volumes"
Sep 18 14:16:22.468266 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:22.468234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:23.879960 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:23.879932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:30.694512 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:30.694477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:30.798256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:30.798223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:31.808116 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:31.808071    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m" podUID="c24fbbf0-31cb-4f92-abdb-58b39b53621a" containerName="main" containerID="cri-o://ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e" gracePeriod=45
Sep 18 14:16:32.063768 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.063715    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:16:32.164703 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.164663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpdlv\" (UniqueName: \"kubernetes.io/projected/c24fbbf0-31cb-4f92-abdb-58b39b53621a-kube-api-access-tpdlv\") pod \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") "
Sep 18 14:16:32.164857 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.164742    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tls-certs\") pod \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") "
Sep 18 14:16:32.164899 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.164873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-dshm\") pod \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") "
Sep 18 14:16:32.164938 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.164908    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tmp-dir\") pod \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") "
Sep 18 14:16:32.164976 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.164935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-home\") pod \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") "
Sep 18 14:16:32.164976 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.164969    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-model-cache\") pod \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\" (UID: \"c24fbbf0-31cb-4f92-abdb-58b39b53621a\") "
Sep 18 14:16:32.165443 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.165359    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-home" (OuterVolumeSpecName: "home") pod "c24fbbf0-31cb-4f92-abdb-58b39b53621a" (UID: "c24fbbf0-31cb-4f92-abdb-58b39b53621a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:16:32.165443 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.165380    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c24fbbf0-31cb-4f92-abdb-58b39b53621a" (UID: "c24fbbf0-31cb-4f92-abdb-58b39b53621a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:16:32.165443 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.165358    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c24fbbf0-31cb-4f92-abdb-58b39b53621a" (UID: "c24fbbf0-31cb-4f92-abdb-58b39b53621a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:16:32.167007 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.166980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c24fbbf0-31cb-4f92-abdb-58b39b53621a-kube-api-access-tpdlv" (OuterVolumeSpecName: "kube-api-access-tpdlv") pod "c24fbbf0-31cb-4f92-abdb-58b39b53621a" (UID: "c24fbbf0-31cb-4f92-abdb-58b39b53621a"). InnerVolumeSpecName "kube-api-access-tpdlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:16:32.167110 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.167027    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-dshm" (OuterVolumeSpecName: "dshm") pod "c24fbbf0-31cb-4f92-abdb-58b39b53621a" (UID: "c24fbbf0-31cb-4f92-abdb-58b39b53621a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:16:32.167110 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.167068    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c24fbbf0-31cb-4f92-abdb-58b39b53621a" (UID: "c24fbbf0-31cb-4f92-abdb-58b39b53621a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:16:32.266404 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.266366    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:32.266404 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.266396    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:32.266404 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.266407    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:32.266404 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.266415    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c24fbbf0-31cb-4f92-abdb-58b39b53621a-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:32.266722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.266423    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpdlv\" (UniqueName: \"kubernetes.io/projected/c24fbbf0-31cb-4f92-abdb-58b39b53621a-kube-api-access-tpdlv\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:32.266722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.266432    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c24fbbf0-31cb-4f92-abdb-58b39b53621a-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:16:32.346788 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.346694    2578 generic.go:356] "Generic (PLEG): container finished" podID="c24fbbf0-31cb-4f92-abdb-58b39b53621a" containerID="ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e" exitCode=0
Sep 18 14:16:32.346788 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.346740    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"
Sep 18 14:16:32.347034 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.346778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m" event={"ID":"c24fbbf0-31cb-4f92-abdb-58b39b53621a","Type":"ContainerDied","Data":"ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e"}
Sep 18 14:16:32.347034 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.346831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m" event={"ID":"c24fbbf0-31cb-4f92-abdb-58b39b53621a","Type":"ContainerDied","Data":"ae68e9073a593b2e47450a7a78a17f40903fb94e5155c0332102a3164d29c5a9"}
Sep 18 14:16:32.347034 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.346853    2578 scope.go:117] "RemoveContainer" containerID="ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e"
Sep 18 14:16:32.355629 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.355586    2578 scope.go:117] "RemoveContainer" containerID="ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e"
Sep 18 14:16:32.355901 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:16:32.355880    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e\": container with ID starting with ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e not found: ID does not exist" containerID="ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e"
Sep 18 14:16:32.355964 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.355909    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e"} err="failed to get container status \"ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e\": rpc error: code = NotFound desc = could not find container \"ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e\": container with ID starting with ba1bda81840b11bca4749a45a6339476fa0917b1db2a604b0a2202cf568f0a0e not found: ID does not exist"
Sep 18 14:16:32.367945 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.367923    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"]
Sep 18 14:16:32.371560 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:32.371540    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d25bfb/sub-test-model-d25bfb-kserve-66ddc9558f-jmz5m"]
Sep 18 14:16:33.850684 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:33.850650    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c24fbbf0-31cb-4f92-abdb-58b39b53621a" path="/var/lib/kubelet/pods/c24fbbf0-31cb-4f92-abdb-58b39b53621a/volumes"
Sep 18 14:16:49.877720 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.877679    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"]
Sep 18 14:16:49.878317 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.878154    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c24fbbf0-31cb-4f92-abdb-58b39b53621a" containerName="main"
Sep 18 14:16:49.878317 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.878173    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c24fbbf0-31cb-4f92-abdb-58b39b53621a" containerName="main"
Sep 18 14:16:49.878317 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.878200    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410115d2-f92f-4d99-b8f4-f74bfe6c8512" containerName="test-curl-7432-f662c4"
Sep 18 14:16:49.878317 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.878209    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="410115d2-f92f-4d99-b8f4-f74bfe6c8512" containerName="test-curl-7432-f662c4"
Sep 18 14:16:49.878317 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.878287    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="410115d2-f92f-4d99-b8f4-f74bfe6c8512" containerName="test-curl-7432-f662c4"
Sep 18 14:16:49.878317 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.878299    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c24fbbf0-31cb-4f92-abdb-58b39b53621a" containerName="main"
Sep 18 14:16:49.881280 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.881259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:49.883976 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.883955    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"kube-root-ca.crt\""
Sep 18 14:16:49.885230 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.885211    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"openshift-service-ca.crt\""
Sep 18 14:16:49.885322 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.885228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"default-dockercfg-qwgsc\""
Sep 18 14:16:49.885322 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.885289    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d634d2\"/\"rate-test-model-d634d2-kserve-self-signed-certs\""
Sep 18 14:16:49.890024 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.890002    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"]
Sep 18 14:16:49.925240 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.925217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-model-cache\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:49.925385 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.925254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnmcs\" (UniqueName: \"kubernetes.io/projected/461fe269-446a-4a10-9668-0cd142cf5a96-kube-api-access-xnmcs\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:49.925385 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.925288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461fe269-446a-4a10-9668-0cd142cf5a96-tls-certs\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:49.925385 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.925337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-dshm\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:49.925511 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.925387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-home\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:49.925511 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.925449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-tmp-dir\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:49.968816 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:49.968793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:16:50.026745 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.026717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-model-cache\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.026858 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.026755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnmcs\" (UniqueName: \"kubernetes.io/projected/461fe269-446a-4a10-9668-0cd142cf5a96-kube-api-access-xnmcs\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.026858 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.026794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461fe269-446a-4a10-9668-0cd142cf5a96-tls-certs\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.026858 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.026824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-dshm\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.027004 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.026862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-home\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.027004 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.026905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-tmp-dir\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.027170 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.027148    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-model-cache\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.027238 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.027221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-tmp-dir\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.027334 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.027315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-home\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.029219 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.029202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-dshm\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.029581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.029562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461fe269-446a-4a10-9668-0cd142cf5a96-tls-certs\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.035800 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.035773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnmcs\" (UniqueName: \"kubernetes.io/projected/461fe269-446a-4a10-9668-0cd142cf5a96-kube-api-access-xnmcs\") pod \"rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") " pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.191752 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.191718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:16:50.463931 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:50.463902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"]
Sep 18 14:16:50.466494 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:16:50.466469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod461fe269_446a_4a10_9668_0cd142cf5a96.slice/crio-ff5b118039a380594e2d6fa42654c25bb9a1141f4466e14171af53d71dc94682 WatchSource:0}: Error finding container ff5b118039a380594e2d6fa42654c25bb9a1141f4466e14171af53d71dc94682: Status 404 returned error can't find the container with id ff5b118039a380594e2d6fa42654c25bb9a1141f4466e14171af53d71dc94682
Sep 18 14:16:51.439907 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:51.439872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf" event={"ID":"461fe269-446a-4a10-9668-0cd142cf5a96","Type":"ContainerStarted","Data":"06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a"}
Sep 18 14:16:51.440382 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:51.439921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf" event={"ID":"461fe269-446a-4a10-9668-0cd142cf5a96","Type":"ContainerStarted","Data":"ff5b118039a380594e2d6fa42654c25bb9a1141f4466e14171af53d71dc94682"}
Sep 18 14:16:51.458494 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:16:51.458444    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf" podStartSLOduration=2.458429582 podStartE2EDuration="2.458429582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:16:51.4567296 +0000 UTC m=+1960.148601200" watchObservedRunningTime="2026-09-18 14:16:51.458429582 +0000 UTC m=+1960.150301177"
Sep 18 14:17:00.192501 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:00.192469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:17:00.192935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:00.192517    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:17:00.204939 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:00.204915    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:17:00.492867 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:00.492789    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:17:26.175937 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:26.175899    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:27.166451 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.166418    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"]
Sep 18 14:17:27.177941 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.177916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:27.585051 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.585014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:27.857921 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.857832    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"]
Sep 18 14:17:27.861214 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.861190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.863818 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.863800    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e8d773-openshift-default-dockercfg-ssdnd\""
Sep 18 14:17:27.873694 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.873672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"]
Sep 18 14:17:27.885969 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.885947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:27.956486 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmqb\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-kube-api-access-mgmqb\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.956684 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-socket\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.956684 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-credential-socket\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.956684 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-envoy\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.956684 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-token\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.956881 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-certs\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.956881 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b447e-f97c-40b0-91a4-0a583ccc8a42-istiod-ca-cert\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.956881 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-data\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:27.957013 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:27.956909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-podinfo\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058092 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-certs\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b447e-f97c-40b0-91a4-0a583ccc8a42-istiod-ca-cert\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-data\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-podinfo\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmqb\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-kube-api-access-mgmqb\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058326 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-socket\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-credential-socket\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-envoy\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-token\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-certs\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058638 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-socket\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058818 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-credential-socket\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.058895 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.058877    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-data\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.059027 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.059002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b447e-f97c-40b0-91a4-0a583ccc8a42-istiod-ca-cert\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.060929 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.060898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-envoy\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.061189 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.061172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-podinfo\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.067550 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.067524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-token\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.067550 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.067540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmqb\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-kube-api-access-mgmqb\") pod \"e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") " pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.171273 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.171181    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:28.328562 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.328520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:28.449157 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.449127    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"]
Sep 18 14:17:28.451505 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:17:28.451477    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398b447e_f97c_40b0_91a4_0a583ccc8a42.slice/crio-7de3610a0a79d9ab122e43c63e6d74b93feba7dfd827ba87a2be65f82e52cd48 WatchSource:0}: Error finding container 7de3610a0a79d9ab122e43c63e6d74b93feba7dfd827ba87a2be65f82e52cd48: Status 404 returned error can't find the container with id 7de3610a0a79d9ab122e43c63e6d74b93feba7dfd827ba87a2be65f82e52cd48
Sep 18 14:17:28.453791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.453755    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:28.453880 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.453837    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:28.453880 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.453865    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:28.609302 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.609257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" event={"ID":"398b447e-f97c-40b0-91a4-0a583ccc8a42","Type":"ContainerStarted","Data":"5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e"}
Sep 18 14:17:28.609468 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.609325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" event={"ID":"398b447e-f97c-40b0-91a4-0a583ccc8a42","Type":"ContainerStarted","Data":"7de3610a0a79d9ab122e43c63e6d74b93feba7dfd827ba87a2be65f82e52cd48"}
Sep 18 14:17:28.632854 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:28.632797    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podStartSLOduration=1.632775517 podStartE2EDuration="1.632775517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:17:28.630178105 +0000 UTC m=+1997.322049701" watchObservedRunningTime="2026-09-18 14:17:28.632775517 +0000 UTC m=+1997.324647113"
Sep 18 14:17:29.171367 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:29.171336    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:29.176053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:29.176030    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:29.614621 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:29.614585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:29.615689 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:29.615668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:30.480355 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:30.480320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:30.569969 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:30.569928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:31.480700 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:31.480661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:32.211082 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:32.211048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:32.311833 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:32.311791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:32.411830 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:32.411791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:32.711182 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:32.711151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:32.809322 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:32.809282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:37.587240 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:37.587200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:42.185484 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.185423    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf" podUID="461fe269-446a-4a10-9668-0cd142cf5a96" containerName="main" containerID="cri-o://06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a" gracePeriod=45
Sep 18 14:17:42.440218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.440194    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:17:42.497557 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.497527    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-tmp-dir\") pod \"461fe269-446a-4a10-9668-0cd142cf5a96\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") "
Sep 18 14:17:42.497751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.497574    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnmcs\" (UniqueName: \"kubernetes.io/projected/461fe269-446a-4a10-9668-0cd142cf5a96-kube-api-access-xnmcs\") pod \"461fe269-446a-4a10-9668-0cd142cf5a96\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") "
Sep 18 14:17:42.497751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.497629    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-dshm\") pod \"461fe269-446a-4a10-9668-0cd142cf5a96\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") "
Sep 18 14:17:42.497751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.497695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-model-cache\") pod \"461fe269-446a-4a10-9668-0cd142cf5a96\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") "
Sep 18 14:17:42.497751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.497727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-home\") pod \"461fe269-446a-4a10-9668-0cd142cf5a96\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") "
Sep 18 14:17:42.497972 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.497784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461fe269-446a-4a10-9668-0cd142cf5a96-tls-certs\") pod \"461fe269-446a-4a10-9668-0cd142cf5a96\" (UID: \"461fe269-446a-4a10-9668-0cd142cf5a96\") "
Sep 18 14:17:42.497972 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.497822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "461fe269-446a-4a10-9668-0cd142cf5a96" (UID: "461fe269-446a-4a10-9668-0cd142cf5a96"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:42.498071 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.498009    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-model-cache" (OuterVolumeSpecName: "model-cache") pod "461fe269-446a-4a10-9668-0cd142cf5a96" (UID: "461fe269-446a-4a10-9668-0cd142cf5a96"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:42.498071 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.498032    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-home" (OuterVolumeSpecName: "home") pod "461fe269-446a-4a10-9668-0cd142cf5a96" (UID: "461fe269-446a-4a10-9668-0cd142cf5a96"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:42.498167 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.498134    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:17:42.498167 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.498153    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:17:42.498167 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.498165    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:17:42.500055 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.500027    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-dshm" (OuterVolumeSpecName: "dshm") pod "461fe269-446a-4a10-9668-0cd142cf5a96" (UID: "461fe269-446a-4a10-9668-0cd142cf5a96"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:17:42.500164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.500078    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461fe269-446a-4a10-9668-0cd142cf5a96-kube-api-access-xnmcs" (OuterVolumeSpecName: "kube-api-access-xnmcs") pod "461fe269-446a-4a10-9668-0cd142cf5a96" (UID: "461fe269-446a-4a10-9668-0cd142cf5a96"). InnerVolumeSpecName "kube-api-access-xnmcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:17:42.500311 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.500296    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/461fe269-446a-4a10-9668-0cd142cf5a96-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "461fe269-446a-4a10-9668-0cd142cf5a96" (UID: "461fe269-446a-4a10-9668-0cd142cf5a96"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:17:42.599629 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.599585    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/461fe269-446a-4a10-9668-0cd142cf5a96-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:17:42.599629 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.599639    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnmcs\" (UniqueName: \"kubernetes.io/projected/461fe269-446a-4a10-9668-0cd142cf5a96-kube-api-access-xnmcs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:17:42.599871 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.599650    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/461fe269-446a-4a10-9668-0cd142cf5a96-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:17:42.690528 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.690497    2578 generic.go:356] "Generic (PLEG): container finished" podID="461fe269-446a-4a10-9668-0cd142cf5a96" containerID="06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a" exitCode=0
Sep 18 14:17:42.690728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.690547    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"
Sep 18 14:17:42.690728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.690595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf" event={"ID":"461fe269-446a-4a10-9668-0cd142cf5a96","Type":"ContainerDied","Data":"06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a"}
Sep 18 14:17:42.690728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.690679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf" event={"ID":"461fe269-446a-4a10-9668-0cd142cf5a96","Type":"ContainerDied","Data":"ff5b118039a380594e2d6fa42654c25bb9a1141f4466e14171af53d71dc94682"}
Sep 18 14:17:42.690728 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.690707    2578 scope.go:117] "RemoveContainer" containerID="06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a"
Sep 18 14:17:42.700281 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.700247    2578 scope.go:117] "RemoveContainer" containerID="06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a"
Sep 18 14:17:42.700578 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:17:42.700557    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a\": container with ID starting with 06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a not found: ID does not exist" containerID="06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a"
Sep 18 14:17:42.700679 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.700587    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a"} err="failed to get container status \"06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a\": rpc error: code = NotFound desc = could not find container \"06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a\": container with ID starting with 06c85bcaedb224e3bf251863da06e1912861abbded7c910ecd4fa7c7fee7889a not found: ID does not exist"
Sep 18 14:17:42.712591 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.712557    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"]
Sep 18 14:17:42.714977 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:42.714956    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d634d2/rate-test-model-d634d2-kserve-d4f8c4b4c-n6tdf"]
Sep 18 14:17:43.850798 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:43.850759    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461fe269-446a-4a10-9668-0cd142cf5a96" path="/var/lib/kubelet/pods/461fe269-446a-4a10-9668-0cd142cf5a96/volumes"
Sep 18 14:17:45.152696 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.151857    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": read tcp 10.132.0.2:39290->10.132.0.76:15021: read: connection reset by peer" start-of-body=
Sep 18 14:17:45.152696 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.151920    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": read tcp 10.132.0.2:39290->10.132.0.76:15021: read: connection reset by peer"
Sep 18 14:17:45.708498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.708466    2578 generic.go:356] "Generic (PLEG): container finished" podID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerID="5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e" exitCode=0
Sep 18 14:17:45.708693 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.708525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" event={"ID":"398b447e-f97c-40b0-91a4-0a583ccc8a42","Type":"ContainerDied","Data":"5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e"}
Sep 18 14:17:45.708989 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.708974    2578 scope.go:117] "RemoveContainer" containerID="5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e"
Sep 18 14:17:45.710086 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.710059    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:45.710141 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.710126    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:45.710180 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:45.710159    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:46.714887 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:46.714850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" event={"ID":"398b447e-f97c-40b0-91a4-0a583ccc8a42","Type":"ContainerStarted","Data":"cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e"}
Sep 18 14:17:47.172000 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:47.171899    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:47.172354 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:47.172325    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 18 14:17:47.172527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:47.172499    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 18 14:17:48.172503 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:48.172454    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 18 14:17:48.173036 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:48.172547    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 18 14:17:49.171900 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:49.171853    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 18 14:17:49.172126 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:49.171924    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 18 14:17:50.172626 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:50.172561    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 18 14:17:50.173137 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:50.172652    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 18 14:17:51.172731 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:51.172691    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 18 14:17:51.173370 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:51.173333    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 18 14:17:52.175627 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:52.175578    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:52.176115 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:52.176014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:52.176750 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:52.176726    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:17:53.111331 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:53.111296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:54.356563 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:54.356525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:55.166074 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:55.165980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:55.438857 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:55.438817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:55.842121 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:55.842020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:56.087881 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.087848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:56.187018 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.186978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:56.504423 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.504337    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"]
Sep 18 14:17:56.504829 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.504814    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461fe269-446a-4a10-9668-0cd142cf5a96" containerName="main"
Sep 18 14:17:56.504885 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.504833    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="461fe269-446a-4a10-9668-0cd142cf5a96" containerName="main"
Sep 18 14:17:56.504949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.504937    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="461fe269-446a-4a10-9668-0cd142cf5a96" containerName="main"
Sep 18 14:17:56.508011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.507992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.510880 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.510858    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a035eb-openshift-default-dockercfg-szdr2\""
Sep 18 14:17:56.534149 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.534124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"]
Sep 18 14:17:56.551755 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.551727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:56.641198 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.641165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:56.651447 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-podinfo\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9gl6\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-kube-api-access-b9gl6\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-credential-socket\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-certs\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651632 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-socket\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-token\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istiod-ca-cert\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-envoy\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.651920 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.651806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-data\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.752852 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.752816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-credential-socket\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.752852 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.752851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-certs\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.752888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-socket\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.752926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-token\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.752955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istiod-ca-cert\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.752980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-envoy\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-data\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753335 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-podinfo\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753335 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9gl6\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-kube-api-access-b9gl6\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753335 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-credential-socket\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753335 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-certs\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753547 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753474    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-data\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753547 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-socket\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.753780 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.753758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istiod-ca-cert\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.755477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.755427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-envoy\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.755748 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.755730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-podinfo\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.765319 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.763685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-token\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.768768 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.767477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9gl6\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-kube-api-access-b9gl6\") pod \"e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") " pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.818843 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.818811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:56.821160 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:56.821136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:57.097056 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.097028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"]
Sep 18 14:17:57.098979 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:17:57.098951    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a02a5d_91ed_445e_8230_bebfeaef39a6.slice/crio-6d12c24f07a9a782327d3cd39c50a6bcd90872511e5b623467bb0a6a1c9fb669 WatchSource:0}: Error finding container 6d12c24f07a9a782327d3cd39c50a6bcd90872511e5b623467bb0a6a1c9fb669: Status 404 returned error can't find the container with id 6d12c24f07a9a782327d3cd39c50a6bcd90872511e5b623467bb0a6a1c9fb669
Sep 18 14:17:57.101255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.101221    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:57.101350 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.101289    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:57.101350 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.101322    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:17:57.771911 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.771878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" event={"ID":"e0a02a5d-91ed-445e-8230-bebfeaef39a6","Type":"ContainerStarted","Data":"76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d"}
Sep 18 14:17:57.772365 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.771929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" event={"ID":"e0a02a5d-91ed-445e-8230-bebfeaef39a6","Type":"ContainerStarted","Data":"6d12c24f07a9a782327d3cd39c50a6bcd90872511e5b623467bb0a6a1c9fb669"}
Sep 18 14:17:57.796549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.796449    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podStartSLOduration=1.796429321 podStartE2EDuration="1.796429321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:17:57.795717835 +0000 UTC m=+2026.487589431" watchObservedRunningTime="2026-09-18 14:17:57.796429321 +0000 UTC m=+2026.488300916"
Sep 18 14:17:57.819832 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:57.819805    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:58.823968 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:58.823937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:59.016843 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:59.016787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:59.728630 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:59.728581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:17:59.780898 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:59.780873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:59.781971 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:59.781951    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:17:59.810902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:17:59.810858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:00.015939 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:00.015856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:00.780494 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:00.780464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:01.694098 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:01.694064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:02.511265 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:02.511201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:02.616479 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:02.616436    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:02.717215 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:02.717180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:03.007900 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:03.007855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:03.132662 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:03.132630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:15.321740 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:15.321698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:15.822766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:15.822724    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 14:18:15.822975 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:15.822779    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 14:18:16.864656 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:16.864600    2578 generic.go:356] "Generic (PLEG): container finished" podID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerID="76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d" exitCode=0
Sep 18 14:18:16.865090 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:16.864665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" event={"ID":"e0a02a5d-91ed-445e-8230-bebfeaef39a6","Type":"ContainerDied","Data":"76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d"}
Sep 18 14:18:16.865090 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:16.865013    2578 scope.go:117] "RemoveContainer" containerID="76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d"
Sep 18 14:18:16.866038 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:16.866006    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:18:16.866131 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:16.866074    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:18:16.866131 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:16.866108    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 18 14:18:17.875178 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:17.875141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" event={"ID":"e0a02a5d-91ed-445e-8230-bebfeaef39a6","Type":"ContainerStarted","Data":"f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc"}
Sep 18 14:18:18.819158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:18.819125    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:18:18.819361 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:18.819318    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 18 14:18:18.819412 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:18.819374    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 18 14:18:19.819870 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:19.819835    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 18 14:18:19.820299 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:19.819891    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 18 14:18:20.819691 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:20.819659    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 18 14:18:20.819884 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:20.819713    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 18 14:18:21.820048 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:21.820007    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 18 14:18:21.820446 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:21.820063    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 18 14:18:22.819316 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:22.819272    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 18 14:18:22.819518 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:22.819346    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 18 14:18:23.568509 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:23.568475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:23.823563 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:23.823481    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:18:23.823875 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:23.823854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:18:23.824594 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:23.824576    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:18:24.687577 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:24.687536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:24.895849 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:24.895819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:25.787715 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:25.787679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:26.572749 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:26.572709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:27.281975 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:27.281945    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:28.115191 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:28.115155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:39.075377 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.075284    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"]
Sep 18 14:18:39.079081 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.079058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.083059 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.083035    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e8d773\"/\"openshift-service-ca.crt\""
Sep 18 14:18:39.083189 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.083167    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e8d773\"/\"kube-root-ca.crt\""
Sep 18 14:18:39.083268 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.083171    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e8d773\"/\"default-dockercfg-t69gw\""
Sep 18 14:18:39.083268 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.083170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e8d773\"/\"ipp-route-e8d773-kserve-self-signed-certs\""
Sep 18 14:18:39.088873 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.088851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"]
Sep 18 14:18:39.135946 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.135912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019bdc20-0838-4ea7-8fc8-a69960429350-tls-certs\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.136120 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.136017    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-tmp-dir\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.136120 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.136085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-dshm\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.136219 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.136126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-home\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.136219 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.136152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztpd5\" (UniqueName: \"kubernetes.io/projected/019bdc20-0838-4ea7-8fc8-a69960429350-kube-api-access-ztpd5\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.136219 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.136187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-model-cache\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.170307 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.170274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:18:39.236726 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.236697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019bdc20-0838-4ea7-8fc8-a69960429350-tls-certs\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.236882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.236741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-tmp-dir\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.236882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.236766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-dshm\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.236993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.236881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-home\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.236993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.236914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztpd5\" (UniqueName: \"kubernetes.io/projected/019bdc20-0838-4ea7-8fc8-a69960429350-kube-api-access-ztpd5\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.236993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.236938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-model-cache\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.237213 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.237184    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-tmp-dir\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.237282 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.237236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-home\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.237330 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.237308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-model-cache\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.239158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.239141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-dshm\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.239300 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.239285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019bdc20-0838-4ea7-8fc8-a69960429350-tls-certs\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.246681 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.246659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztpd5\" (UniqueName: \"kubernetes.io/projected/019bdc20-0838-4ea7-8fc8-a69960429350-kube-api-access-ztpd5\") pod \"ipp-route-e8d773-kserve-565b545959-h5929\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") " pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.389509 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.389414    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:39.667533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.667508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"]
Sep 18 14:18:39.670138 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:18:39.670109    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod019bdc20_0838_4ea7_8fc8_a69960429350.slice/crio-3dd3e647c3fd3c9ccc713d9a3df156f16a03f2ac7b6ac332d917e2237e03e305 WatchSource:0}: Error finding container 3dd3e647c3fd3c9ccc713d9a3df156f16a03f2ac7b6ac332d917e2237e03e305: Status 404 returned error can't find the container with id 3dd3e647c3fd3c9ccc713d9a3df156f16a03f2ac7b6ac332d917e2237e03e305
Sep 18 14:18:39.978053 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.978007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929" event={"ID":"019bdc20-0838-4ea7-8fc8-a69960429350","Type":"ContainerStarted","Data":"206ad2eb95c560e02b6ad1378cababb987fe3ee97d1f0a0fecf0090e196d4cc5"}
Sep 18 14:18:39.978219 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.978067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929" event={"ID":"019bdc20-0838-4ea7-8fc8-a69960429350","Type":"ContainerStarted","Data":"3dd3e647c3fd3c9ccc713d9a3df156f16a03f2ac7b6ac332d917e2237e03e305"}
Sep 18 14:18:39.995800 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:39.995759    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929" podStartSLOduration=0.995744142 podStartE2EDuration="995.744142ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:18:39.994146853 +0000 UTC m=+2068.686018461" watchObservedRunningTime="2026-09-18 14:18:39.995744142 +0000 UTC m=+2068.687615737"
Sep 18 14:18:49.389730 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:49.389682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:49.390337 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:49.389768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:49.402420 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:49.402399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:18:50.038502 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:18:50.038473    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:19:06.268544 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:06.268510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:06.574323 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:06.574249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:06.670718 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:06.670683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:09.116142 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:09.116099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:09.724316 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:09.724281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:09.817953 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:09.817924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:09.944934 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:09.944885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:11.016277 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:11.016247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:11.840824 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:11.840787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:12.626244 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:12.626195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:13.312993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.312956    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"]
Sep 18 14:19:13.316308 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.316287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.318974 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.318952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-4ce51f-serving-cert\""
Sep 18 14:19:13.327234 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.327209    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"]
Sep 18 14:19:13.347674 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.347653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:13.444040 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.443999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77hwh\" (UniqueName: \"kubernetes.io/projected/a123511c-53ae-4f2a-a365-1b1e28deddec-kube-api-access-77hwh\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.444040 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.444046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.444313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.444187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a123511c-53ae-4f2a-a365-1b1e28deddec-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.444313 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.444238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.448245 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.448215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:13.545110 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.545066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a123511c-53ae-4f2a-a365-1b1e28deddec-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.545315 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.545127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.545315 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.545175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77hwh\" (UniqueName: \"kubernetes.io/projected/a123511c-53ae-4f2a-a365-1b1e28deddec-kube-api-access-77hwh\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.545315 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.545210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.545490 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:19:13.545318    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-serving-cert: secret "maas-api-e2e-ipp-cleanup-4ce51f-serving-cert" not found
Sep 18 14:19:13.545490 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:19:13.545397    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls podName:a123511c-53ae-4f2a-a365-1b1e28deddec nodeName:}" failed. No retries permitted until 2026-09-18 14:19:14.045374411 +0000 UTC m=+2102.737245997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd" (UID: "a123511c-53ae-4f2a-a365-1b1e28deddec") : secret "maas-api-e2e-ipp-cleanup-4ce51f-serving-cert" not found
Sep 18 14:19:13.545766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.545746    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a123511c-53ae-4f2a-a365-1b1e28deddec-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.548027 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.548007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.555714 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.555689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77hwh\" (UniqueName: \"kubernetes.io/projected/a123511c-53ae-4f2a-a365-1b1e28deddec-kube-api-access-77hwh\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:13.625129 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.625023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:13.899311 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.899212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:13.997164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:13.997125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:14.050462 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:14.050433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:14.053075 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:14.053048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:14.229678 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:14.229644    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:14.502686 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:14.502658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"]
Sep 18 14:19:14.504263 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:19:14.504238    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda123511c_53ae_4f2a_a365_1b1e28deddec.slice/crio-255e2446353ce66b1fdae2fbda97c37b3e13b17224db024c9eb19b2aa7ecfd55 WatchSource:0}: Error finding container 255e2446353ce66b1fdae2fbda97c37b3e13b17224db024c9eb19b2aa7ecfd55: Status 404 returned error can't find the container with id 255e2446353ce66b1fdae2fbda97c37b3e13b17224db024c9eb19b2aa7ecfd55
Sep 18 14:19:14.505733 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:14.505716    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 14:19:15.152562 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:15.152526    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd" event={"ID":"a123511c-53ae-4f2a-a365-1b1e28deddec","Type":"ContainerStarted","Data":"a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668"}
Sep 18 14:19:15.152949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:15.152579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd" event={"ID":"a123511c-53ae-4f2a-a365-1b1e28deddec","Type":"ContainerStarted","Data":"255e2446353ce66b1fdae2fbda97c37b3e13b17224db024c9eb19b2aa7ecfd55"}
Sep 18 14:19:15.152949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:15.152621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:15.170815 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:15.170717    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd" podStartSLOduration=1.767892787 podStartE2EDuration="2.170697098s" totalImagesPullingTime="402.804311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:19:15.170114494 +0000 UTC m=+2103.861986089" watchObservedRunningTime="2026-09-18 14:19:15.170697098 +0000 UTC m=+2103.862568691"
Sep 18 14:19:21.163451 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:21.163422    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:27.280573 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:27.280538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:27.381228 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:27.381195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:35.383628 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:35.383567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:36.326968 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:36.326925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:37.031518 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:37.031485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:37.793067 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:37.793019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:38.593866 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:38.593819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:39.245350 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:39.245292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:39.828361 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:39.828326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:41.365568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:41.365514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:42.094673 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:42.094630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:42.917839 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:42.917803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:43.604181 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:43.604127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:44.418437 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:44.418390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:45.222161 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:45.222127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:51.712528 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:51.712492    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"]
Sep 18 14:19:51.713094 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:51.712771    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd" podUID="a123511c-53ae-4f2a-a365-1b1e28deddec" containerName="maas-api" containerID="cri-o://a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668" gracePeriod=30
Sep 18 14:19:51.758470 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:51.758413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:51.841679 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:51.841639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:51.942751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:51.942715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:51.966882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:51.966817    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:52.003413 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.003378    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a123511c-53ae-4f2a-a365-1b1e28deddec-openshift-service-ca\") pod \"a123511c-53ae-4f2a-a365-1b1e28deddec\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") "
Sep 18 14:19:52.003583 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.003436    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77hwh\" (UniqueName: \"kubernetes.io/projected/a123511c-53ae-4f2a-a365-1b1e28deddec-kube-api-access-77hwh\") pod \"a123511c-53ae-4f2a-a365-1b1e28deddec\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") "
Sep 18 14:19:52.003583 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.003540    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-metrics-certs\") pod \"a123511c-53ae-4f2a-a365-1b1e28deddec\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") "
Sep 18 14:19:52.003583 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.003564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls\") pod \"a123511c-53ae-4f2a-a365-1b1e28deddec\" (UID: \"a123511c-53ae-4f2a-a365-1b1e28deddec\") "
Sep 18 14:19:52.003767 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.003738    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a123511c-53ae-4f2a-a365-1b1e28deddec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a123511c-53ae-4f2a-a365-1b1e28deddec" (UID: "a123511c-53ae-4f2a-a365-1b1e28deddec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:19:52.005877 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.005847    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a123511c-53ae-4f2a-a365-1b1e28deddec" (UID: "a123511c-53ae-4f2a-a365-1b1e28deddec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:19:52.005996 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.005897    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a123511c-53ae-4f2a-a365-1b1e28deddec" (UID: "a123511c-53ae-4f2a-a365-1b1e28deddec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:19:52.005996 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.005911    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a123511c-53ae-4f2a-a365-1b1e28deddec-kube-api-access-77hwh" (OuterVolumeSpecName: "kube-api-access-77hwh") pod "a123511c-53ae-4f2a-a365-1b1e28deddec" (UID: "a123511c-53ae-4f2a-a365-1b1e28deddec"). InnerVolumeSpecName "kube-api-access-77hwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:19:52.042882 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.042845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:52.105220 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.105180    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-metrics-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:19:52.105220 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.105222    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a123511c-53ae-4f2a-a365-1b1e28deddec-maas-api-tls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:19:52.105491 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.105237    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a123511c-53ae-4f2a-a365-1b1e28deddec-openshift-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:19:52.105491 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.105252    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77hwh\" (UniqueName: \"kubernetes.io/projected/a123511c-53ae-4f2a-a365-1b1e28deddec-kube-api-access-77hwh\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:19:52.337019 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.336930    2578 generic.go:356] "Generic (PLEG): container finished" podID="a123511c-53ae-4f2a-a365-1b1e28deddec" containerID="a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668" exitCode=0
Sep 18 14:19:52.337019 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.336981    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"
Sep 18 14:19:52.337208 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.337023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd" event={"ID":"a123511c-53ae-4f2a-a365-1b1e28deddec","Type":"ContainerDied","Data":"a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668"}
Sep 18 14:19:52.337208 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.337084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd" event={"ID":"a123511c-53ae-4f2a-a365-1b1e28deddec","Type":"ContainerDied","Data":"255e2446353ce66b1fdae2fbda97c37b3e13b17224db024c9eb19b2aa7ecfd55"}
Sep 18 14:19:52.337208 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.337108    2578 scope.go:117] "RemoveContainer" containerID="a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668"
Sep 18 14:19:52.347422 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.347405    2578 scope.go:117] "RemoveContainer" containerID="a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668"
Sep 18 14:19:52.347739 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:19:52.347718    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668\": container with ID starting with a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668 not found: ID does not exist" containerID="a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668"
Sep 18 14:19:52.347827 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.347749    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668"} err="failed to get container status \"a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668\": rpc error: code = NotFound desc = could not find container \"a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668\": container with ID starting with a8530bb4b8defcef227444d6d64d51c11b294c1304406b01ddf3ea98f6b16668 not found: ID does not exist"
Sep 18 14:19:52.361956 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.361933    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"]
Sep 18 14:19:52.365383 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.365359    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-4ce51f-7565b9999c-4b5jd"]
Sep 18 14:19:52.489953 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.489919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:52.590283 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:52.590206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:53.207351 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:53.207307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:53.850497 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:53.850463    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a123511c-53ae-4f2a-a365-1b1e28deddec" path="/var/lib/kubelet/pods/a123511c-53ae-4f2a-a365-1b1e28deddec/volumes"
Sep 18 14:19:53.906820 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:53.906787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:54.711568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:54.711519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:55.399569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:55.399531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:58.512337 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:58.512304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:58.587790 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:58.587762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:19:58.791197 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:19:58.791121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:02.461079 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:02.461042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:03.228571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:03.228530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:04.121401 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:04.121367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:04.814454 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:04.814422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:05.478306 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:05.478274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:06.307838 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:06.307799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:14.189096 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:14.189059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:17.797447 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:17.797412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:17.876324 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:17.876294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:17.943189 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:17.943153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:18.039836 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:18.039795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:18.108334 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:18.108243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:18.406478 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:18.406389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:18.504247 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:18.504212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:19.495626 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:19.495585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:20.349385 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:20.349338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:21.031645 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:21.031591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:23.377939 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:23.377903    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"]
Sep 18 14:20:23.428129 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:23.428097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:38.397526 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.397483    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929" podUID="019bdc20-0838-4ea7-8fc8-a69960429350" containerName="main" containerID="cri-o://206ad2eb95c560e02b6ad1378cababb987fe3ee97d1f0a0fecf0090e196d4cc5" gracePeriod=45
Sep 18 14:20:38.560114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.560079    2578 generic.go:356] "Generic (PLEG): container finished" podID="019bdc20-0838-4ea7-8fc8-a69960429350" containerID="206ad2eb95c560e02b6ad1378cababb987fe3ee97d1f0a0fecf0090e196d4cc5" exitCode=0
Sep 18 14:20:38.560275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.560152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929" event={"ID":"019bdc20-0838-4ea7-8fc8-a69960429350","Type":"ContainerDied","Data":"206ad2eb95c560e02b6ad1378cababb987fe3ee97d1f0a0fecf0090e196d4cc5"}
Sep 18 14:20:38.655141 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.655077    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:20:38.740631 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740580    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019bdc20-0838-4ea7-8fc8-a69960429350-tls-certs\") pod \"019bdc20-0838-4ea7-8fc8-a69960429350\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") "
Sep 18 14:20:38.740860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-tmp-dir\") pod \"019bdc20-0838-4ea7-8fc8-a69960429350\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") "
Sep 18 14:20:38.740860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740702    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztpd5\" (UniqueName: \"kubernetes.io/projected/019bdc20-0838-4ea7-8fc8-a69960429350-kube-api-access-ztpd5\") pod \"019bdc20-0838-4ea7-8fc8-a69960429350\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") "
Sep 18 14:20:38.740860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740731    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-home\") pod \"019bdc20-0838-4ea7-8fc8-a69960429350\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") "
Sep 18 14:20:38.740860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740747    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-dshm\") pod \"019bdc20-0838-4ea7-8fc8-a69960429350\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") "
Sep 18 14:20:38.740860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-model-cache\") pod \"019bdc20-0838-4ea7-8fc8-a69960429350\" (UID: \"019bdc20-0838-4ea7-8fc8-a69960429350\") "
Sep 18 14:20:38.741145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "019bdc20-0838-4ea7-8fc8-a69960429350" (UID: "019bdc20-0838-4ea7-8fc8-a69960429350"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:38.741145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.740985    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-home" (OuterVolumeSpecName: "home") pod "019bdc20-0838-4ea7-8fc8-a69960429350" (UID: "019bdc20-0838-4ea7-8fc8-a69960429350"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:38.741145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.741082    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:20:38.741145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.741105    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:20:38.741145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.741100    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-model-cache" (OuterVolumeSpecName: "model-cache") pod "019bdc20-0838-4ea7-8fc8-a69960429350" (UID: "019bdc20-0838-4ea7-8fc8-a69960429350"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:38.742966 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.742932    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/019bdc20-0838-4ea7-8fc8-a69960429350-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "019bdc20-0838-4ea7-8fc8-a69960429350" (UID: "019bdc20-0838-4ea7-8fc8-a69960429350"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:20:38.743094 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.742983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-dshm" (OuterVolumeSpecName: "dshm") pod "019bdc20-0838-4ea7-8fc8-a69960429350" (UID: "019bdc20-0838-4ea7-8fc8-a69960429350"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:20:38.743094 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.743029    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019bdc20-0838-4ea7-8fc8-a69960429350-kube-api-access-ztpd5" (OuterVolumeSpecName: "kube-api-access-ztpd5") pod "019bdc20-0838-4ea7-8fc8-a69960429350" (UID: "019bdc20-0838-4ea7-8fc8-a69960429350"). InnerVolumeSpecName "kube-api-access-ztpd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:20:38.842506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.842470    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/019bdc20-0838-4ea7-8fc8-a69960429350-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:20:38.842506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.842498    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztpd5\" (UniqueName: \"kubernetes.io/projected/019bdc20-0838-4ea7-8fc8-a69960429350-kube-api-access-ztpd5\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:20:38.842506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.842509    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:20:38.842781 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:38.842519    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/019bdc20-0838-4ea7-8fc8-a69960429350-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:20:39.567743 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:39.567711    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"
Sep 18 14:20:39.567743 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:39.567733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929" event={"ID":"019bdc20-0838-4ea7-8fc8-a69960429350","Type":"ContainerDied","Data":"3dd3e647c3fd3c9ccc713d9a3df156f16a03f2ac7b6ac332d917e2237e03e305"}
Sep 18 14:20:39.568305 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:39.567787    2578 scope.go:117] "RemoveContainer" containerID="206ad2eb95c560e02b6ad1378cababb987fe3ee97d1f0a0fecf0090e196d4cc5"
Sep 18 14:20:39.590033 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:39.590010    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"]
Sep 18 14:20:39.592724 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:39.592703    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-e8d773/ipp-route-e8d773-kserve-565b545959-h5929"]
Sep 18 14:20:39.851758 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:39.851674    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="019bdc20-0838-4ea7-8fc8-a69960429350" path="/var/lib/kubelet/pods/019bdc20-0838-4ea7-8fc8-a69960429350/volumes"
Sep 18 14:20:50.218990 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:50.218915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:51.716000 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:51.715965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:56.674297 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:56.674262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:56.775580 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:56.775543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:56.932164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:56.932068    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"]
Sep 18 14:20:56.932357 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:56.932325    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy" containerID="cri-o://cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e" gracePeriod=30
Sep 18 14:20:56.962905 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:56.962874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:58.032623 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:58.032572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:58.718725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:58.718696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:20:59.626043 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:20:59.626013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:00.327831 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:00.327796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:02.179805 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.179778    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:21:02.359190 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359103    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgmqb\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-kube-api-access-mgmqb\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359190 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-data\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359435 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359205    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-token\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359435 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359243    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b447e-f97c-40b0-91a4-0a583ccc8a42-istiod-ca-cert\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359435 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359295    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-podinfo\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359435 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359383    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-socket\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359435 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359422    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-envoy\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359757 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359467    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-credential-socket\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359757 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359492    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-data" (OuterVolumeSpecName: "istio-data") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:02.359757 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359510    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-certs\") pod \"398b447e-f97c-40b0-91a4-0a583ccc8a42\" (UID: \"398b447e-f97c-40b0-91a4-0a583ccc8a42\") "
Sep 18 14:21:02.359757 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359720    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:02.359972 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359759    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398b447e-f97c-40b0-91a4-0a583ccc8a42-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:02.360039 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:02.360039 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.359995    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:02.360145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.360101    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/398b447e-f97c-40b0-91a4-0a583ccc8a42-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.360145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.360125    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.360256 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.360153    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.361912 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.361878    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:21:02.362047 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.361992    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-token" (OuterVolumeSpecName: "istio-token") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:02.362140 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.362121    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-kube-api-access-mgmqb" (OuterVolumeSpecName: "kube-api-access-mgmqb") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "kube-api-access-mgmqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:02.362275 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.362263    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "398b447e-f97c-40b0-91a4-0a583ccc8a42" (UID: "398b447e-f97c-40b0-91a4-0a583ccc8a42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:02.461295 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.461259    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.461295 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.461288    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.461295 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.461297    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.461295 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.461308    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.461581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.461316    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/398b447e-f97c-40b0-91a4-0a583ccc8a42-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.461581 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.461324    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgmqb\" (UniqueName: \"kubernetes.io/projected/398b447e-f97c-40b0-91a4-0a583ccc8a42-kube-api-access-mgmqb\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:02.680849 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.680765    2578 generic.go:356] "Generic (PLEG): container finished" podID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerID="cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e" exitCode=0
Sep 18 14:21:02.680849 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.680822    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"
Sep 18 14:21:02.681029 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.680855    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" event={"ID":"398b447e-f97c-40b0-91a4-0a583ccc8a42","Type":"ContainerDied","Data":"cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e"}
Sep 18 14:21:02.681029 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.680915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs" event={"ID":"398b447e-f97c-40b0-91a4-0a583ccc8a42","Type":"ContainerDied","Data":"7de3610a0a79d9ab122e43c63e6d74b93feba7dfd827ba87a2be65f82e52cd48"}
Sep 18 14:21:02.681029 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.680943    2578 scope.go:117] "RemoveContainer" containerID="cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e"
Sep 18 14:21:02.690100 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.690083    2578 scope.go:117] "RemoveContainer" containerID="5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e"
Sep 18 14:21:02.698214 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.698199    2578 scope.go:117] "RemoveContainer" containerID="cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e"
Sep 18 14:21:02.698478 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:21:02.698460    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e\": container with ID starting with cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e not found: ID does not exist" containerID="cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e"
Sep 18 14:21:02.698525 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.698486    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e"} err="failed to get container status \"cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e\": rpc error: code = NotFound desc = could not find container \"cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e\": container with ID starting with cc381eb8222da187a8f73e29645a26191c3058a7d961a84e29547932f02dc45e not found: ID does not exist"
Sep 18 14:21:02.698525 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.698504    2578 scope.go:117] "RemoveContainer" containerID="5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e"
Sep 18 14:21:02.698723 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:21:02.698703    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e\": container with ID starting with 5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e not found: ID does not exist" containerID="5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e"
Sep 18 14:21:02.698782 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.698730    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e"} err="failed to get container status \"5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e\": rpc error: code = NotFound desc = could not find container \"5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e\": container with ID starting with 5672e6cd1aad3c5d279623b4c9a2b8536e676112aca090d615b1a503f036576e not found: ID does not exist"
Sep 18 14:21:02.702846 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.702826    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"]
Sep 18 14:21:02.706915 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:02.706893    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e8d773-openshift-default-768b4ff9bb-7pdrs"]
Sep 18 14:21:03.850951 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:03.850918    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" path="/var/lib/kubelet/pods/398b447e-f97c-40b0-91a4-0a583ccc8a42/volumes"
Sep 18 14:21:07.790994 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:07.790966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:07.870838 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:07.870809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:07.939077 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:07.939031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:08.053570 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:08.053473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:08.144249 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:08.144218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:08.446827 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:08.441814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:08.541463 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:08.541427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:09.145416 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:09.145386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:09.842259 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:09.842211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:14.656513 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:14.656477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:14.726688 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:14.726651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:14.973188 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:14.973157    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"]
Sep 18 14:21:14.973453 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:14.973424    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy" containerID="cri-o://f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc" gracePeriod=30
Sep 18 14:21:15.017536 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:15.017508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:15.579011 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:15.578976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:16.355164 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:16.355132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:17.179450 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:17.179420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:17.960945 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:17.960911    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:20.229707 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.229683    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:21:20.317027 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.316946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-data\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317027 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317011    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-podinfo\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317055    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-credential-socket\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-certs\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317110    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-token\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317146    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-socket\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istiod-ca-cert\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317218 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-envoy\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9gl6\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-kube-api-access-b9gl6\") pod \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\" (UID: \"e0a02a5d-91ed-445e-8230-bebfeaef39a6\") "
Sep 18 14:21:20.317571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317267    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:20.317571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:20.317571 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317524    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:20.317810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317582    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.317810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317601    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.317810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317629    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:20.317810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.317694    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:20.319661 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.319625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:20.319804 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.319787    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-kube-api-access-b9gl6" (OuterVolumeSpecName: "kube-api-access-b9gl6") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "kube-api-access-b9gl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:20.319982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.319933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:21:20.319982 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.319935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0a02a5d-91ed-445e-8230-bebfeaef39a6" (UID: "e0a02a5d-91ed-445e-8230-bebfeaef39a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:20.418578 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.418538    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.418578 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.418571    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.418578 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.418580    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.418828 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.418588    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.418828 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.418598    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.418828 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.418631    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9gl6\" (UniqueName: \"kubernetes.io/projected/e0a02a5d-91ed-445e-8230-bebfeaef39a6-kube-api-access-b9gl6\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.418828 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.418640    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0a02a5d-91ed-445e-8230-bebfeaef39a6-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:20.767093 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.767060    2578 generic.go:356] "Generic (PLEG): container finished" podID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerID="f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc" exitCode=0
Sep 18 14:21:20.767271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.767112    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"
Sep 18 14:21:20.767271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.767146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" event={"ID":"e0a02a5d-91ed-445e-8230-bebfeaef39a6","Type":"ContainerDied","Data":"f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc"}
Sep 18 14:21:20.767271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.767213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz" event={"ID":"e0a02a5d-91ed-445e-8230-bebfeaef39a6","Type":"ContainerDied","Data":"6d12c24f07a9a782327d3cd39c50a6bcd90872511e5b623467bb0a6a1c9fb669"}
Sep 18 14:21:20.767271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.767243    2578 scope.go:117] "RemoveContainer" containerID="f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc"
Sep 18 14:21:20.776791 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.776774    2578 scope.go:117] "RemoveContainer" containerID="76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d"
Sep 18 14:21:20.784569 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.784554    2578 scope.go:117] "RemoveContainer" containerID="f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc"
Sep 18 14:21:20.784877 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:21:20.784857    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc\": container with ID starting with f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc not found: ID does not exist" containerID="f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc"
Sep 18 14:21:20.784919 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.784885    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc"} err="failed to get container status \"f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc\": rpc error: code = NotFound desc = could not find container \"f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc\": container with ID starting with f4992b652f9a2ef0ea96bd349019028bacdd133ca20f211a0513cb016cafa0cc not found: ID does not exist"
Sep 18 14:21:20.784919 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.784902    2578 scope.go:117] "RemoveContainer" containerID="76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d"
Sep 18 14:21:20.785155 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:21:20.785136    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d\": container with ID starting with 76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d not found: ID does not exist" containerID="76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d"
Sep 18 14:21:20.785196 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.785162    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d"} err="failed to get container status \"76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d\": rpc error: code = NotFound desc = could not find container \"76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d\": container with ID starting with 76d129b072c9809d425f0c73bf458bf5fcd2babe2f9aeff1498e8dc52af9af4d not found: ID does not exist"
Sep 18 14:21:20.794702 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.794681    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"]
Sep 18 14:21:20.798866 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:20.798843    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a035eb-openshift-default-f78d94968-j4wmz"]
Sep 18 14:21:21.850063 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:21.850030    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" path="/var/lib/kubelet/pods/e0a02a5d-91ed-445e-8230-bebfeaef39a6/volumes"
Sep 18 14:21:21.898319 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:21.898295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:25.976479 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:25.976434    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"]
Sep 18 14:21:25.976935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:25.976704    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz" podUID="4257cbb9-23f5-401f-8028-a0639db14471" containerName="maas-api" containerID="cri-o://e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e" gracePeriod=30
Sep 18 14:21:26.013055 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.013019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:26.089195 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.089165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:26.154491 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.154460    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:26.220025 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.220003    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:21:26.233767 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.233713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:26.277207 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.277178    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2m2f\" (UniqueName: \"kubernetes.io/projected/4257cbb9-23f5-401f-8028-a0639db14471-kube-api-access-t2m2f\") pod \"4257cbb9-23f5-401f-8028-a0639db14471\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") "
Sep 18 14:21:26.277361 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.277234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-metrics-certs\") pod \"4257cbb9-23f5-401f-8028-a0639db14471\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") "
Sep 18 14:21:26.277361 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.277272    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4257cbb9-23f5-401f-8028-a0639db14471-openshift-service-ca\") pod \"4257cbb9-23f5-401f-8028-a0639db14471\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") "
Sep 18 14:21:26.277474 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.277413    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-maas-api-tls\") pod \"4257cbb9-23f5-401f-8028-a0639db14471\" (UID: \"4257cbb9-23f5-401f-8028-a0639db14471\") "
Sep 18 14:21:26.277636 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.277589    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4257cbb9-23f5-401f-8028-a0639db14471-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4257cbb9-23f5-401f-8028-a0639db14471" (UID: "4257cbb9-23f5-401f-8028-a0639db14471"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:26.277751 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.277732    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4257cbb9-23f5-401f-8028-a0639db14471-openshift-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.279554 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.279528    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4257cbb9-23f5-401f-8028-a0639db14471-kube-api-access-t2m2f" (OuterVolumeSpecName: "kube-api-access-t2m2f") pod "4257cbb9-23f5-401f-8028-a0639db14471" (UID: "4257cbb9-23f5-401f-8028-a0639db14471"). InnerVolumeSpecName "kube-api-access-t2m2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:26.279652 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.279565    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4257cbb9-23f5-401f-8028-a0639db14471" (UID: "4257cbb9-23f5-401f-8028-a0639db14471"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:21:26.279698 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.279663    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4257cbb9-23f5-401f-8028-a0639db14471" (UID: "4257cbb9-23f5-401f-8028-a0639db14471"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:21:26.303803 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.303779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:26.379156 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.379126    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2m2f\" (UniqueName: \"kubernetes.io/projected/4257cbb9-23f5-401f-8028-a0639db14471-kube-api-access-t2m2f\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.379156 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.379156    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-metrics-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.379338 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.379165    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4257cbb9-23f5-401f-8028-a0639db14471-maas-api-tls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:26.605951 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.605869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:26.709725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.709688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:26.797289 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.797252    2578 generic.go:356] "Generic (PLEG): container finished" podID="4257cbb9-23f5-401f-8028-a0639db14471" containerID="e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e" exitCode=0
Sep 18 14:21:26.797436 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.797299    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"
Sep 18 14:21:26.797436 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.797336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz" event={"ID":"4257cbb9-23f5-401f-8028-a0639db14471","Type":"ContainerDied","Data":"e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e"}
Sep 18 14:21:26.797436 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.797388    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz" event={"ID":"4257cbb9-23f5-401f-8028-a0639db14471","Type":"ContainerDied","Data":"04750d7fbf41621b19293a64d5a0f12d05c83b6cddbe101b8add9f897a51be57"}
Sep 18 14:21:26.797436 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.797415    2578 scope.go:117] "RemoveContainer" containerID="e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e"
Sep 18 14:21:26.806636 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.806601    2578 scope.go:117] "RemoveContainer" containerID="e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e"
Sep 18 14:21:26.806900 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:21:26.806883    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e\": container with ID starting with e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e not found: ID does not exist" containerID="e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e"
Sep 18 14:21:26.806969 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.806906    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e"} err="failed to get container status \"e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e\": rpc error: code = NotFound desc = could not find container \"e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e\": container with ID starting with e11edc5c75191351663552fa751bdd0a43a0f4b3834442816c4920456693cd2e not found: ID does not exist"
Sep 18 14:21:26.818856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.818834    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"]
Sep 18 14:21:26.826271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:26.826245    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d25bfb-697446d78d-qpvqz"]
Sep 18 14:21:27.476398 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:27.476361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:27.850176 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:27.850099    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4257cbb9-23f5-401f-8028-a0639db14471" path="/var/lib/kubelet/pods/4257cbb9-23f5-401f-8028-a0639db14471/volumes"
Sep 18 14:21:32.945149 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:32.945066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:33.012935 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.012901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:33.203907 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.203825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:33.547331 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547248    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"]
Sep 18 14:21:33.547593 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547580    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy"
Sep 18 14:21:33.547668 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547595    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy"
Sep 18 14:21:33.547668 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547620    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy"
Sep 18 14:21:33.547668 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547629    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy"
Sep 18 14:21:33.547668 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547648    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a123511c-53ae-4f2a-a365-1b1e28deddec" containerName="maas-api"
Sep 18 14:21:33.547668 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547658    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a123511c-53ae-4f2a-a365-1b1e28deddec" containerName="maas-api"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547678    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547683    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547690    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4257cbb9-23f5-401f-8028-a0639db14471" containerName="maas-api"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547696    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4257cbb9-23f5-401f-8028-a0639db14471" containerName="maas-api"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547701    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547706    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547711    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019bdc20-0838-4ea7-8fc8-a69960429350" containerName="main"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547716    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="019bdc20-0838-4ea7-8fc8-a69960429350" containerName="main"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547768    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4257cbb9-23f5-401f-8028-a0639db14471" containerName="maas-api"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547777    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547782    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="019bdc20-0838-4ea7-8fc8-a69960429350" containerName="main"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547788    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547795    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="398b447e-f97c-40b0-91a4-0a583ccc8a42" containerName="istio-proxy"
Sep 18 14:21:33.547826 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.547800    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a123511c-53ae-4f2a-a365-1b1e28deddec" containerName="maas-api"
Sep 18 14:21:33.552051 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.552034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"
Sep 18 14:21:33.554962 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.554943    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 14:21:33.555055 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.554985    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7hhww\""
Sep 18 14:21:33.561355 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.561330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"]
Sep 18 14:21:33.641073 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.641043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b662a5-3128-4c6f-a038-48f99482ff9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2\" (UID: \"e9b662a5-3128-4c6f-a038-48f99482ff9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"
Sep 18 14:21:33.741992 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.741965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b662a5-3128-4c6f-a038-48f99482ff9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2\" (UID: \"e9b662a5-3128-4c6f-a038-48f99482ff9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"
Sep 18 14:21:33.742498 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.742481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b662a5-3128-4c6f-a038-48f99482ff9e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2\" (UID: \"e9b662a5-3128-4c6f-a038-48f99482ff9e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"
Sep 18 14:21:33.863145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:33.863084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"
Sep 18 14:21:34.138017 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:34.137993    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"]
Sep 18 14:21:34.140531 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:21:34.140504    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b662a5_3128_4c6f_a038_48f99482ff9e.slice/crio-68006d6825b8ec0f7f4915f1ff5e8e467b69536891d0a65d172ab61242c01848 WatchSource:0}: Error finding container 68006d6825b8ec0f7f4915f1ff5e8e467b69536891d0a65d172ab61242c01848: Status 404 returned error can't find the container with id 68006d6825b8ec0f7f4915f1ff5e8e467b69536891d0a65d172ab61242c01848
Sep 18 14:21:34.509273 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:34.509248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:34.834722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:34.834632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2" event={"ID":"e9b662a5-3128-4c6f-a038-48f99482ff9e","Type":"ContainerStarted","Data":"29ea4d7bb681abeeb0775e9703c8bb1e060567047f63920cb9a28915b4535e07"}
Sep 18 14:21:34.834722 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:34.834709    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2" event={"ID":"e9b662a5-3128-4c6f-a038-48f99482ff9e","Type":"ContainerStarted","Data":"68006d6825b8ec0f7f4915f1ff5e8e467b69536891d0a65d172ab61242c01848"}
Sep 18 14:21:34.851310 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:34.851268    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2" podStartSLOduration=1.851253139 podStartE2EDuration="1.851253139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:21:34.849419088 +0000 UTC m=+2243.541290683" watchObservedRunningTime="2026-09-18 14:21:34.851253139 +0000 UTC m=+2243.543124772"
Sep 18 14:21:35.194278 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:35.194238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:35.840945 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:35.840909    2578 generic.go:356] "Generic (PLEG): container finished" podID="e9b662a5-3128-4c6f-a038-48f99482ff9e" containerID="29ea4d7bb681abeeb0775e9703c8bb1e060567047f63920cb9a28915b4535e07" exitCode=0
Sep 18 14:21:35.841139 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:35.840954    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2" event={"ID":"e9b662a5-3128-4c6f-a038-48f99482ff9e","Type":"ContainerDied","Data":"29ea4d7bb681abeeb0775e9703c8bb1e060567047f63920cb9a28915b4535e07"}
Sep 18 14:21:36.970221 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:36.970194    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"
Sep 18 14:21:37.070750 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:37.070718    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b662a5-3128-4c6f-a038-48f99482ff9e-maas-api-service-ca\") pod \"e9b662a5-3128-4c6f-a038-48f99482ff9e\" (UID: \"e9b662a5-3128-4c6f-a038-48f99482ff9e\") "
Sep 18 14:21:37.071067 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:37.071042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9b662a5-3128-4c6f-a038-48f99482ff9e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9b662a5-3128-4c6f-a038-48f99482ff9e" (UID: "e9b662a5-3128-4c6f-a038-48f99482ff9e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:37.171690 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:37.171590    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b662a5-3128-4c6f-a038-48f99482ff9e-maas-api-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:37.851016 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:37.850980    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"
Sep 18 14:21:37.851016 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:37.850994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2" event={"ID":"e9b662a5-3128-4c6f-a038-48f99482ff9e","Type":"ContainerDied","Data":"68006d6825b8ec0f7f4915f1ff5e8e467b69536891d0a65d172ab61242c01848"}
Sep 18 14:21:37.851230 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:37.851040    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68006d6825b8ec0f7f4915f1ff5e8e467b69536891d0a65d172ab61242c01848"
Sep 18 14:21:44.081073 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.081030    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"]
Sep 18 14:21:44.088184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.088144    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d634d2-29829015-nghg7"]
Sep 18 14:21:44.097146 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.097122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:44.192836 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.192795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:44.291178 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.291148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:44.364066 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.363991    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"]
Sep 18 14:21:44.368399 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.368376    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-d634d2-dm9s2"]
Sep 18 14:21:44.368568 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.368504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:44.764373 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.764336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:44.855902 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:44.855870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:45.850573 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:45.850538    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de0879e6-4875-42e6-81d0-c8fdc2bb41e3" path="/var/lib/kubelet/pods/de0879e6-4875-42e6-81d0-c8fdc2bb41e3/volumes"
Sep 18 14:21:45.850969 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:45.850883    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b662a5-3128-4c6f-a038-48f99482ff9e" path="/var/lib/kubelet/pods/e9b662a5-3128-4c6f-a038-48f99482ff9e/volumes"
Sep 18 14:21:50.896875 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:50.896837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:50.996872 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:50.996839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:51.144515 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:51.144483    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"]
Sep 18 14:21:51.144845 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:51.144785    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy" containerID="cri-o://811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717" gracePeriod=30
Sep 18 14:21:51.170243 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:51.170183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:21:56.384215 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.384187    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:21:56.429107 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-socket\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429107 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429070    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-token\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429332 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-certs\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429332 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429162    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-podinfo\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429332 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429188    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-credential-socket\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429492 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429332    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:56.429492 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429386    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjkcm\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-kube-api-access-gjkcm\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429492 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429425    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:56.429492 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429447    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-data\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429492 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:56.429492 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-envoy\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429545    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a84b12a-89ba-4ec4-98b5-48558481e52a-istiod-ca-cert\") pod \"3a84b12a-89ba-4ec4-98b5-48558481e52a\" (UID: \"3a84b12a-89ba-4ec4-98b5-48558481e52a\") "
Sep 18 14:21:56.429810 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429651    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:56.429991 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429824    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.429991 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429845    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-credential-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.429991 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429860    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-data\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.429991 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429874    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-workload-socket\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.429991 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.429934    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a84b12a-89ba-4ec4-98b5-48558481e52a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:21:56.431682 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.431657    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:56.431797 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.431723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-kube-api-access-gjkcm" (OuterVolumeSpecName: "kube-api-access-gjkcm") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "kube-api-access-gjkcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:21:56.432158 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.432137    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:21:56.432204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.432138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a84b12a-89ba-4ec4-98b5-48558481e52a" (UID: "3a84b12a-89ba-4ec4-98b5-48558481e52a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 14:21:56.531236 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.531196    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjkcm\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-kube-api-access-gjkcm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.531236 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.531230    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-envoy\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.531236 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.531242    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a84b12a-89ba-4ec4-98b5-48558481e52a-istiod-ca-cert\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.531489 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.531253    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-token\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.531489 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.531264    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a84b12a-89ba-4ec4-98b5-48558481e52a-istio-podinfo\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:21:56.937585 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.937550    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerID="811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717" exitCode=0
Sep 18 14:21:56.937792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.937629    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"
Sep 18 14:21:56.937792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.937654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" event={"ID":"3a84b12a-89ba-4ec4-98b5-48558481e52a","Type":"ContainerDied","Data":"811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717"}
Sep 18 14:21:56.937792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.937713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x" event={"ID":"3a84b12a-89ba-4ec4-98b5-48558481e52a","Type":"ContainerDied","Data":"a03e00ca116791d0653f23382ac288f417cbdca3562c52cef456b60cffe9e291"}
Sep 18 14:21:56.937792 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.937736    2578 scope.go:117] "RemoveContainer" containerID="811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717"
Sep 18 14:21:56.947088 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.947070    2578 scope.go:117] "RemoveContainer" containerID="ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303"
Sep 18 14:21:56.954822 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.954803    2578 scope.go:117] "RemoveContainer" containerID="811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717"
Sep 18 14:21:56.955079 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:21:56.955059    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717\": container with ID starting with 811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717 not found: ID does not exist" containerID="811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717"
Sep 18 14:21:56.955135 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.955086    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717"} err="failed to get container status \"811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717\": rpc error: code = NotFound desc = could not find container \"811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717\": container with ID starting with 811448900ff01d098b8fe1590bac7f0be94dc1eb3c063bc08b3ac31374b71717 not found: ID does not exist"
Sep 18 14:21:56.955135 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.955104    2578 scope.go:117] "RemoveContainer" containerID="ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303"
Sep 18 14:21:56.955327 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:21:56.955313    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303\": container with ID starting with ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303 not found: ID does not exist" containerID="ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303"
Sep 18 14:21:56.955382 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.955337    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303"} err="failed to get container status \"ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303\": rpc error: code = NotFound desc = could not find container \"ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303\": container with ID starting with ad81704b2958b623562bb5c2628b37348aee7b6b4c55dbd04111bb9cdb368303 not found: ID does not exist"
Sep 18 14:21:56.959675 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.959653    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"]
Sep 18 14:21:56.963953 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:56.963932    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-d634d2-openshift-default-79d56fdcbd-lmb4x"]
Sep 18 14:21:57.850039 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:21:57.850009    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" path="/var/lib/kubelet/pods/3a84b12a-89ba-4ec4-98b5-48558481e52a/volumes"
Sep 18 14:22:12.218812 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:22:12.218779    2578 scope.go:117] "RemoveContainer" containerID="41cad1ee7cef834a5196a645fb0c14a6939994ef283b12e2ffd04adc7c11dbb7"
Sep 18 14:22:41.601907 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:22:41.601862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:23:06.441543 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:23:06.441450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:23:06.499805 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:23:06.499773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:23:17.386667 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:23:17.386628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:23:19.192591 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:23:19.192558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:25:00.695644 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:25:00.695537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:25:43.127745 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:25:43.127702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:25:43.229422 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:25:43.229380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:26:14.251488 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:26:14.251447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:26:26.666934 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:26:26.666897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:26:26.725506 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:26:26.725474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:27:05.576527 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.576485    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"]
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.576959    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.576978    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577005    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577015    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577041    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b662a5-3128-4c6f-a038-48f99482ff9e" containerName="revoke-keys"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577050    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b662a5-3128-4c6f-a038-48f99482ff9e" containerName="revoke-keys"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577131    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b662a5-3128-4c6f-a038-48f99482ff9e" containerName="revoke-keys"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577145    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577154    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a02a5d-91ed-445e-8230-bebfeaef39a6" containerName="istio-proxy"
Sep 18 14:27:05.577184 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.577163    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a84b12a-89ba-4ec4-98b5-48558481e52a" containerName="istio-proxy"
Sep 18 14:27:05.580114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.580095    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.582992 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.582973    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c74b0e62-kserve-self-signed-certs\""
Sep 18 14:27:05.589997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.589965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"]
Sep 18 14:27:05.617325 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.617282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:27:05.733016 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.732861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-home\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.733016 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.732908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-model-cache\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.733016 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.732937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m62d\" (UniqueName: \"kubernetes.io/projected/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-kube-api-access-2m62d\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.733359 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.733039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tls-certs\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.733359 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.733127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-dshm\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.733359 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.733177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tmp-dir\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tls-certs\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-dshm\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834204 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tmp-dir\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834475 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-home\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834475 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-model-cache\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834475 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m62d\" (UniqueName: \"kubernetes.io/projected/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-kube-api-access-2m62d\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834766 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tmp-dir\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-home\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.834860 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.834794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-model-cache\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.836806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.836789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-dshm\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.836872 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.836854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tls-certs\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.843538 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.843513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m62d\" (UniqueName: \"kubernetes.io/projected/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-kube-api-access-2m62d\") pod \"e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") " pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:05.890251 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:05.890224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:06.161431 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:06.161406    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"]
Sep 18 14:27:06.163699 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:27:06.163669    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8ae9301_9f4c_48ec_abf2_f76f4e56bec2.slice/crio-cdd9e2c7ae703dd6865b1a4242fdeaa4b21459b4d3e99523735c6fe4c7daf89b WatchSource:0}: Error finding container cdd9e2c7ae703dd6865b1a4242fdeaa4b21459b4d3e99523735c6fe4c7daf89b: Status 404 returned error can't find the container with id cdd9e2c7ae703dd6865b1a4242fdeaa4b21459b4d3e99523735c6fe4c7daf89b
Sep 18 14:27:06.298088 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:06.298041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k" event={"ID":"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2","Type":"ContainerStarted","Data":"fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653"}
Sep 18 14:27:06.298088 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:06.298093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k" event={"ID":"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2","Type":"ContainerStarted","Data":"cdd9e2c7ae703dd6865b1a4242fdeaa4b21459b4d3e99523735c6fe4c7daf89b"}
Sep 18 14:27:06.316086 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:06.316037    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k" podStartSLOduration=1.316018094 podStartE2EDuration="1.316018094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:27:06.315133369 +0000 UTC m=+2575.007004967" watchObservedRunningTime="2026-09-18 14:27:06.316018094 +0000 UTC m=+2575.007889689"
Sep 18 14:27:09.560276 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.560232    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"]
Sep 18 14:27:09.563582 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.563560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.566398 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.566379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c74b0e62-kserve-self-signed-certs\""
Sep 18 14:27:09.575006 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.574982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"]
Sep 18 14:27:09.595865 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.595831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:27:09.669370 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.669333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-home\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.669370 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.669374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9nn\" (UniqueName: \"kubernetes.io/projected/1bc9bc37-35cd-44ab-8d76-f58baac18861-kube-api-access-2h9nn\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.669633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.669393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-dshm\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.669633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.669416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-tmp-dir\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.669633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.669471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-model-cache\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.669633 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.669499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9bc37-35cd-44ab-8d76-f58baac18861-tls-certs\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.770539 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.770506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-tmp-dir\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.770741 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.770558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-model-cache\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.770741 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.770588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9bc37-35cd-44ab-8d76-f58baac18861-tls-certs\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.770741 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.770653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-home\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.770911 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.770778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9nn\" (UniqueName: \"kubernetes.io/projected/1bc9bc37-35cd-44ab-8d76-f58baac18861-kube-api-access-2h9nn\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.770911 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.770819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-dshm\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.771042 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.770999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-tmp-dir\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.771121 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.771050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-model-cache\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.771121 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.771076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-home\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.773168 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.773145    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-dshm\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.773291 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.773273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9bc37-35cd-44ab-8d76-f58baac18861-tls-certs\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.779193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.779168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9nn\" (UniqueName: \"kubernetes.io/projected/1bc9bc37-35cd-44ab-8d76-f58baac18861-kube-api-access-2h9nn\") pod \"e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") " pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:09.875773 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:09.875684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:10.149768 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:10.149695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"]
Sep 18 14:27:10.153198 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:27:10.153162    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bc9bc37_35cd_44ab_8d76_f58baac18861.slice/crio-3bf728fde3c8cbb10cdb99490a65b743a9ab538ed76b6ebd60d9cdb23a8b0fdb WatchSource:0}: Error finding container 3bf728fde3c8cbb10cdb99490a65b743a9ab538ed76b6ebd60d9cdb23a8b0fdb: Status 404 returned error can't find the container with id 3bf728fde3c8cbb10cdb99490a65b743a9ab538ed76b6ebd60d9cdb23a8b0fdb
Sep 18 14:27:10.316654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:10.316597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx" event={"ID":"1bc9bc37-35cd-44ab-8d76-f58baac18861","Type":"ContainerStarted","Data":"1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f"}
Sep 18 14:27:10.316654 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:10.316661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx" event={"ID":"1bc9bc37-35cd-44ab-8d76-f58baac18861","Type":"ContainerStarted","Data":"3bf728fde3c8cbb10cdb99490a65b743a9ab538ed76b6ebd60d9cdb23a8b0fdb"}
Sep 18 14:27:10.334999 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:10.334959    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx" podStartSLOduration=1.334944004 podStartE2EDuration="1.334944004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:27:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:27:10.333012045 +0000 UTC m=+2579.024883823" watchObservedRunningTime="2026-09-18 14:27:10.334944004 +0000 UTC m=+2579.026815598"
Sep 18 14:27:15.891262 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:15.891232    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:15.891262 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:15.891268    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:15.903673 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:15.903651    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:16.354285 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:16.354251    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:19.876109 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:19.876080    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:19.876489 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:19.876122    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:19.888524 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:19.888493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:20.371187 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:20.371162    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:28.806497 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:28.806462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:27:41.944487 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:41.944386    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"]
Sep 18 14:27:41.971665 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:41.971634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:27:43.692640 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:43.692589    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"]
Sep 18 14:27:43.714725 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:43.714700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:27:56.964092 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:56.964045    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k" podUID="e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" containerName="main" containerID="cri-o://fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653" gracePeriod=45
Sep 18 14:27:57.206424 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.206393    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:57.332681 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.332585    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-dshm\") pod \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") "
Sep 18 14:27:57.332681 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.332644    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tmp-dir\") pod \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") "
Sep 18 14:27:57.332681 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.332681    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tls-certs\") pod \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") "
Sep 18 14:27:57.332920 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.332762    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-model-cache\") pod \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") "
Sep 18 14:27:57.332920 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.332781    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-home\") pod \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") "
Sep 18 14:27:57.332920 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.332798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m62d\" (UniqueName: \"kubernetes.io/projected/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-kube-api-access-2m62d\") pod \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\" (UID: \"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2\") "
Sep 18 14:27:57.333088 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.332939    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" (UID: "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:57.333088 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.333020    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-home" (OuterVolumeSpecName: "home") pod "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" (UID: "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:57.333088 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.333035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-model-cache" (OuterVolumeSpecName: "model-cache") pod "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" (UID: "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:57.333255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.333098    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:57.333255 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.333117    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:57.335141 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.335110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-kube-api-access-2m62d" (OuterVolumeSpecName: "kube-api-access-2m62d") pod "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" (UID: "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2"). InnerVolumeSpecName "kube-api-access-2m62d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:27:57.335141 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.335133    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-dshm" (OuterVolumeSpecName: "dshm") pod "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" (UID: "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:57.335335 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.335194    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" (UID: "e8ae9301-9f4c-48ec-abf2-f76f4e56bec2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:27:57.434458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.434428    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:57.434458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.434452    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:57.434458 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.434462    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m62d\" (UniqueName: \"kubernetes.io/projected/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-kube-api-access-2m62d\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:57.434726 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.434471    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:57.532689 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.532660    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" containerID="fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653" exitCode=0
Sep 18 14:27:57.532873 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.532707    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"
Sep 18 14:27:57.532873 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.532723    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k" event={"ID":"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2","Type":"ContainerDied","Data":"fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653"}
Sep 18 14:27:57.532873 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.532756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k" event={"ID":"e8ae9301-9f4c-48ec-abf2-f76f4e56bec2","Type":"ContainerDied","Data":"cdd9e2c7ae703dd6865b1a4242fdeaa4b21459b4d3e99523735c6fe4c7daf89b"}
Sep 18 14:27:57.532873 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.532773    2578 scope.go:117] "RemoveContainer" containerID="fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653"
Sep 18 14:27:57.542003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.541965    2578 scope.go:117] "RemoveContainer" containerID="fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653"
Sep 18 14:27:57.542269 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:27:57.542251    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653\": container with ID starting with fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653 not found: ID does not exist" containerID="fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653"
Sep 18 14:27:57.542316 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.542277    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653"} err="failed to get container status \"fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653\": rpc error: code = NotFound desc = could not find container \"fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653\": container with ID starting with fe4347ac708a47b9ba448f00056dbcbe6948ae91c6bc8b86feb9fd4fd6d05653 not found: ID does not exist"
Sep 18 14:27:57.555119 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.555096    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"]
Sep 18 14:27:57.559193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.559173    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c74b0e62-kserve-65cc856779-h787k"]
Sep 18 14:27:57.850698 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:57.850664    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" path="/var/lib/kubelet/pods/e8ae9301-9f4c-48ec-abf2-f76f4e56bec2/volumes"
Sep 18 14:27:58.711926 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:58.711887    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx" podUID="1bc9bc37-35cd-44ab-8d76-f58baac18861" containerName="main" containerID="cri-o://1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f" gracePeriod=45
Sep 18 14:27:58.965265 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:58.965208    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:59.049097 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049066    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9bc37-35cd-44ab-8d76-f58baac18861-tls-certs\") pod \"1bc9bc37-35cd-44ab-8d76-f58baac18861\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") "
Sep 18 14:27:59.049286 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-home\") pod \"1bc9bc37-35cd-44ab-8d76-f58baac18861\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") "
Sep 18 14:27:59.049286 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049135    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-tmp-dir\") pod \"1bc9bc37-35cd-44ab-8d76-f58baac18861\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") "
Sep 18 14:27:59.049286 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h9nn\" (UniqueName: \"kubernetes.io/projected/1bc9bc37-35cd-44ab-8d76-f58baac18861-kube-api-access-2h9nn\") pod \"1bc9bc37-35cd-44ab-8d76-f58baac18861\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") "
Sep 18 14:27:59.049286 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049193    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-dshm\") pod \"1bc9bc37-35cd-44ab-8d76-f58baac18861\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") "
Sep 18 14:27:59.049286 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049281    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-model-cache\") pod \"1bc9bc37-35cd-44ab-8d76-f58baac18861\" (UID: \"1bc9bc37-35cd-44ab-8d76-f58baac18861\") "
Sep 18 14:27:59.049585 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049410    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-home" (OuterVolumeSpecName: "home") pod "1bc9bc37-35cd-44ab-8d76-f58baac18861" (UID: "1bc9bc37-35cd-44ab-8d76-f58baac18861"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:59.049585 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049451    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1bc9bc37-35cd-44ab-8d76-f58baac18861" (UID: "1bc9bc37-35cd-44ab-8d76-f58baac18861"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:59.049585 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049543    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-home\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:59.049585 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049555    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-tmp-dir\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:59.049823 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.049675    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-model-cache" (OuterVolumeSpecName: "model-cache") pod "1bc9bc37-35cd-44ab-8d76-f58baac18861" (UID: "1bc9bc37-35cd-44ab-8d76-f58baac18861"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:59.051537 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.051511    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bc9bc37-35cd-44ab-8d76-f58baac18861-kube-api-access-2h9nn" (OuterVolumeSpecName: "kube-api-access-2h9nn") pod "1bc9bc37-35cd-44ab-8d76-f58baac18861" (UID: "1bc9bc37-35cd-44ab-8d76-f58baac18861"). InnerVolumeSpecName "kube-api-access-2h9nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:27:59.051649 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.051564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-dshm" (OuterVolumeSpecName: "dshm") pod "1bc9bc37-35cd-44ab-8d76-f58baac18861" (UID: "1bc9bc37-35cd-44ab-8d76-f58baac18861"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 14:27:59.051649 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.051636    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bc9bc37-35cd-44ab-8d76-f58baac18861-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1bc9bc37-35cd-44ab-8d76-f58baac18861" (UID: "1bc9bc37-35cd-44ab-8d76-f58baac18861"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:27:59.150101 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.150069    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-dshm\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:59.150101 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.150098    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9bc37-35cd-44ab-8d76-f58baac18861-model-cache\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:59.150101 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.150106    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9bc37-35cd-44ab-8d76-f58baac18861-tls-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:59.150329 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.150114    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h9nn\" (UniqueName: \"kubernetes.io/projected/1bc9bc37-35cd-44ab-8d76-f58baac18861-kube-api-access-2h9nn\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:27:59.544445 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.544414    2578 generic.go:356] "Generic (PLEG): container finished" podID="1bc9bc37-35cd-44ab-8d76-f58baac18861" containerID="1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f" exitCode=0
Sep 18 14:27:59.544649 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.544462    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"
Sep 18 14:27:59.544649 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.544508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx" event={"ID":"1bc9bc37-35cd-44ab-8d76-f58baac18861","Type":"ContainerDied","Data":"1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f"}
Sep 18 14:27:59.544649 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.544557    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx" event={"ID":"1bc9bc37-35cd-44ab-8d76-f58baac18861","Type":"ContainerDied","Data":"3bf728fde3c8cbb10cdb99490a65b743a9ab538ed76b6ebd60d9cdb23a8b0fdb"}
Sep 18 14:27:59.544649 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.544583    2578 scope.go:117] "RemoveContainer" containerID="1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f"
Sep 18 14:27:59.553742 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.553724    2578 scope.go:117] "RemoveContainer" containerID="1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f"
Sep 18 14:27:59.554023 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:27:59.554007    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f\": container with ID starting with 1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f not found: ID does not exist" containerID="1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f"
Sep 18 14:27:59.554065 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.554032    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f"} err="failed to get container status \"1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f\": rpc error: code = NotFound desc = could not find container \"1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f\": container with ID starting with 1797f6f8a4a7d07b7aada91b26ec96f4947c566861de851a92506c4d6acb0b5f not found: ID does not exist"
Sep 18 14:27:59.566763 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.566732    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"]
Sep 18 14:27:59.569156 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.569130    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c74b0e62-kserve-7dd4d87599-9qchx"]
Sep 18 14:27:59.850424 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.850343    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bc9bc37-35cd-44ab-8d76-f58baac18861" path="/var/lib/kubelet/pods/1bc9bc37-35cd-44ab-8d76-f58baac18861/volumes"
Sep 18 14:27:59.982332 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.982298    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"]
Sep 18 14:27:59.982646 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.982632    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc9bc37-35cd-44ab-8d76-f58baac18861" containerName="main"
Sep 18 14:27:59.982646 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.982648    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc9bc37-35cd-44ab-8d76-f58baac18861" containerName="main"
Sep 18 14:27:59.982731 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.982663    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" containerName="main"
Sep 18 14:27:59.982731 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.982673    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" containerName="main"
Sep 18 14:27:59.982794 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.982741    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc9bc37-35cd-44ab-8d76-f58baac18861" containerName="main"
Sep 18 14:27:59.982794 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.982751    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ae9301-9f4c-48ec-abf2-f76f4e56bec2" containerName="main"
Sep 18 14:27:59.987031 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.987010    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:27:59.990175 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.990156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5jwtb\""
Sep 18 14:27:59.990302 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.990194    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 14:27:59.991287 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.991257    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 14:27:59.991417 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.991317    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 14:27:59.991480 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.991415    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 14:27:59.995188 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:27:59.995171    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"]
Sep 18 14:28:00.057845 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.057816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-maas-api-tls\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.058003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.057851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-metrics-certs\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.058003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.057943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-openshift-service-ca\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.058003 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.057996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5jv\" (UniqueName: \"kubernetes.io/projected/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-kube-api-access-lp5jv\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.158639 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.158541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5jv\" (UniqueName: \"kubernetes.io/projected/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-kube-api-access-lp5jv\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.158639 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.158587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-maas-api-tls\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.158639 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.158634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-metrics-certs\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.158841 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.158704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-openshift-service-ca\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.159423 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.159333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-openshift-service-ca\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.161193 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.161163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-metrics-certs\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.161268 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.161237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-maas-api-tls\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.167109 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.167091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5jv\" (UniqueName: \"kubernetes.io/projected/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-kube-api-access-lp5jv\") pod \"maas-api-5fc7cc57dd-wwpr9\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") " pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.298525 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.298496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:00.574932 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.574845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"]
Sep 18 14:28:00.577104 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:28:00.577075    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1077739d_b1f7_4cbb_9e29_fb403b8f83e7.slice/crio-71301a842a0a102c3852f5d41ca29b7ae142dcd2549ebecf98a172b5d6e3a40d WatchSource:0}: Error finding container 71301a842a0a102c3852f5d41ca29b7ae142dcd2549ebecf98a172b5d6e3a40d: Status 404 returned error can't find the container with id 71301a842a0a102c3852f5d41ca29b7ae142dcd2549ebecf98a172b5d6e3a40d
Sep 18 14:28:00.578401 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:00.578382    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 14:28:01.556114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:01.556021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9" event={"ID":"1077739d-b1f7-4cbb-9e29-fb403b8f83e7","Type":"ContainerStarted","Data":"8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89"}
Sep 18 14:28:01.556114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:01.556084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9" event={"ID":"1077739d-b1f7-4cbb-9e29-fb403b8f83e7","Type":"ContainerStarted","Data":"71301a842a0a102c3852f5d41ca29b7ae142dcd2549ebecf98a172b5d6e3a40d"}
Sep 18 14:28:01.556496 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:01.556116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:01.600802 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:01.600750    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9" podStartSLOduration=1.980969253 podStartE2EDuration="2.600734217s" totalImagesPullingTime="619.764964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:28:01.59506929 +0000 UTC m=+2630.286940884" watchObservedRunningTime="2026-09-18 14:28:01.600734217 +0000 UTC m=+2630.292605819"
Sep 18 14:28:07.566540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:07.566507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:07.935430 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:07.935394    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"]
Sep 18 14:28:07.938838 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:07.938819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:07.951579 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:07.951545    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"]
Sep 18 14:28:08.027942 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.027906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b2933-3ecc-4a5c-b546-acd741903f9e-openshift-service-ca\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.027942 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.027947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a8b2933-3ecc-4a5c-b546-acd741903f9e-metrics-certs\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.028162 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.027976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a8b2933-3ecc-4a5c-b546-acd741903f9e-maas-api-tls\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.028162 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.028040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2phgw\" (UniqueName: \"kubernetes.io/projected/3a8b2933-3ecc-4a5c-b546-acd741903f9e-kube-api-access-2phgw\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.128904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.128862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a8b2933-3ecc-4a5c-b546-acd741903f9e-maas-api-tls\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.128904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.128905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2phgw\" (UniqueName: \"kubernetes.io/projected/3a8b2933-3ecc-4a5c-b546-acd741903f9e-kube-api-access-2phgw\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.129138 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.128968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b2933-3ecc-4a5c-b546-acd741903f9e-openshift-service-ca\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.129138 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.128984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a8b2933-3ecc-4a5c-b546-acd741903f9e-metrics-certs\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.129656 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.129601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a8b2933-3ecc-4a5c-b546-acd741903f9e-openshift-service-ca\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.131683 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.131660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a8b2933-3ecc-4a5c-b546-acd741903f9e-maas-api-tls\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.131683 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.131681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a8b2933-3ecc-4a5c-b546-acd741903f9e-metrics-certs\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.137430 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.137408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2phgw\" (UniqueName: \"kubernetes.io/projected/3a8b2933-3ecc-4a5c-b546-acd741903f9e-kube-api-access-2phgw\") pod \"maas-api-74bfccbffb-x5ldt\" (UID: \"3a8b2933-3ecc-4a5c-b546-acd741903f9e\") " pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.249667 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.249537    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:08.524075 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.524020    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"]
Sep 18 14:28:08.526401 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:28:08.526365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8b2933_3ecc_4a5c_b546_acd741903f9e.slice/crio-2f4ba58ac41e4c1bf641ce9b7f3f6c372d156063d40c197e12bc2a7c7f335c60 WatchSource:0}: Error finding container 2f4ba58ac41e4c1bf641ce9b7f3f6c372d156063d40c197e12bc2a7c7f335c60: Status 404 returned error can't find the container with id 2f4ba58ac41e4c1bf641ce9b7f3f6c372d156063d40c197e12bc2a7c7f335c60
Sep 18 14:28:08.590157 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:08.590122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt" event={"ID":"3a8b2933-3ecc-4a5c-b546-acd741903f9e","Type":"ContainerStarted","Data":"2f4ba58ac41e4c1bf641ce9b7f3f6c372d156063d40c197e12bc2a7c7f335c60"}
Sep 18 14:28:09.596858 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:09.596818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt" event={"ID":"3a8b2933-3ecc-4a5c-b546-acd741903f9e","Type":"ContainerStarted","Data":"e9c41fe2c7422fd58c63703d68aa1060b7991310686a462dd520fab3d6ed5b2f"}
Sep 18 14:28:09.597261 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:09.596939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:12.282482 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:12.282447    2578 scope.go:117] "RemoveContainer" containerID="29ea4d7bb681abeeb0775e9703c8bb1e060567047f63920cb9a28915b4535e07"
Sep 18 14:28:15.607103 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.607073    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt"
Sep 18 14:28:15.627465 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.627419    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-74bfccbffb-x5ldt" podStartSLOduration=8.331594604 podStartE2EDuration="8.627405054s" totalImagesPullingTime="295.81045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 14:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:28:09.616096708 +0000 UTC m=+2638.307968304" watchObservedRunningTime="2026-09-18 14:28:15.627405054 +0000 UTC m=+2644.319276649"
Sep 18 14:28:15.656477 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.656447    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"]
Sep 18 14:28:15.656686 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.656662    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9" podUID="1077739d-b1f7-4cbb-9e29-fb403b8f83e7" containerName="maas-api" containerID="cri-o://8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89" gracePeriod=30
Sep 18 14:28:15.897145 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.897118    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:15.998958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.998926    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-maas-api-tls\") pod \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") "
Sep 18 14:28:15.999095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.998965    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-openshift-service-ca\") pod \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") "
Sep 18 14:28:15.999095 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.999075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-metrics-certs\") pod \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") "
Sep 18 14:28:15.999209 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.999125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp5jv\" (UniqueName: \"kubernetes.io/projected/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-kube-api-access-lp5jv\") pod \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\" (UID: \"1077739d-b1f7-4cbb-9e29-fb403b8f83e7\") "
Sep 18 14:28:15.999444 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:15.999413    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1077739d-b1f7-4cbb-9e29-fb403b8f83e7" (UID: "1077739d-b1f7-4cbb-9e29-fb403b8f83e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 14:28:16.001308 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.001284    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-kube-api-access-lp5jv" (OuterVolumeSpecName: "kube-api-access-lp5jv") pod "1077739d-b1f7-4cbb-9e29-fb403b8f83e7" (UID: "1077739d-b1f7-4cbb-9e29-fb403b8f83e7"). InnerVolumeSpecName "kube-api-access-lp5jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 14:28:16.001395 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.001344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1077739d-b1f7-4cbb-9e29-fb403b8f83e7" (UID: "1077739d-b1f7-4cbb-9e29-fb403b8f83e7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:28:16.001395 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.001355    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1077739d-b1f7-4cbb-9e29-fb403b8f83e7" (UID: "1077739d-b1f7-4cbb-9e29-fb403b8f83e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 14:28:16.099949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.099908    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-metrics-certs\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:28:16.099949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.099945    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp5jv\" (UniqueName: \"kubernetes.io/projected/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-kube-api-access-lp5jv\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:28:16.099949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.099956    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-maas-api-tls\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:28:16.099949 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.099966    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1077739d-b1f7-4cbb-9e29-fb403b8f83e7-openshift-service-ca\") on node \"ip-10-0-132-244.ec2.internal\" DevicePath \"\""
Sep 18 14:28:16.629392 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.629359    2578 generic.go:356] "Generic (PLEG): container finished" podID="1077739d-b1f7-4cbb-9e29-fb403b8f83e7" containerID="8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89" exitCode=0
Sep 18 14:28:16.629833 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.629408    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"
Sep 18 14:28:16.629833 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.629407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9" event={"ID":"1077739d-b1f7-4cbb-9e29-fb403b8f83e7","Type":"ContainerDied","Data":"8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89"}
Sep 18 14:28:16.629833 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.629545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9" event={"ID":"1077739d-b1f7-4cbb-9e29-fb403b8f83e7","Type":"ContainerDied","Data":"71301a842a0a102c3852f5d41ca29b7ae142dcd2549ebecf98a172b5d6e3a40d"}
Sep 18 14:28:16.629833 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.629577    2578 scope.go:117] "RemoveContainer" containerID="8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89"
Sep 18 14:28:16.639171 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.639154    2578 scope.go:117] "RemoveContainer" containerID="8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89"
Sep 18 14:28:16.639459 ip-10-0-132-244 kubenswrapper[2578]: E0918 14:28:16.639441    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89\": container with ID starting with 8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89 not found: ID does not exist" containerID="8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89"
Sep 18 14:28:16.639510 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.639468    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89"} err="failed to get container status \"8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89\": rpc error: code = NotFound desc = could not find container \"8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89\": container with ID starting with 8e8f3a0c433d86cad45d02db228814af046d3f893741d8df8a84f023ad005c89 not found: ID does not exist"
Sep 18 14:28:16.652312 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.652281    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"]
Sep 18 14:28:16.657012 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:16.656990    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fc7cc57dd-wwpr9"]
Sep 18 14:28:17.850997 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:17.850962    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1077739d-b1f7-4cbb-9e29-fb403b8f83e7" path="/var/lib/kubelet/pods/1077739d-b1f7-4cbb-9e29-fb403b8f83e7/volumes"
Sep 18 14:28:29.507450 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:29.507416    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-96dcb6468-7lxjk_d683e3ab-6d59-49da-a897-28cf01bd9b66/authorino/0.log"
Sep 18 14:28:35.070195 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:35.070164    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5klnx_d77a8b92-6a16-4f5f-9027-1c8187486761/server/0.log"
Sep 18 14:28:35.294264 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:35.294240    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-drz9c_ae4dda9d-a5b5-4a75-9e45-746ca1a181c3/copy-manifests/0.log"
Sep 18 14:28:35.301007 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:35.300984    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-drz9c_ae4dda9d-a5b5-4a75-9e45-746ca1a181c3/manager/0.log"
Sep 18 14:28:35.974387 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:35.974359    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-74bfccbffb-x5ldt_3a8b2933-3ecc-4a5c-b546-acd741903f9e/maas-api/0.log"
Sep 18 14:28:37.032675 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:37.032646    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-96dcb6468-7lxjk_d683e3ab-6d59-49da-a897-28cf01bd9b66/authorino/0.log"
Sep 18 14:28:38.113132 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:38.113098    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6_d70fdf34-3709-460c-9560-831da7dd8618/istio-proxy/0.log"
Sep 18 14:28:38.358114 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:38.358071    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-849fd8447d-jw84c_6fb32a63-e36a-42cb-b277-cbaaa765efbe/kube-auth-proxy/0.log"
Sep 18 14:28:40.461699 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:40.461659    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pftrv_5b16d1fd-fd34-45c1-90b0-cfb10d8358f6/main/0.log"
Sep 18 14:28:40.681115 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:40.681087    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxj642_ec264359-94c3-4667-8331-a41e987d2aa6/main/0.log"
Sep 18 14:28:41.071712 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:41.071686    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-4rchf_6e50c500-1652-4ce1-a23c-92c72c6898f2/main/0.log"
Sep 18 14:28:46.220104 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:46.220073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:28:46.312151 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:46.312123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log" limit=1024
Sep 18 14:28:49.219710 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:49.219678    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9dpx9_b80e0bea-a2e6-4a2f-aca7-695a10be7fd6/global-pull-secret-syncer/0.log"
Sep 18 14:28:49.379647 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:49.379617    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5hdp7_83c00562-ea79-41f9-98c1-38ce3d04572f/konnectivity-agent/0.log"
Sep 18 14:28:49.506895 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:49.506823    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-244.ec2.internal_1ceb76050e700c0166a29d2417c811e7/haproxy/0.log"
Sep 18 14:28:53.862958 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:53.862922    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-96dcb6468-7lxjk_d683e3ab-6d59-49da-a897-28cf01bd9b66/authorino/0.log"
Sep 18 14:28:56.187470 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:56.187445    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cl42t_e8cc6d70-8691-4104-82d8-a6d3ba2d8e51/node-exporter/0.log"
Sep 18 14:28:56.215046 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:56.215020    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cl42t_e8cc6d70-8691-4104-82d8-a6d3ba2d8e51/kube-rbac-proxy/0.log"
Sep 18 14:28:56.237001 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:56.236974    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cl42t_e8cc6d70-8691-4104-82d8-a6d3ba2d8e51/init-textfile/0.log"
Sep 18 14:28:58.587150 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:58.587123    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-8bmdp_82ab6358-26a3-4c07-8562-3a196b22852f/networking-console-plugin/0.log"
Sep 18 14:28:59.739243 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.739203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"]
Sep 18 14:28:59.739856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.739709    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1077739d-b1f7-4cbb-9e29-fb403b8f83e7" containerName="maas-api"
Sep 18 14:28:59.739856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.739729    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1077739d-b1f7-4cbb-9e29-fb403b8f83e7" containerName="maas-api"
Sep 18 14:28:59.739856 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.739825    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1077739d-b1f7-4cbb-9e29-fb403b8f83e7" containerName="maas-api"
Sep 18 14:28:59.742702 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.742683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.745493 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.745469    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkp9v\"/\"kube-root-ca.crt\""
Sep 18 14:28:59.745599 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.745541    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkp9v\"/\"openshift-service-ca.crt\""
Sep 18 14:28:59.746533 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.746518    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pkp9v\"/\"default-dockercfg-5xwr9\""
Sep 18 14:28:59.753267 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.753246    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"]
Sep 18 14:28:59.849846 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.849814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-sys\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.850010 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.849879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-podres\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.850010 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.849910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-proc\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.850010 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.849927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcfp7\" (UniqueName: \"kubernetes.io/projected/790b0b88-22bc-4f25-98cc-ef8422d25061-kube-api-access-kcfp7\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.850010 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.849951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-lib-modules\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950554 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-podres\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950554 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-proc\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcfp7\" (UniqueName: \"kubernetes.io/projected/790b0b88-22bc-4f25-98cc-ef8422d25061-kube-api-access-kcfp7\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-lib-modules\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-sys\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-proc\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950720    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-podres\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-sys\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.950806 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.950796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/790b0b88-22bc-4f25-98cc-ef8422d25061-lib-modules\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:28:59.958914 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:28:59.958887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcfp7\" (UniqueName: \"kubernetes.io/projected/790b0b88-22bc-4f25-98cc-ef8422d25061-kube-api-access-kcfp7\") pod \"perf-node-gather-daemonset-qs9t8\" (UID: \"790b0b88-22bc-4f25-98cc-ef8422d25061\") " pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:29:00.053683 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:00.053576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:29:00.324144 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:00.323992    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"]
Sep 18 14:29:00.326533 ip-10-0-132-244 kubenswrapper[2578]: W0918 14:29:00.326499    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod790b0b88_22bc_4f25_98cc_ef8422d25061.slice/crio-3bc87e79b8172b0444d504dfac1b037acb12aba8ae55f4eb177fc1c495cd2a68 WatchSource:0}: Error finding container 3bc87e79b8172b0444d504dfac1b037acb12aba8ae55f4eb177fc1c495cd2a68: Status 404 returned error can't find the container with id 3bc87e79b8172b0444d504dfac1b037acb12aba8ae55f4eb177fc1c495cd2a68
Sep 18 14:29:00.832540 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:00.832502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8" event={"ID":"790b0b88-22bc-4f25-98cc-ef8422d25061","Type":"ContainerStarted","Data":"03fc7a5a2d94c59274fd488cccaa3d09178b1bac50cd7bfe4ae3d44566455a27"}
Sep 18 14:29:00.832993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:00.832565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8" event={"ID":"790b0b88-22bc-4f25-98cc-ef8422d25061","Type":"ContainerStarted","Data":"3bc87e79b8172b0444d504dfac1b037acb12aba8ae55f4eb177fc1c495cd2a68"}
Sep 18 14:29:00.832993 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:00.832698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:29:00.849392 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:00.849343    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8" podStartSLOduration=1.849326856 podStartE2EDuration="1.849326856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 14:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 14:29:00.847819272 +0000 UTC m=+2689.539690867" watchObservedRunningTime="2026-09-18 14:29:00.849326856 +0000 UTC m=+2689.541198450"
Sep 18 14:29:01.819775 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:01.819741    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfsnj_4e8a26de-e991-45e2-bf80-9a9e1a24f310/dns/0.log"
Sep 18 14:29:01.839904 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:01.839878    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfsnj_4e8a26de-e991-45e2-bf80-9a9e1a24f310/kube-rbac-proxy/0.log"
Sep 18 14:29:01.959472 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:01.959446    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9fxf_6da04e18-92bd-4437-a852-fa667bdd230b/dns-node-resolver/0.log"
Sep 18 14:29:02.605570 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:02.605498    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wsffq_1cc9d4a5-7c7b-44d8-96d8-807e5250fc65/node-ca/0.log"
Sep 18 14:29:03.554549 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:03.554516    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6_d70fdf34-3709-460c-9560-831da7dd8618/istio-proxy/0.log"
Sep 18 14:29:04.409415 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:04.409384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-849fd8447d-jw84c_6fb32a63-e36a-42cb-b277-cbaaa765efbe/kube-auth-proxy/0.log"
Sep 18 14:29:05.478700 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:05.478669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c68zt_b76b3927-aa11-4333-8579-fa0edc1ec92c/serve-healthcheck-canary/0.log"
Sep 18 14:29:05.988466 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:05.988434    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-gxvq5_0bd27ddc-ed3e-4986-8c83-a9bc5f90c977/insights-operator/0.log"
Sep 18 14:29:05.989134 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:05.989118    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-gxvq5_0bd27ddc-ed3e-4986-8c83-a9bc5f90c977/insights-operator/1.log"
Sep 18 14:29:06.081100 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:06.081072    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kflk6_06373ef4-cef7-475e-99aa-9c3004af9903/kube-rbac-proxy/0.log"
Sep 18 14:29:06.099926 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:06.099902    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kflk6_06373ef4-cef7-475e-99aa-9c3004af9903/exporter/0.log"
Sep 18 14:29:06.120942 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:06.120918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kflk6_06373ef4-cef7-475e-99aa-9c3004af9903/extractor/0.log"
Sep 18 14:29:06.846963 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:06.846936    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pkp9v/perf-node-gather-daemonset-qs9t8"
Sep 18 14:29:09.052064 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:09.052039    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5klnx_d77a8b92-6a16-4f5f-9027-1c8187486761/server/0.log"
Sep 18 14:29:09.204375 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:09.204351    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-drz9c_ae4dda9d-a5b5-4a75-9e45-746ca1a181c3/manager/0.log"
Sep 18 14:29:09.226355 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:09.226320    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b7fcb4fd-drz9c_ae4dda9d-a5b5-4a75-9e45-746ca1a181c3/copy-manifests/0.log"
Sep 18 14:29:10.392384 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:10.392354    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6_d70fdf34-3709-460c-9560-831da7dd8618/istio-proxy/0.log"
Sep 18 14:29:10.757529 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:10.757502    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f877cc68b-lh5bn_6870b75d-48cf-470d-acaa-8f1d6e2c6579/manager/0.log"
Sep 18 14:29:10.781586 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:10.781565    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-krgrw_665f0e56-56dd-4273-bb38-642d8322b755/openshift-lws-operator/0.log"
Sep 18 14:29:11.262716 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:11.262690    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-849fd8447d-jw84c_6fb32a63-e36a-42cb-b277-cbaaa765efbe/kube-auth-proxy/0.log"
Sep 18 14:29:12.968271 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:12.968241    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-p99j6_d70fdf34-3709-460c-9560-831da7dd8618/istio-proxy/0.log"
Sep 18 14:29:13.868196 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:13.868161    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-849fd8447d-jw84c_6fb32a63-e36a-42cb-b277-cbaaa765efbe/kube-auth-proxy/0.log"
Sep 18 14:29:16.049760 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:16.049732    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-z899w_414f8052-e7f2-4ec8-b140-689caeb7d853/migrator/0.log"
Sep 18 14:29:16.068658 ip-10-0-132-244 kubenswrapper[2578]: I0918 14:29:16.068633    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-z899w_414f8052-e7f2-4ec8-b140-689caeb7d853/graceful-termination/0.log"