Sep 18 22:14:50.166350 ip-10-0-139-21 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 22:14:50.166437 ip-10-0-139-21 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 22:14:50.166448 ip-10-0-139-21 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 22:14:50.166771 ip-10-0-139-21 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 22:15:00.268905 ip-10-0-139-21 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 22:15:00.268920 ip-10-0-139-21 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7fc7705fd8a54c54bee7f8c38a796845 --
Sep 18 22:16:48.004067 ip-10-0-139-21 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 22:16:51.228282 ip-10-0-139-21 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:16:51.228282 ip-10-0-139-21 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 22:16:51.228282 ip-10-0-139-21 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:16:51.228282 ip-10-0-139-21 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 22:16:51.228282 ip-10-0-139-21 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:16:51.229274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.228361    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 22:16:51.231870 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231852    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:16:51.231870 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231869    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231873    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231876    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231879    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231882    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231885    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231887    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231890    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231893    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231896    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231898    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231902    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231904    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231906    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231909    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231912    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231914    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231916    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231925    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231927    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:16:51.231935 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231930    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231932    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231935    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231938    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231942    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231946    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231950    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231953    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231956    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231958    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231961    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231964    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231966    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231969    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231971    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231974    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231976    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231979    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231981    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:16:51.232407 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231983    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231986    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231988    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231990    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231993    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231995    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.231998    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232000    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232003    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232005    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232009    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232011    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232014    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232017    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232019    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232022    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232024    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232026    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232029    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232032    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:16:51.232883 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232034    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232037    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232040    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232042    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232045    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232047    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232050    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232052    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232055    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232057    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232059    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232063    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232065    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232068    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232070    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232073    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232075    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232078    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232081    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232083    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:16:51.233367 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232086    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232088    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232091    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232093    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232096    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232098    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232101    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232105    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232107    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232110    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232112    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232115    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232117    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232120    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232123    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232125    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232128    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232132    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232136    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:16:51.233855 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232860    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232867    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232871    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232873    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232876    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232879    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232883    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232885    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232888    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232890    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232893    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232896    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232898    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232901    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232903    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232906    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232909    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232911    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232914    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232917    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:16:51.234318 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232919    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232922    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232924    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232927    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232929    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232932    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232934    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232936    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232941    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232944    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232947    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232950    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232953    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232956    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232959    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232962    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232965    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232968    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232971    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232974    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:16:51.234857 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232976    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232979    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232981    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232984    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232986    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232988    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232991    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232994    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232997    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.232999    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233001    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233004    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233006    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233009    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233011    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233014    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233016    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233018    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233021    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:16:51.235347 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233023    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233027    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233030    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233032    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233035    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233038    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233040    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233043    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233047    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233051    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233054    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233056    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233062    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233064    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233067    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233070    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233072    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233075    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233078    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:16:51.235811 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233080    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233083    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233085    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233088    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233091    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233093    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233096    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233099    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233101    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233103    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233106    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233108    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233111    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233113    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233116    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233118    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233121    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233123    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233125    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233128    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:16:51.236266 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233130    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233518    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233523    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233525    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233528    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233532    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233535    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233538    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233541    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233543    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233546    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233548    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233551    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233553    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233557    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233559    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233562    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233564    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233567    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233569    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:16:51.236748 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233572    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233574    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233577    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233580    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233583    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233586    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233588    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233591    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233593    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233596    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233598    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233600    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233603    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233605    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233608    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233610    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233612    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233617    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233620    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:16:51.237239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233622    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233625    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233627    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233634    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233638    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233641    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233644    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233647    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233649    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233652    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233655    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233658    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233660    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233663    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233665    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233668    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233670    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233673    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233675    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:16:51.237715 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233679    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233682    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233685    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233688    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233691    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233693    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233696    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233699    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233701    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233704    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233706    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233710    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233713    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233716    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233718    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233721    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233724    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233727    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233729    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233732    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:16:51.238205 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233734    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233737    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233739    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233742    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233744    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233747    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233750    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233752    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233756    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233758    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233761    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233763    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233765    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233768    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233770    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233772    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233791    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233794    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233796    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233799    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:16:51.238694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233801    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.233804    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233888    2570 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233930    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233938    2570 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233942    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233947    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233951    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233956    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233961    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233964    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233968    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233971    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233975    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233978    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233981    2570 flags.go:64] FLAG: --cgroup-root=""
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233984    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233987    2570 flags.go:64] FLAG: --client-ca-file=""
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233990    2570 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233993    2570 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233997    2570 flags.go:64] FLAG: --cluster-domain=""
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.233999    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234002    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234006    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 22:16:51.239212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234009    2570 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234013    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234016    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234018    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234021    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234024    2570 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234027    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234030    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234034    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234036    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234040    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234044    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234047    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234049    2570 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234052    2570 flags.go:64] FLAG: --enable-server="true"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234056    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234061    2570 flags.go:64] FLAG: --event-burst="100"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234064    2570 flags.go:64] FLAG: --event-qps="50"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234067    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234070    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234073    2570 flags.go:64] FLAG: --eviction-hard=""
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234077    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234080    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234082    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234086    2570 flags.go:64] FLAG: --eviction-soft=""
Sep 18 22:16:51.239832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234088    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234091    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234094    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234097    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234099    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234102    2570 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234105    2570 flags.go:64] FLAG: --feature-gates=""
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234108    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234111    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234114    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234117    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234120    2570 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234123    2570 flags.go:64] FLAG: --help="false"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234125    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234128    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234131    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234134    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234137    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234141    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234144    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234146    2570 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234149    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234152    2570 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 22:16:51.240421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234157    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234160    2570 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234163    2570 flags.go:64] FLAG: --kube-reserved=""
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234166    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234168    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234171    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234174    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234177    2570 flags.go:64] FLAG: --lock-file=""
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234179    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234182    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234185    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234190    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234193    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234196    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234199    2570 flags.go:64] FLAG: --logging-format="text"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234201    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234204    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234207    2570 flags.go:64] FLAG: --manifest-url=""
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234210    2570 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234214    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234217    2570 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234221    2570 flags.go:64] FLAG: --max-pods="110"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234224    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234226    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234229    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 22:16:51.241236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234232    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234234    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234237    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234240    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234248    2570 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234251    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234254    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234258    2570 flags.go:64] FLAG: --pod-cidr=""
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234262    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234268    2570 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234271    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234274    2570 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234277    2570 flags.go:64] FLAG: --port="10250"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234280    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234283    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0780673ba98f0eb6b"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234286    2570 flags.go:64] FLAG: --qos-reserved=""
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234289    2570 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234292    2570 flags.go:64] FLAG: --register-node="true"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234294    2570 flags.go:64] FLAG: --register-with-taints=""
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234304    2570 flags.go:64] FLAG: --registry-burst="10"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234307    2570 flags.go:64] FLAG: --registry-qps="5"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234310    2570 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234313    2570 flags.go:64] FLAG: --reserved-memory=""
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234316    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234319    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 22:16:51.242305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234322    2570 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234325    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234328    2570 flags.go:64] FLAG: --runonce="false"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234331    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234336    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234339    2570 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234342    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234345    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234348    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234351    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234355    2570 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234358    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234361    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234363    2570 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234366    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234370    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234374    2570 flags.go:64] FLAG: --system-cgroups=""
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234377    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234382    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234385    2570 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234388    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234392    2570 flags.go:64] FLAG: --tls-min-version=""
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234395    2570 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234397    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234400    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 22:16:51.243362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234403    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234406    2570 flags.go:64] FLAG: --v="2"
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234409    2570 flags.go:64] FLAG: --version="false"
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234413    2570 flags.go:64] FLAG: --vmodule=""
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234416    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.234420    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234538    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234542    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234545    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234548    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234551    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234555    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234557    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234560    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234562    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234565    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234567    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234569    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234572    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234575    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234577    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:16:51.244454 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234579    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234583    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234586    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234589    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234592    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234596    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234599    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234602    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234605    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234608    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234610    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234613    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234615    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234618    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234621    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234623    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234626    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234628    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234631    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234634    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:16:51.245147 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234636    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234639    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234642    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234645    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234648    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234650    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234653    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234655    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234657    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234660    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234662    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234665    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234667    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234671    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234673    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234676    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234679    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234682    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234684    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234686    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:16:51.245874 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234689    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234692    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234694    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234696    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234699    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234701    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234705    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234708    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234711    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234714    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234717    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234719    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234722    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234724    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234728    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234730    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234733    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234735    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234738    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:16:51.246402 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234741    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234745    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234748    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234751    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234753    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234756    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234760    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234763    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234765    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234768    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234771    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234788    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234791    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234794    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234796    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234799    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234801    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234804    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234806    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234809    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:16:51.247212 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234812    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234814    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234817    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234819    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.234822    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.235305    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.243017    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.243036    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.243065    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.243074    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243169    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243177    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243181    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243186    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243191    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:16:51.247868 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243195    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243199    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243204    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243209    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243213    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243217    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243221    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243226    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243230    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243234    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243238    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243243    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243247    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243253    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243259    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243264    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243268    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243273    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243277    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243281    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:16:51.248348 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243286    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243290    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243294    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243298    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243304    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243309    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243313    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243317    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243322    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243326    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243331    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243335    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243339    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243343    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243347    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243353    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243359    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243363    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243368    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:16:51.248930 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243372    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243376    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243380    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243384    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243388    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243391    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243396    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243400    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243404    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243408    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243412    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243416    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243421    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243425    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243429    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243434    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243438    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243443    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243449    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243453    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:16:51.249536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243458    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243462    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243466    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243470    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243474    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243478    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243482    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243486    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243490    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243494    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243501    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243507    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243512    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243516    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243520    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243524    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243528    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243532    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243536    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:16:51.250239 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243540    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243544    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243548    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243552    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243558    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243562    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243566    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243570    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243575    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243579    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243584    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243588    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243593    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243597    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243601    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:16:51.250858 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243605    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.243614    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243817    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243828    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243832    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243836    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243840    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243845    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243850    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243854    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243858    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243862    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243867    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243871    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243875    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:16:51.251540 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243879    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243883    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243887    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243891    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243895    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243899    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243903    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243908    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243912    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243916    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243921    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243925    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243929    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243933    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243938    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243943    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243948    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243952    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243956    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:16:51.252166 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243960    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243966    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243973    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243978    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243983    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243987    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243991    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.243996    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244000    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244004    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244008    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244013    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244020    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244024    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244028    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244032    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244036    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244040    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244044    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:16:51.252642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244048    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244054    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244059    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244064    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244068    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244072    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244077    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244081    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244085    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244089    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244093    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244098    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244102    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244106    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244110    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244114    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244118    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244122    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244126    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244131    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:16:51.253213 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244134    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244139    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244142    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244147    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244151    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244155    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244159    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244163    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244168    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244172    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244176    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244180    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244184    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244188    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244193    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244197    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244201    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244205    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244209    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244213    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:16:51.253714 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244217    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244221    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244225    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244230    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244234    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244239    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244243    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:51.244247    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.244255    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.244444    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.247845    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.248671    2570 server.go:1019] "Starting client certificate rotation"
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.248773    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 22:16:51.254649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.248827    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 22:16:51.255001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.251507    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 22:16:51.255001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.254411    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 22:16:51.261331 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.261298    2570 log.go:25] "Validated CRI v1 runtime API"
Sep 18 22:16:51.263512 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.263499    2570 log.go:25] "Validated CRI v1 image API"
Sep 18 22:16:51.264349 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.264333    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 22:16:51.266340 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.266321    2570 fs.go:135] Filesystem UUIDs: map[124445b3-9057-44a3-b001-b010ebae446d:/dev/nvme0n1p3 40882232-c57c-4f9c-89bd-e7dadec4a5cf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 18 22:16:51.266393 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.266341    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 22:16:51.271887 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.271790    2570 manager.go:216] Machine: {Timestamp:2026-09-18 22:16:51.271308374 +0000 UTC m=+1.849253515 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100859 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec290b998f5188fd514e058b0b16b206 SystemUUID:ec290b99-8f51-88fd-514e-058b0b16b206 BootID:7fc7705f-d8a5-4c54-bee7-f8c38a796845 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c2:44:8d:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c2:44:8d:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:15:7e:2f:63:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 22:16:51.271887 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.271882    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 22:16:51.272002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.271957    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 22:16:51.273261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.273236    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 22:16:51.273407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.273264    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 22:16:51.274356 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.274345    2570 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 22:16:51.274390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.274358    2570 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 22:16:51.274390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.274366    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 22:16:51.274390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.274378    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 22:16:51.275620 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.275611    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 22:16:51.278766 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.278749    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 22:16:51.279394 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279382    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 22:16:51.279497 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279488    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 22:16:51.279534 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279517    2570 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 22:16:51.279534 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279527    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 22:16:51.279589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279541    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 22:16:51.279589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279551    2570 kubelet.go:398] "Adding apiserver pod source"
Sep 18 22:16:51.279589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279561    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 22:16:51.279892 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279881    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 22:16:51.279954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.279899    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 22:16:51.281642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.281624    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 22:16:51.283881 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.283865    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 22:16:51.283930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.283898    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 22:16:51.285017 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.284993    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 22:16:51.285017 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285014    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 22:16:51.285017 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285020    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 22:16:51.285017 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285025    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285035    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285040    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285053    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285058    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285065    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285081    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285094    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285099    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285122    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 22:16:51.285203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.285127    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 22:16:51.289946 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.289894    2570 server.go:1268] "Started kubelet"
Sep 18 22:16:51.289946 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.289915    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 22:16:51.289946 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.289928    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 22:16:51.290178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.290066    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 22:16:51.290178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.290071    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 22:16:51.290178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.290095    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 22:16:51.290318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.290183    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 22:16:51.291029 ip-10-0-139-21 systemd[1]: Started Kubernetes Kubelet.
Sep 18 22:16:51.291885 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.291845    2570 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 22:16:51.293674 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.293648    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 22:16:51.294268 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.294250    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 22:16:51.299682 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.299663    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 22:16:51.299794 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.299693    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 22:16:51.299858 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.299843    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:51.300255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300121    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 22:16:51.300255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300124    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 22:16:51.300255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300147    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 22:16:51.300255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300226    2570 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 22:16:51.300255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300235    2570 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 22:16:51.300611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300592    2570 factory.go:55] Registering systemd factory
Sep 18 22:16:51.300611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300613    2570 factory.go:223] Registration of the systemd container factory successfully
Sep 18 22:16:51.300864 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300849    2570 factory.go:153] Registering CRI-O factory
Sep 18 22:16:51.301234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.300981    2570 factory.go:223] Registration of the crio container factory successfully
Sep 18 22:16:51.301234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.301061    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 22:16:51.301234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.301085    2570 factory.go:103] Registering Raw factory
Sep 18 22:16:51.301234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.301102    2570 manager.go:1196] Started watching for new ooms in manager
Sep 18 22:16:51.301564 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.301335    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 22:16:51.301644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.301631    2570 manager.go:349] Starting recovery of all containers
Sep 18 22:16:51.302326 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.302305    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 22:16:51.311388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.311361    2570 manager.go:354] Recovery completed
Sep 18 22:16:51.313105 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.313087    2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 18 22:16:51.316117 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.316100    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:51.318125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.318109    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:51.318190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.318142    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:51.318190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.318153    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:51.319489 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.319468    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 22:16:51.319489 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.319490    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 22:16:51.319639 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.319508    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 22:16:51.320271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.320254    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:51.321395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.321378    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:51.321473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.321408    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:51.321473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.321424    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:51.321741 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.321726    2570 policy_none.go:49] "None policy: Start"
Sep 18 22:16:51.321741 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.321741    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 22:16:51.321871 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.321760    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 22:16:51.323742 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.323730    2570 policy_none.go:47] "Start"
Sep 18 22:16:51.329893 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.328935    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a2927a68b4d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.289869133 +0000 UTC m=+1.867814268,LastTimestamp:2026-09-18 22:16:51.289869133 +0000 UTC m=+1.867814268,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.332551 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.332497    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a292955b6d4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-21.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.318126292 +0000 UTC m=+1.896071429,LastTimestamp:2026-09-18 22:16:51.318126292 +0000 UTC m=+1.896071429,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.338659 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.338589    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a2929560781  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-21.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.318146945 +0000 UTC m=+1.896092081,LastTimestamp:2026-09-18 22:16:51.318146945 +0000 UTC m=+1.896092081,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.342676 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.342595    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a292956305b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-21.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.318157403 +0000 UTC m=+1.896102539,LastTimestamp:2026-09-18 22:16:51.318157403 +0000 UTC m=+1.896102539,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.349239 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.349180    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-21.ec2.internal.18d68a292955b6d4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a292955b6d4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-21.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.318126292 +0000 UTC m=+1.896071429,LastTimestamp:2026-09-18 22:16:51.32139428 +0000 UTC m=+1.899339416,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.354309 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.354241    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-21.ec2.internal.18d68a2929560781\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a2929560781  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-21.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.318146945 +0000 UTC m=+1.896092081,LastTimestamp:2026-09-18 22:16:51.321415897 +0000 UTC m=+1.899361038,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.357037 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.356959    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-21.ec2.internal.18d68a292956305b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a292956305b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-21.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.318157403 +0000 UTC m=+1.896102539,LastTimestamp:2026-09-18 22:16:51.321427803 +0000 UTC m=+1.899372940,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.362345    2570 manager.go:337] "Starting Device Plugin manager"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.362379    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.362390    2570 server.go:87] "Starting device plugin registration server"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.362656    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.362674    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.362813    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.362911    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.362921    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.363408    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.363451    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.366696    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18d68a292c19c88c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-09-18 22:16:51.364530316 +0000 UTC m=+1.942475443,LastTimestamp:2026-09-18 22:16:51.364530316 +0000 UTC m=+1.942475443,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
Sep 18 22:16:51.383267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.381054    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptgc9"
Sep 18 22:16:51.388907 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.388887    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptgc9"
Sep 18 22:16:51.394880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.394849    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 22:16:51.396185 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.396161    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 22:16:51.396274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.396213    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 22:16:51.396274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.396246    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 22:16:51.396370 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.396294    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 22:16:51.405674 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.405657    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:16:51.462908 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.462884    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:51.464664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.464635    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:51.464761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.464677    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:51.464761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.464692    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:51.464761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.464714    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.497076 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.497023    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"]
Sep 18 22:16:51.497133 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.497089    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:51.498009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.497996    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:51.498056 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.498030    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:51.498056 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.498045    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:51.499389 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.499374    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.499430 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.499396    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-21.ec2.internal\": node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:51.500423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.500411    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:51.500536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.500521    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.500566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.500557    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:51.501199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501183    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:51.501271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501203    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:51.501271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501214    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:51.501271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501224    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:51.501271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52187890db8f3c4806772b995bc76a6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"52187890db8f3c4806772b995bc76a6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.501271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501227    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:51.501271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52187890db8f3c4806772b995bc76a6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"52187890db8f3c4806772b995bc76a6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.501271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501255    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:51.501477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.501416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e3881ed91595ba0bbb3df028072a67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-21.ec2.internal\" (UID: \"e0e3881ed91595ba0bbb3df028072a67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.503644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.503626    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.503745 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.503659    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:51.504359 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.504341    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:51.504447 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.504386    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:51.504447 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.504401    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:51.520364 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.520346    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:51.537476 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.537456    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-21.ec2.internal\" not found" node="ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.541964 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.541951    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-21.ec2.internal\" not found" node="ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.601615 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.601593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e3881ed91595ba0bbb3df028072a67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-21.ec2.internal\" (UID: \"e0e3881ed91595ba0bbb3df028072a67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.601615 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.601619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52187890db8f3c4806772b995bc76a6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"52187890db8f3c4806772b995bc76a6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.601809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.601639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52187890db8f3c4806772b995bc76a6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"52187890db8f3c4806772b995bc76a6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.601809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.601681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52187890db8f3c4806772b995bc76a6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"52187890db8f3c4806772b995bc76a6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.601809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.601700    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0e3881ed91595ba0bbb3df028072a67-config\") pod \"kube-apiserver-proxy-ip-10-0-139-21.ec2.internal\" (UID: \"e0e3881ed91595ba0bbb3df028072a67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.601809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.601706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52187890db8f3c4806772b995bc76a6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"52187890db8f3c4806772b995bc76a6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.621084 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.621061    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:51.722019 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.721967    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:51.822851 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.822757    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:51.840970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.840940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.846220 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:51.846037    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:51.923035 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:51.922858    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.023424 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:52.023390    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.123964 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:52.123876    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.224664 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:52.224633    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.248808 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.248772    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 22:16:52.249211 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.248915    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 22:16:52.325363 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:52.325334    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.326642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.326622    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:16:52.338374 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.338347    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:16:52.340566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.340544    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:16:52.340651 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.340588    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:16:52.340651 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.340604    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:16:52.394247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.394170    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 22:11:51 +0000 UTC" deadline="2028-03-05 05:34:00.025824123 +0000 UTC"
Sep 18 22:16:52.394247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.394204    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12799h17m7.631623479s"
Sep 18 22:16:52.425913 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:52.425752    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.444721 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.444638    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:16:52.462916 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:52.462881    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52187890db8f3c4806772b995bc76a6c.slice/crio-35106a18569b70ae2fba903cfac396a8e5fe81a9e9d92dea7864cd0376ee0863 WatchSource:0}: Error finding container 35106a18569b70ae2fba903cfac396a8e5fe81a9e9d92dea7864cd0376ee0863: Status 404 returned error can't find the container with id 35106a18569b70ae2fba903cfac396a8e5fe81a9e9d92dea7864cd0376ee0863
Sep 18 22:16:52.463321 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:52.463305    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e3881ed91595ba0bbb3df028072a67.slice/crio-27ef7b18566990e055ed4fda02676e0c88c9ae139fafa29eab606b11795904b9 WatchSource:0}: Error finding container 27ef7b18566990e055ed4fda02676e0c88c9ae139fafa29eab606b11795904b9: Status 404 returned error can't find the container with id 27ef7b18566990e055ed4fda02676e0c88c9ae139fafa29eab606b11795904b9
Sep 18 22:16:52.468345 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.468325    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:16:52.526798 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:52.526744    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.627312 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:52.627260    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
Sep 18 22:16:52.667413 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.667360    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:16:52.700445 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.700411    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:52.710396 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.710371    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 22:16:52.711249 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.711234    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
Sep 18 22:16:52.721884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:52.721868    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 22:16:53.280897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.280868    2570 apiserver.go:52] "Watching apiserver"
Sep 18 22:16:53.287471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.287436    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 22:16:53.287937 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.287913    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-d8fcn","openshift-multus/network-metrics-daemon-8rdzh","openshift-ovn-kubernetes/ovnkube-node-fnrp7","kube-system/global-pull-secret-syncer-qfmqn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7","openshift-cluster-node-tuning-operator/tuned-2g2tf","openshift-dns/node-resolver-6wbkd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal","openshift-network-diagnostics/network-check-target-4g5cx","openshift-network-operator/iptables-alerter-7kjk8","kube-system/konnectivity-agent-gblr7","kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal","openshift-image-registry/node-ca-ghg7l","openshift-multus/multus-additional-cni-plugins-mqngn"]
Sep 18 22:16:53.290470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.290441    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.292845 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.292824    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.293620 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.293603    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9cpv\""
Sep 18 22:16:53.293843 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.293827    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 22:16:53.293986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.293969    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 22:16:53.294991 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.294972    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 22:16:53.295122 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.295102    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 22:16:53.295202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.295187    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4rksw\""
Sep 18 22:16:53.295345 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.295325    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 22:16:53.295524 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.295506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.297852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.297833    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.297926 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.297894    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:16:53.298736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.298708    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 22:16:53.299840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.298979    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 22:16:53.299840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.299160    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 22:16:53.299840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.299310    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 22:16:53.299840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.299549    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 22:16:53.299840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.299766    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 22:16:53.300831 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.300810    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cbrk8\""
Sep 18 22:16:53.301744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.301066    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 22:16:53.302255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.302233    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.305078 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.304415    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.305078 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.304582    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 22:16:53.305078 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.304653    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 22:16:53.305078 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.304920    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-95qgb\""
Sep 18 22:16:53.305078 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.304981    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 22:16:53.306762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.306741    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:53.306893 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.306830    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:16:53.306893 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.306870    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:16:53.307007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.306906    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zwjfq\""
Sep 18 22:16:53.307158 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.307142    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 22:16:53.309579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.309064    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.312086 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.311837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:53.312086 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.311949    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:16:53.312225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312078    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25nm\" (UniqueName: \"kubernetes.io/projected/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-kube-api-access-b25nm\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.312225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3da85a87-b538-439c-bb22-7d6614f772a8-host\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.312225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312168    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-etc-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312361 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312267    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovnkube-config\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312361 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8h4h\" (UniqueName: \"kubernetes.io/projected/3da85a87-b538-439c-bb22-7d6614f772a8-kube-api-access-t8h4h\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.312361 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-systemd-units\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312361 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfvww\" (UniqueName: \"kubernetes.io/projected/cf765131-c9a6-49d3-8707-daecd8fd59d1-kube-api-access-bfvww\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312531 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312390    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-slash\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312531 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-systemd\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312629 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-cni-bin\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312629 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3da85a87-b538-439c-bb22-7d6614f772a8-serviceca\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.312629 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-log-socket\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312768 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312654    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.312768 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312750    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-sys-fs\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.312880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-hosts-file\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.312880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312840    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-kubelet\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.312880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312871    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-node-log\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313020 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.312922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313020 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313000    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5d42\" (UniqueName: \"kubernetes.io/projected/b362af33-b609-4f55-9095-654350ac2f6a-kube-api-access-d5d42\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.313113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313037    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb35237d-fa0a-4732-9f7a-64783a41bcbf-kubelet-config\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.313164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-run-netns\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313178    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-var-lib-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313326 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-ovn\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313326 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-cni-netd\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313326 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovn-node-metrics-cert\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313456 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-registration-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.313456 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313551 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313505    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovnkube-script-lib\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313566    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.313682 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-device-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.313810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-env-overrides\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.313810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313761    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb35237d-fa0a-4732-9f7a-64783a41bcbf-dbus\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.313920 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.313920 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313897    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-socket-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.314884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.313932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-tmp-dir\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.314884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.314143    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 22:16:53.314884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.314345    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 22:16:53.314884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.314524    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 22:16:53.314884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.314602    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 22:16:53.314884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.314768    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jg4r5\""
Sep 18 22:16:53.316543 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.316524    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.319103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.319086    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 22:16:53.319202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.319107    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:16:53.319308 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.319292    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.319418 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.319340    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 22:16:53.319704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.319546    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-867hh\""
Sep 18 22:16:53.321160 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.321124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.325057 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.325039    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dvgzf\""
Sep 18 22:16:53.325261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.325241    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 22:16:53.325617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.325595    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 22:16:53.325960 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.325943    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 22:16:53.326175 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.326161    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4p6sp\""
Sep 18 22:16:53.326262 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.326233    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 22:16:53.326335 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.326322    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 22:16:53.343289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.343268    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bbxll"
Sep 18 22:16:53.351965 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.351948    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bbxll"
Sep 18 22:16:53.401182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.401160    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 22:16:53.402423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.402345    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" event={"ID":"52187890db8f3c4806772b995bc76a6c","Type":"ContainerStarted","Data":"35106a18569b70ae2fba903cfac396a8e5fe81a9e9d92dea7864cd0376ee0863"}
Sep 18 22:16:53.403583 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.403553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal" event={"ID":"e0e3881ed91595ba0bbb3df028072a67","Type":"ContainerStarted","Data":"27ef7b18566990e055ed4fda02676e0c88c9ae139fafa29eab606b11795904b9"}
Sep 18 22:16:53.415092 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovnkube-config\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.415258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415102    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysctl-d\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.415258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415128    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfvww\" (UniqueName: \"kubernetes.io/projected/cf765131-c9a6-49d3-8707-daecd8fd59d1-kube-api-access-bfvww\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.415258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-k8s-cni-cncf-io\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.415258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415178    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-multus-certs\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.415258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/761ea664-e76a-468f-82b2-3bc1b4107204-konnectivity-ca\") pod \"konnectivity-agent-gblr7\" (UID: \"761ea664-e76a-468f-82b2-3bc1b4107204\") " pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.415258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-system-cni-dir\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.415258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415254    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-kubernetes\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415274    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-slash\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415298    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-system-cni-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-cnibin\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-etc-kubernetes\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-log-socket\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-cni-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415404    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmmws\" (UniqueName: \"kubernetes.io/projected/922be084-872e-466e-9b68-f447707d3999-kube-api-access-tmmws\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415444    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcgtl\" (UniqueName: \"kubernetes.io/projected/b93cfc3c-e1f9-43db-945a-15a8992d02c6-kube-api-access-vcgtl\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysctl-conf\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-systemd\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb35237d-fa0a-4732-9f7a-64783a41bcbf-kubelet-config\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-slash\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-run-netns\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-var-lib-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.415598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-log-socket\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-ovn\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415636    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovnkube-config\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-cni-netd\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415695    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-run-netns\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415705    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb35237d-fa0a-4732-9f7a-64783a41bcbf-kubelet-config\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-run\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-sys\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415752    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-ovn\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-var-lib-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415773    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415797    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovnkube-script-lib\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415824    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-cni-netd\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.416568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415862    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415890    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-tmp\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrzg4\" (UniqueName: \"kubernetes.io/projected/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-kube-api-access-wrzg4\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.415945    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-env-overrides\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.415977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb35237d-fa0a-4732-9f7a-64783a41bcbf-dbus\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.416042    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret podName:fb35237d-fa0a-4732-9f7a-64783a41bcbf nodeName:}" failed. No retries permitted until 2026-09-18 22:16:53.916010547 +0000 UTC m=+4.493955692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret") pod "global-pull-secret-syncer-qfmqn" (UID: "fb35237d-fa0a-4732-9f7a-64783a41bcbf") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-socket-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416117    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-tmp-dir\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3da85a87-b538-439c-bb22-7d6614f772a8-host\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-socket-dir-parent\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416215    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-tuned\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-etc-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416262    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/381cf0fb-d930-4210-8caa-71261ba5e0d6-cni-binary-copy\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68m7\" (UniqueName: \"kubernetes.io/projected/381cf0fb-d930-4210-8caa-71261ba5e0d6-kube-api-access-v68m7\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovnkube-script-lib\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/922be084-872e-466e-9b68-f447707d3999-iptables-alerter-script\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.417648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416304    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/761ea664-e76a-468f-82b2-3bc1b4107204-agent-certs\") pod \"konnectivity-agent-gblr7\" (UID: \"761ea664-e76a-468f-82b2-3bc1b4107204\") " pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416362    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3da85a87-b538-439c-bb22-7d6614f772a8-host\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416384    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf765131-c9a6-49d3-8707-daecd8fd59d1-env-overrides\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416399    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb35237d-fa0a-4732-9f7a-64783a41bcbf-dbus\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-var-lib-kubelet\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416446    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-etc-openvswitch\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-systemd-units\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416469    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-socket-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-hostroot\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-systemd-units\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-conf-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-tmp-dir\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416557    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-daemon-config\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416625    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cnibin\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-systemd\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-run-systemd\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.418419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-cni-bin\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3da85a87-b538-439c-bb22-7d6614f772a8-serviceca\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-cni-bin\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-netns\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-cni-bin\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-kubelet\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.416965    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-sys-fs\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-hosts-file\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-sys-fs\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417184    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-kubelet\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-node-log\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417249    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-kubelet\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417284    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5d42\" (UniqueName: \"kubernetes.io/projected/b362af33-b609-4f55-9095-654350ac2f6a-kube-api-access-d5d42\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417332    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-cni-multus\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417342    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-hosts-file\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovn-node-metrics-cert\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417376    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf765131-c9a6-49d3-8707-daecd8fd59d1-node-log\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3da85a87-b538-439c-bb22-7d6614f772a8-serviceca\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-registration-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/922be084-872e-466e-9b68-f447707d3999-host-slash\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysconfig\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-lib-modules\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417492    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-device-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm77x\" (UniqueName: \"kubernetes.io/projected/c8f92073-6622-4825-8f48-ec08f7bff5ef-kube-api-access-cm77x\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417522    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-registration-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417554    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-modprobe-d\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-device-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.419791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25nm\" (UniqueName: \"kubernetes.io/projected/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-kube-api-access-b25nm\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.420422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417637    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8h4h\" (UniqueName: \"kubernetes.io/projected/3da85a87-b538-439c-bb22-7d6614f772a8-kube-api-access-t8h4h\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.420422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:53.420422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417669    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-host\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.420422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417738    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 22:16:53.420422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.417607    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b362af33-b609-4f55-9095-654350ac2f6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.421551 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.421529    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf765131-c9a6-49d3-8707-daecd8fd59d1-ovn-node-metrics-cert\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.431904 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.431829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5d42\" (UniqueName: \"kubernetes.io/projected/b362af33-b609-4f55-9095-654350ac2f6a-kube-api-access-d5d42\") pod \"aws-ebs-csi-driver-node-pmlq7\" (UID: \"b362af33-b609-4f55-9095-654350ac2f6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.433456 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.433431    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfvww\" (UniqueName: \"kubernetes.io/projected/cf765131-c9a6-49d3-8707-daecd8fd59d1-kube-api-access-bfvww\") pod \"ovnkube-node-fnrp7\" (UID: \"cf765131-c9a6-49d3-8707-daecd8fd59d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.434909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.434662    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8h4h\" (UniqueName: \"kubernetes.io/projected/3da85a87-b538-439c-bb22-7d6614f772a8-kube-api-access-t8h4h\") pod \"node-ca-ghg7l\" (UID: \"3da85a87-b538-439c-bb22-7d6614f772a8\") " pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.435118 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.435096    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25nm\" (UniqueName: \"kubernetes.io/projected/bf6d6f80-59ad-457e-b964-5cd20aa3d4e2-kube-api-access-b25nm\") pod \"node-resolver-6wbkd\" (UID: \"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2\") " pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.506634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.506600    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:16:53.518828 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.518802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-run\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.518986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.518840    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-sys\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.518986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.518881    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:53.518986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.518904    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-tmp\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.518986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.518926    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrzg4\" (UniqueName: \"kubernetes.io/projected/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-kube-api-access-wrzg4\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.518986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.518959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-run\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519014    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-sys\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.519033    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519069    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-socket-dir-parent\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519104    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-tuned\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.519120    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:16:54.019100251 +0000 UTC m=+4.597045389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-socket-dir-parent\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/381cf0fb-d930-4210-8caa-71261ba5e0d6-cni-binary-copy\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519182    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v68m7\" (UniqueName: \"kubernetes.io/projected/381cf0fb-d930-4210-8caa-71261ba5e0d6-kube-api-access-v68m7\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519204    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/922be084-872e-466e-9b68-f447707d3999-iptables-alerter-script\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.519232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/761ea664-e76a-468f-82b2-3bc1b4107204-agent-certs\") pod \"konnectivity-agent-gblr7\" (UID: \"761ea664-e76a-468f-82b2-3bc1b4107204\") " pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-var-lib-kubelet\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-hostroot\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-conf-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519318    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-daemon-config\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519341    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cnibin\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-netns\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-cni-bin\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-kubelet\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-cni-multus\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/922be084-872e-466e-9b68-f447707d3999-host-slash\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519513    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysconfig\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-lib-modules\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519546    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm77x\" (UniqueName: \"kubernetes.io/projected/c8f92073-6622-4825-8f48-ec08f7bff5ef-kube-api-access-cm77x\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.519709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-cni-bin\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519675    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-modprobe-d\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519665    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/381cf0fb-d930-4210-8caa-71261ba5e0d6-cni-binary-copy\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-host\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-var-lib-kubelet\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.519973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysctl-d\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-k8s-cni-cncf-io\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-hostroot\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-multus-certs\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-conf-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/761ea664-e76a-468f-82b2-3bc1b4107204-konnectivity-ca\") pod \"konnectivity-agent-gblr7\" (UID: \"761ea664-e76a-468f-82b2-3bc1b4107204\") " pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-system-cni-dir\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/922be084-872e-466e-9b68-f447707d3999-iptables-alerter-script\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520143    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-kubernetes\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520150    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-system-cni-dir\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520178    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-system-cni-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520204    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-cnibin\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.520621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520205    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-host\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-etc-kubernetes\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520253    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-cni-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmws\" (UniqueName: \"kubernetes.io/projected/922be084-872e-466e-9b68-f447707d3999-kube-api-access-tmmws\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520308    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcgtl\" (UniqueName: \"kubernetes.io/projected/b93cfc3c-e1f9-43db-945a-15a8992d02c6-kube-api-access-vcgtl\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520335    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysctl-d\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520371    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-k8s-cni-cncf-io\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520382    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-cni-multus\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520401    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-kubernetes\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520415    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysctl-conf\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-systemd\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-system-cni-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-daemon-config\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520547    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-multus-certs\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.521474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysconfig\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520590    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cnibin\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520632    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-etc-kubernetes\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520683    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-multus-cni-dir\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520686    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-lib-modules\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-cnibin\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520762    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-systemd\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.520988    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521065    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b93cfc3c-e1f9-43db-945a-15a8992d02c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521073    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-sysctl-conf\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521123    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-run-netns\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521220    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/381cf0fb-d930-4210-8caa-71261ba5e0d6-host-var-lib-kubelet\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-modprobe-d\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521273    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/922be084-872e-466e-9b68-f447707d3999-host-slash\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521335    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/761ea664-e76a-468f-82b2-3bc1b4107204-konnectivity-ca\") pod \"konnectivity-agent-gblr7\" (UID: \"761ea664-e76a-468f-82b2-3bc1b4107204\") " pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-tmp\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.521733    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-etc-tuned\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.522275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.522187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/761ea664-e76a-468f-82b2-3bc1b4107204-agent-certs\") pod \"konnectivity-agent-gblr7\" (UID: \"761ea664-e76a-468f-82b2-3bc1b4107204\") " pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.531459 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.531397    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:16:53.531459 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.531422    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:16:53.531459 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.531436    2570 projected.go:196] Error preparing data for projected volume kube-api-access-mdqf8 for pod openshift-network-diagnostics/network-check-target-4g5cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:53.531665 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.531514    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8 podName:62680257-0184-4adc-a796-610d2149fbff nodeName:}" failed. No retries permitted until 2026-09-18 22:16:54.031487023 +0000 UTC m=+4.609432165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mdqf8" (UniqueName: "kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8") pod "network-check-target-4g5cx" (UID: "62680257-0184-4adc-a796-610d2149fbff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:53.533657 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.533633    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68m7\" (UniqueName: \"kubernetes.io/projected/381cf0fb-d930-4210-8caa-71261ba5e0d6-kube-api-access-v68m7\") pod \"multus-d8fcn\" (UID: \"381cf0fb-d930-4210-8caa-71261ba5e0d6\") " pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.533747 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.533638    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm77x\" (UniqueName: \"kubernetes.io/projected/c8f92073-6622-4825-8f48-ec08f7bff5ef-kube-api-access-cm77x\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:53.533747 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.533715    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrzg4\" (UniqueName: \"kubernetes.io/projected/a9c5c6fb-e39c-462d-ae2d-4b8eff260b07-kube-api-access-wrzg4\") pod \"tuned-2g2tf\" (UID: \"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07\") " pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.535659 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.535639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmws\" (UniqueName: \"kubernetes.io/projected/922be084-872e-466e-9b68-f447707d3999-kube-api-access-tmmws\") pod \"iptables-alerter-7kjk8\" (UID: \"922be084-872e-466e-9b68-f447707d3999\") " pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.535744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.535671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcgtl\" (UniqueName: \"kubernetes.io/projected/b93cfc3c-e1f9-43db-945a-15a8992d02c6-kube-api-access-vcgtl\") pod \"multus-additional-cni-plugins-mqngn\" (UID: \"b93cfc3c-e1f9-43db-945a-15a8992d02c6\") " pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.605459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.605424    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6wbkd"
Sep 18 22:16:53.613833 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.613811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ghg7l"
Sep 18 22:16:53.622649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.622627    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:16:53.629440 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.629418    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7"
Sep 18 22:16:53.637179 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.637162    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2g2tf"
Sep 18 22:16:53.644798 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.644763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8fcn"
Sep 18 22:16:53.653409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.653388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7kjk8"
Sep 18 22:16:53.661075 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.661053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:16:53.667685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.667662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqngn"
Sep 18 22:16:53.923936 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:53.923850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:53.924097 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.924005    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:53.924097 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:53.924089    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret podName:fb35237d-fa0a-4732-9f7a-64783a41bcbf nodeName:}" failed. No retries permitted until 2026-09-18 22:16:54.924069051 +0000 UTC m=+5.502014184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret") pod "global-pull-secret-syncer-qfmqn" (UID: "fb35237d-fa0a-4732-9f7a-64783a41bcbf") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:54.024635 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:54.024591    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:54.024836 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.024736    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:54.024836 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.024817    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:16:55.024802144 +0000 UTC m=+5.602747287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:54.125497 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:54.125462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:54.125651 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.125590    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:16:54.125651 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.125607    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:16:54.125651 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.125616    2570 projected.go:196] Error preparing data for projected volume kube-api-access-mdqf8 for pod openshift-network-diagnostics/network-check-target-4g5cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:54.125758 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.125665    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8 podName:62680257-0184-4adc-a796-610d2149fbff nodeName:}" failed. No retries permitted until 2026-09-18 22:16:55.125652164 +0000 UTC m=+5.703597301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdqf8" (UniqueName: "kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8") pod "network-check-target-4g5cx" (UID: "62680257-0184-4adc-a796-610d2149fbff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:54.354905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:54.354820    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 22:11:53 +0000 UTC" deadline="2028-06-17 15:17:32.481892336 +0000 UTC"
Sep 18 22:16:54.354905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:54.354859    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15305h0m38.1270379s"
Sep 18 22:16:54.397028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:54.396997    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:54.397177 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.397122    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:16:54.437994 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.437959    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93cfc3c_e1f9_43db_945a_15a8992d02c6.slice/crio-cfb10a552d3b3faafe085705057bd9b75d4d9db0aea63d5b749fc479fbf83913 WatchSource:0}: Error finding container cfb10a552d3b3faafe085705057bd9b75d4d9db0aea63d5b749fc479fbf83913: Status 404 returned error can't find the container with id cfb10a552d3b3faafe085705057bd9b75d4d9db0aea63d5b749fc479fbf83913
Sep 18 22:16:54.439097 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.439073    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381cf0fb_d930_4210_8caa_71261ba5e0d6.slice/crio-f730dc1a7595d0d37a45c98f216934a7ee7702ad38b94b6c9303c3571adbe9d5 WatchSource:0}: Error finding container f730dc1a7595d0d37a45c98f216934a7ee7702ad38b94b6c9303c3571adbe9d5: Status 404 returned error can't find the container with id f730dc1a7595d0d37a45c98f216934a7ee7702ad38b94b6c9303c3571adbe9d5
Sep 18 22:16:54.443107 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.443084    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6d6f80_59ad_457e_b964_5cd20aa3d4e2.slice/crio-4bc255662439ea6c1f35056bc749bc764abc26161847f5d6d0f5189e34006c88 WatchSource:0}: Error finding container 4bc255662439ea6c1f35056bc749bc764abc26161847f5d6d0f5189e34006c88: Status 404 returned error can't find the container with id 4bc255662439ea6c1f35056bc749bc764abc26161847f5d6d0f5189e34006c88
Sep 18 22:16:54.443913 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.443890    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c5c6fb_e39c_462d_ae2d_4b8eff260b07.slice/crio-b5570b2cb35db1a65c4847a0888378d76a262d3f83fbb96f307a788501b0dc37 WatchSource:0}: Error finding container b5570b2cb35db1a65c4847a0888378d76a262d3f83fbb96f307a788501b0dc37: Status 404 returned error can't find the container with id b5570b2cb35db1a65c4847a0888378d76a262d3f83fbb96f307a788501b0dc37
Sep 18 22:16:54.445416 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.445246    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922be084_872e_466e_9b68_f447707d3999.slice/crio-3d4443801f24315ceddf6341bd216cc4fcf18d6be9810e1ba62b3cce01f249ee WatchSource:0}: Error finding container 3d4443801f24315ceddf6341bd216cc4fcf18d6be9810e1ba62b3cce01f249ee: Status 404 returned error can't find the container with id 3d4443801f24315ceddf6341bd216cc4fcf18d6be9810e1ba62b3cce01f249ee
Sep 18 22:16:54.446325 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.446303    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761ea664_e76a_468f_82b2_3bc1b4107204.slice/crio-4625fd0247e8d9273143ba4367e11a384224650321668f13c71cc8be825d58f7 WatchSource:0}: Error finding container 4625fd0247e8d9273143ba4367e11a384224650321668f13c71cc8be825d58f7: Status 404 returned error can't find the container with id 4625fd0247e8d9273143ba4367e11a384224650321668f13c71cc8be825d58f7
Sep 18 22:16:54.447253 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.447230    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf765131_c9a6_49d3_8707_daecd8fd59d1.slice/crio-e6d31965ca4f799672ab257b084f3e4b71e2ff17bc1b2d20b3ea1dd11dad5362 WatchSource:0}: Error finding container e6d31965ca4f799672ab257b084f3e4b71e2ff17bc1b2d20b3ea1dd11dad5362: Status 404 returned error can't find the container with id e6d31965ca4f799672ab257b084f3e4b71e2ff17bc1b2d20b3ea1dd11dad5362
Sep 18 22:16:54.448090 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.448068    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da85a87_b538_439c_bb22_7d6614f772a8.slice/crio-50a03db5da3ad06b83e1573d06b1d5b5f71a1ea7b600e317ab9470a6f652f93a WatchSource:0}: Error finding container 50a03db5da3ad06b83e1573d06b1d5b5f71a1ea7b600e317ab9470a6f652f93a: Status 404 returned error can't find the container with id 50a03db5da3ad06b83e1573d06b1d5b5f71a1ea7b600e317ab9470a6f652f93a
Sep 18 22:16:54.448960 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:16:54.448703    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb362af33_b609_4f55_9095_654350ac2f6a.slice/crio-7355c3b5c3ec473ec00b680e20e4afc5f6298b3fe9bc4cd35d51c0889a585ecc WatchSource:0}: Error finding container 7355c3b5c3ec473ec00b680e20e4afc5f6298b3fe9bc4cd35d51c0889a585ecc: Status 404 returned error can't find the container with id 7355c3b5c3ec473ec00b680e20e4afc5f6298b3fe9bc4cd35d51c0889a585ecc
Sep 18 22:16:54.932413 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:54.932087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:54.932413 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.932332    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:54.932413 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:54.932410    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret podName:fb35237d-fa0a-4732-9f7a-64783a41bcbf nodeName:}" failed. No retries permitted until 2026-09-18 22:16:56.932388911 +0000 UTC m=+7.510334048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret") pod "global-pull-secret-syncer-qfmqn" (UID: "fb35237d-fa0a-4732-9f7a-64783a41bcbf") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:55.033810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.033232    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:55.033810 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.033421    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:55.033810 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.033483    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:16:57.033465024 +0000 UTC m=+7.611410150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:55.134230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.134187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:55.134432 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.134409    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:16:55.134432 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.134431    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:16:55.134543 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.134443    2570 projected.go:196] Error preparing data for projected volume kube-api-access-mdqf8 for pod openshift-network-diagnostics/network-check-target-4g5cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:55.134543 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.134500    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8 podName:62680257-0184-4adc-a796-610d2149fbff nodeName:}" failed. No retries permitted until 2026-09-18 22:16:57.134483813 +0000 UTC m=+7.712428943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdqf8" (UniqueName: "kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8") pod "network-check-target-4g5cx" (UID: "62680257-0184-4adc-a796-610d2149fbff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:55.355715 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.355560    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 22:11:53 +0000 UTC" deadline="2028-03-27 19:51:50.994712312 +0000 UTC"
Sep 18 22:16:55.355715 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.355620    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13341h34m55.639096881s"
Sep 18 22:16:55.400127 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.399358    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:55.400127 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.399493    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:16:55.400127 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.399889    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:55.400127 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:55.399990    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:16:55.439836 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.439369    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal" event={"ID":"e0e3881ed91595ba0bbb3df028072a67","Type":"ContainerStarted","Data":"386c9a00d889efd4c4a7ee5e1d132a254d9380eb52c1c6c3bd8c3e8df8b2dcf9"}
Sep 18 22:16:55.449595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.449498    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7" event={"ID":"b362af33-b609-4f55-9095-654350ac2f6a","Type":"ContainerStarted","Data":"7355c3b5c3ec473ec00b680e20e4afc5f6298b3fe9bc4cd35d51c0889a585ecc"}
Sep 18 22:16:55.459630 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.459561    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghg7l" event={"ID":"3da85a87-b538-439c-bb22-7d6614f772a8","Type":"ContainerStarted","Data":"50a03db5da3ad06b83e1573d06b1d5b5f71a1ea7b600e317ab9470a6f652f93a"}
Sep 18 22:16:55.466880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.466694    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"e6d31965ca4f799672ab257b084f3e4b71e2ff17bc1b2d20b3ea1dd11dad5362"}
Sep 18 22:16:55.485293 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.485229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7kjk8" event={"ID":"922be084-872e-466e-9b68-f447707d3999","Type":"ContainerStarted","Data":"3d4443801f24315ceddf6341bd216cc4fcf18d6be9810e1ba62b3cce01f249ee"}
Sep 18 22:16:55.499603 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.499569    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6wbkd" event={"ID":"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2","Type":"ContainerStarted","Data":"4bc255662439ea6c1f35056bc749bc764abc26161847f5d6d0f5189e34006c88"}
Sep 18 22:16:55.502850 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.502799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerStarted","Data":"cfb10a552d3b3faafe085705057bd9b75d4d9db0aea63d5b749fc479fbf83913"}
Sep 18 22:16:55.514570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.514539    2570 generic.go:356] "Generic (PLEG): container finished" podID="52187890db8f3c4806772b995bc76a6c" containerID="b1c23213c389bc28b674ba2162a94e2dc6a90a9e2bdd179f8617aec337b855f4" exitCode=0
Sep 18 22:16:55.514689 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.514620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" event={"ID":"52187890db8f3c4806772b995bc76a6c","Type":"ContainerDied","Data":"b1c23213c389bc28b674ba2162a94e2dc6a90a9e2bdd179f8617aec337b855f4"}
Sep 18 22:16:55.521157 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.521130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gblr7" event={"ID":"761ea664-e76a-468f-82b2-3bc1b4107204","Type":"ContainerStarted","Data":"4625fd0247e8d9273143ba4367e11a384224650321668f13c71cc8be825d58f7"}
Sep 18 22:16:55.526934 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.526904    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2g2tf" event={"ID":"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07","Type":"ContainerStarted","Data":"b5570b2cb35db1a65c4847a0888378d76a262d3f83fbb96f307a788501b0dc37"}
Sep 18 22:16:55.533564 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.532685    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal" podStartSLOduration=3.532665975 podStartE2EDuration="3.532665975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:16:55.45776501 +0000 UTC m=+6.035710158" watchObservedRunningTime="2026-09-18 22:16:55.532665975 +0000 UTC m=+6.110611121"
Sep 18 22:16:55.561476 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:55.561395    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8fcn" event={"ID":"381cf0fb-d930-4210-8caa-71261ba5e0d6","Type":"ContainerStarted","Data":"f730dc1a7595d0d37a45c98f216934a7ee7702ad38b94b6c9303c3571adbe9d5"}
Sep 18 22:16:56.397296 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:56.397264    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:56.397836 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:56.397411    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:16:56.574513 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:56.574447    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" event={"ID":"52187890db8f3c4806772b995bc76a6c","Type":"ContainerStarted","Data":"cae22ccae29de3cb9e79a5c2094f6460e9a81dbf07dd3774ef407a553f283ffb"}
Sep 18 22:16:56.948291 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:56.948248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:56.948534 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:56.948408    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:56.948534 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:56.948475    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret podName:fb35237d-fa0a-4732-9f7a-64783a41bcbf nodeName:}" failed. No retries permitted until 2026-09-18 22:17:00.948458028 +0000 UTC m=+11.526403167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret") pod "global-pull-secret-syncer-qfmqn" (UID: "fb35237d-fa0a-4732-9f7a-64783a41bcbf") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:16:57.049542 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:57.049504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:57.049806 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.049691    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:57.049806 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.049768    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:17:01.04975093 +0000 UTC m=+11.627696065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:16:57.150249 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:57.150214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:57.150434 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.150413    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:16:57.150434 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.150433    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:16:57.150553 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.150447    2570 projected.go:196] Error preparing data for projected volume kube-api-access-mdqf8 for pod openshift-network-diagnostics/network-check-target-4g5cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:57.150553 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.150508    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8 podName:62680257-0184-4adc-a796-610d2149fbff nodeName:}" failed. No retries permitted until 2026-09-18 22:17:01.150489447 +0000 UTC m=+11.728434574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdqf8" (UniqueName: "kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8") pod "network-check-target-4g5cx" (UID: "62680257-0184-4adc-a796-610d2149fbff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:16:57.398089 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:57.397997    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:57.398089 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:57.398065    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:57.398635 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.398194    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:16:57.398696 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:57.398632    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:16:58.396874 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:58.396829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:16:58.397023 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:58.396979    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:16:59.399237 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:59.398797    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:16:59.399237 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:59.398949    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:16:59.399237 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:16:59.399039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:16:59.399237 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:16:59.399166    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:00.397045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:00.397008    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:00.397244 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:00.397141    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:00.982514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:00.982463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:00.982983 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:00.982622    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:17:00.982983 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:00.982690    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret podName:fb35237d-fa0a-4732-9f7a-64783a41bcbf nodeName:}" failed. No retries permitted until 2026-09-18 22:17:08.98267121 +0000 UTC m=+19.560616336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret") pod "global-pull-secret-syncer-qfmqn" (UID: "fb35237d-fa0a-4732-9f7a-64783a41bcbf") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:17:01.083253 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:01.083215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:01.083434 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.083376    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:17:01.083495 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.083458    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:17:09.083429145 +0000 UTC m=+19.661374291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:17:01.183945 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:01.183909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:01.184123 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.184079    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:17:01.184123 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.184100    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:17:01.184123 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.184112    2570 projected.go:196] Error preparing data for projected volume kube-api-access-mdqf8 for pod openshift-network-diagnostics/network-check-target-4g5cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:17:01.184266 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.184169    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8 podName:62680257-0184-4adc-a796-610d2149fbff nodeName:}" failed. No retries permitted until 2026-09-18 22:17:09.184154643 +0000 UTC m=+19.762099766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdqf8" (UniqueName: "kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8") pod "network-check-target-4g5cx" (UID: "62680257-0184-4adc-a796-610d2149fbff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:17:01.399328 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:01.397795    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:01.399328 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.397912    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:01.399328 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:01.398313    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:01.399328 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:01.398387    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:02.396636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:02.396596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:02.397132 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:02.396747    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:03.397883 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:03.397848    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:03.398329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:03.397897    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:03.398329 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:03.397981    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:03.398329 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:03.398098    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:04.396451 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:04.396413    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:04.396725 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:04.396540    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:05.396527 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:05.396486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:05.397015 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:05.396541    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:05.397015 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:05.396638    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:05.397015 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:05.396689    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:06.396552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:06.396512    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:06.397002 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:06.396634    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:07.396524 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:07.396488    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:07.396695 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:07.396635    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:07.397101 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:07.396687    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:07.397101 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:07.396817    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:08.397477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:08.397438    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:08.397921 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:08.397560    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:09.046563 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:09.046530    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:09.046735 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.046689    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:17:09.046834 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.046755    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret podName:fb35237d-fa0a-4732-9f7a-64783a41bcbf nodeName:}" failed. No retries permitted until 2026-09-18 22:17:25.046740457 +0000 UTC m=+35.624685583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret") pod "global-pull-secret-syncer-qfmqn" (UID: "fb35237d-fa0a-4732-9f7a-64783a41bcbf") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:17:09.147707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:09.147676    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:09.147915 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.147853    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:17:09.147982 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.147937    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:17:25.147916143 +0000 UTC m=+35.725861273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:17:09.248676 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:09.248641    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:09.248887 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.248842    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:17:09.248887 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.248867    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:17:09.248887 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.248881    2570 projected.go:196] Error preparing data for projected volume kube-api-access-mdqf8 for pod openshift-network-diagnostics/network-check-target-4g5cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:17:09.249040 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.248945    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8 podName:62680257-0184-4adc-a796-610d2149fbff nodeName:}" failed. No retries permitted until 2026-09-18 22:17:25.248927383 +0000 UTC m=+35.826872523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdqf8" (UniqueName: "kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8") pod "network-check-target-4g5cx" (UID: "62680257-0184-4adc-a796-610d2149fbff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:17:09.396848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:09.396734    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:09.397006 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.396890    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:09.397006 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:09.396946    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:09.397097 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:09.397076    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:10.397134 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:10.397093    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:10.397543 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:10.397206    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:11.398186 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:11.398152    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:11.398597 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:11.398279    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:11.398597 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:11.398337    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:11.398597 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:11.398437    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:12.396752 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.396592    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:12.396885 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:12.396865    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:12.607837 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.607665    2570 generic.go:356] "Generic (PLEG): container finished" podID="b93cfc3c-e1f9-43db-945a-15a8992d02c6" containerID="9fc56b82caebab666b329159828dbda1461f660a1b71e933d483054028bdb740" exitCode=0
Sep 18 22:17:12.607837 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.607762    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerDied","Data":"9fc56b82caebab666b329159828dbda1461f660a1b71e933d483054028bdb740"}
Sep 18 22:17:12.610037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.610001    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gblr7" event={"ID":"761ea664-e76a-468f-82b2-3bc1b4107204","Type":"ContainerStarted","Data":"cceb21d7fe935ad5a900ab5d0797a76207fbcba6b275ec347ed1c97856ae97fb"}
Sep 18 22:17:12.611877 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.611847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2g2tf" event={"ID":"a9c5c6fb-e39c-462d-ae2d-4b8eff260b07","Type":"ContainerStarted","Data":"944601985aae8ccc76b0cf704ddc4c4985de4ec4964c4c3ef9130fc9b68a3012"}
Sep 18 22:17:12.613753 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.613724    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8fcn" event={"ID":"381cf0fb-d930-4210-8caa-71261ba5e0d6","Type":"ContainerStarted","Data":"764667e3e2b18dca25191a59f6631e39e9043817ca5038bf8bab68778f7c9062"}
Sep 18 22:17:12.615516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.615491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7" event={"ID":"b362af33-b609-4f55-9095-654350ac2f6a","Type":"ContainerStarted","Data":"05cf3dd3b69f21e6eb541cb1790ae99f7317caf240ec634208886199a325067e"}
Sep 18 22:17:12.616905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.616874    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ghg7l" event={"ID":"3da85a87-b538-439c-bb22-7d6614f772a8","Type":"ContainerStarted","Data":"686d52c5071f6c5bafbc9cfa721cdbfdcbcd20058a14bd870c032dbcbf47fec9"}
Sep 18 22:17:12.618891 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.618871    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:17:12.619255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.619238    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf765131-c9a6-49d3-8707-daecd8fd59d1" containerID="a0c778eb0ab9b31244a3abf1d01d778bfbd0d57f163ae5899165f64c4da2fa31" exitCode=1
Sep 18 22:17:12.619335 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.619314    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"8100f0783aa460aa214c0c9dfe51f53b5da3843841fb1a0663a79c042f37df02"}
Sep 18 22:17:12.619398 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.619372    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerDied","Data":"a0c778eb0ab9b31244a3abf1d01d778bfbd0d57f163ae5899165f64c4da2fa31"}
Sep 18 22:17:12.619447 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.619421    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"7246c66f96db0a36f29e82cbe1e48a501f9d1a1f991b4c8a6baa9ad102932fb2"}
Sep 18 22:17:12.620740 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.620721    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6wbkd" event={"ID":"bf6d6f80-59ad-457e-b964-5cd20aa3d4e2","Type":"ContainerStarted","Data":"5919b9ffedc652ffda21ba6d04e1e789bc0d5617553ed460699c63b3ea2ef601"}
Sep 18 22:17:12.631468 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.631420    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" podStartSLOduration=20.631407196 podStartE2EDuration="20.631407196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:16:56.592901971 +0000 UTC m=+7.170847117" watchObservedRunningTime="2026-09-18 22:17:12.631407196 +0000 UTC m=+23.209352342"
Sep 18 22:17:12.647190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.647149    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gblr7" podStartSLOduration=7.835998497 podStartE2EDuration="21.647134367s" totalImagesPullingTime="13.81113587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:12.646878155 +0000 UTC m=+23.224823304" watchObservedRunningTime="2026-09-18 22:17:12.647134367 +0000 UTC m=+23.225079519"
Sep 18 22:17:12.666727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.666685    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2g2tf" podStartSLOduration=4.027053794 podStartE2EDuration="21.666670799s" totalImagesPullingTime="17.639617005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:12.666532997 +0000 UTC m=+23.244478142" watchObservedRunningTime="2026-09-18 22:17:12.666670799 +0000 UTC m=+23.244615944"
Sep 18 22:17:12.684038 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.683996    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d8fcn" podStartSLOduration=4.03326919 podStartE2EDuration="21.683982538s" totalImagesPullingTime="17.650713348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:12.683397855 +0000 UTC m=+23.261342999" watchObservedRunningTime="2026-09-18 22:17:12.683982538 +0000 UTC m=+23.261927683"
Sep 18 22:17:12.699702 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:12.699656    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6wbkd" podStartSLOduration=4.09432648 podStartE2EDuration="21.699639023s" totalImagesPullingTime="17.605312543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:12.698704416 +0000 UTC m=+23.276649562" watchObservedRunningTime="2026-09-18 22:17:12.699639023 +0000 UTC m=+23.277584168"
Sep 18 22:17:13.397022 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.396993    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:13.397199 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:13.397120    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:13.397199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.397176    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:13.397324 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:13.397298    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:13.450195 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.450166    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 22:17:13.626010 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.625924    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7" event={"ID":"b362af33-b609-4f55-9095-654350ac2f6a","Type":"ContainerStarted","Data":"a7c70557d8b077782e2a6ccd85c1c75550147a08a4f9e6d888a04dd4391bd2c5"}
Sep 18 22:17:13.629394 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.629370    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:17:13.629885 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.629860    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"8c2e77b8bb41dbc648a517d1c581837c8bbfeae76d66d0f92cd8cbc407e1a258"}
Sep 18 22:17:13.629996 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.629947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"cfcecc4491b46abfb8166ca238ac571066c7099f15aeeb24df29cb0226a9b98b"}
Sep 18 22:17:13.630049 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.629997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"0d7559f307f8192363d9a44b88be219a9c70a09869e879a571a0cbabfdbf29e7"}
Sep 18 22:17:13.631464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.631436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7kjk8" event={"ID":"922be084-872e-466e-9b68-f447707d3999","Type":"ContainerStarted","Data":"c41663f998bfdfbd46db675535016dd53ea77c4bd1ecd208c68c9c16e4d88e1c"}
Sep 18 22:17:13.647003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.646964    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7kjk8" podStartSLOduration=5.007249869 podStartE2EDuration="22.646951533s" totalImagesPullingTime="17.639701664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:13.646891775 +0000 UTC m=+24.224836920" watchObservedRunningTime="2026-09-18 22:17:13.646951533 +0000 UTC m=+24.224896678"
Sep 18 22:17:13.647155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:13.647129    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ghg7l" podStartSLOduration=5.046902818 podStartE2EDuration="22.647120082s" totalImagesPullingTime="17.600217264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:12.72986655 +0000 UTC m=+23.307811694" watchObservedRunningTime="2026-09-18 22:17:13.647120082 +0000 UTC m=+24.225065229"
Sep 18 22:17:14.374693 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:14.374569    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T22:17:13.450188931Z","UUID":"5e64be73-c6af-4eb6-89ab-d09baa2068e1","Handler":null,"Name":"","Endpoint":""}
Sep 18 22:17:14.376053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:14.376033    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 22:17:14.376174 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:14.376067    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 22:17:14.397111 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:14.397089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:14.397245 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:14.397201    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:14.636443 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:14.636354    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7" event={"ID":"b362af33-b609-4f55-9095-654350ac2f6a","Type":"ContainerStarted","Data":"bc69287d87a7e0e083c8c9a88dc540449a6f679436af6545a22ecfaf1a3fcbec"}
Sep 18 22:17:14.654602 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:14.654557    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmlq7" podStartSLOduration=4.092209976 podStartE2EDuration="23.654538855s" totalImagesPullingTime="19.562328879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:14.654072607 +0000 UTC m=+25.232017753" watchObservedRunningTime="2026-09-18 22:17:14.654538855 +0000 UTC m=+25.232484000"
Sep 18 22:17:15.396975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:15.396946    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:15.397128 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:15.397064    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:15.397128 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:15.397119    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:15.397221 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:15.397203    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:15.646220 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:15.646191    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:17:15.646704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:15.646675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"7709d75164b8f6ca3a50ab6430bf41772a3ae011939da5ce608ac83fb343809e"}
Sep 18 22:17:16.396573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:16.396541    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:16.396739 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:16.396672    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:17.188101 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.188071    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:17:17.188906 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.188886    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:17:17.397577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.397426    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:17.397687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.397502    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:17.397687 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:17.397663    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:17.397795 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:17.397760    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:17.654740 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.654668    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:17:17.656973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.656942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"669fc1e67865eb9dfca3cdce7d044bd40c798465018c383bfbebd4c4a53c456d"}
Sep 18 22:17:17.657358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.657251    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:17:17.657358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.657315    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:17:17.657617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.657443    2570 scope.go:117] "RemoveContainer" containerID="a0c778eb0ab9b31244a3abf1d01d778bfbd0d57f163ae5899165f64c4da2fa31"
Sep 18 22:17:17.659483 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.659461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerStarted","Data":"ab26fee4031f1cd1a61079c349736dc1827143d30ec51379e693571669b63b8a"}
Sep 18 22:17:17.675983 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:17.675965    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:17:18.396566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.396531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:18.397232 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:18.396632    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:18.668859 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.668762    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:17:18.669254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.669223    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" event={"ID":"cf765131-c9a6-49d3-8707-daecd8fd59d1","Type":"ContainerStarted","Data":"8b20509d61156cfc0021f10c8e54e9a5cc6e2499eb60f7d3dc7fad87171c8ba0"}
Sep 18 22:17:18.670658 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.670629    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:17:18.673399 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.673371    2570 generic.go:356] "Generic (PLEG): container finished" podID="b93cfc3c-e1f9-43db-945a-15a8992d02c6" containerID="ab26fee4031f1cd1a61079c349736dc1827143d30ec51379e693571669b63b8a" exitCode=0
Sep 18 22:17:18.673493 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.673409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerDied","Data":"ab26fee4031f1cd1a61079c349736dc1827143d30ec51379e693571669b63b8a"}
Sep 18 22:17:18.702801 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.701389    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:17:18.721123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:18.721076    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7" podStartSLOduration=10.02336434 podStartE2EDuration="27.721058999s" totalImagesPullingTime="17.697694659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:18.700961065 +0000 UTC m=+29.278906211" watchObservedRunningTime="2026-09-18 22:17:18.721058999 +0000 UTC m=+29.299004144"
Sep 18 22:17:19.293599 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:19.293567    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qfmqn"]
Sep 18 22:17:19.293805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:19.293687    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:19.293877 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:19.293802    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:19.298029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:19.296968    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rdzh"]
Sep 18 22:17:19.298029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:19.297085    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:19.298029 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:19.297193    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:19.298029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:19.297695    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g5cx"]
Sep 18 22:17:19.298029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:19.297805    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:19.298029 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:19.297895    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:20.136833 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:20.136744    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:17:20.137259 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:20.136912    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 22:17:20.137339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:20.137325    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gblr7"
Sep 18 22:17:20.397032 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:20.396961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:20.397218 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:20.397062    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:20.680498 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:20.680413    2570 generic.go:356] "Generic (PLEG): container finished" podID="b93cfc3c-e1f9-43db-945a-15a8992d02c6" containerID="6ffe6e5a385974fcfa92088916c6765c60278cc42b3df07dcf905b1939c84335" exitCode=0
Sep 18 22:17:20.680498 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:20.680458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerDied","Data":"6ffe6e5a385974fcfa92088916c6765c60278cc42b3df07dcf905b1939c84335"}
Sep 18 22:17:21.396494 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:21.396423    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:21.396941 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:21.396561    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:21.396941 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:21.396658    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:21.396941 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:21.396556    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:21.686413 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:21.686383    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerStarted","Data":"e61acf0fbf145a4a148c9296d4e97e2ffc8324c2f551649076ac9c735e64dde9"}
Sep 18 22:17:22.397072 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:22.397042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:22.397496 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:22.397147    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:22.691467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:22.691389    2570 generic.go:356] "Generic (PLEG): container finished" podID="b93cfc3c-e1f9-43db-945a-15a8992d02c6" containerID="e61acf0fbf145a4a148c9296d4e97e2ffc8324c2f551649076ac9c735e64dde9" exitCode=0
Sep 18 22:17:22.691467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:22.691435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerDied","Data":"e61acf0fbf145a4a148c9296d4e97e2ffc8324c2f551649076ac9c735e64dde9"}
Sep 18 22:17:23.397541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:23.397443    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:23.398006 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:23.397451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:23.398006 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:23.397604    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qfmqn" podUID="fb35237d-fa0a-4732-9f7a-64783a41bcbf"
Sep 18 22:17:23.398006 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:23.397664    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4g5cx" podUID="62680257-0184-4adc-a796-610d2149fbff"
Sep 18 22:17:23.956545 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:23.956511    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:24.050250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:24.050215    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:24.396678 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:24.396648    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:24.396920 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:24.396773    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rdzh" podUID="c8f92073-6622-4825-8f48-ec08f7bff5ef"
Sep 18 22:17:24.974926 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:24.974893    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeReady"
Sep 18 22:17:24.975364 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:24.975064    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 22:17:25.032871 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.032794    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7dw4r"]
Sep 18 22:17:25.051304 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.051262    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pkvmd"]
Sep 18 22:17:25.051471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.051395    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.053956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.053932    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lv824\""
Sep 18 22:17:25.054111 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.054092    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 22:17:25.054209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.054193    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 22:17:25.054324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.054309    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 22:17:25.063307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.063280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:25.063428 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.063414    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:17:25.063490 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.063478    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret podName:fb35237d-fa0a-4732-9f7a-64783a41bcbf nodeName:}" failed. No retries permitted until 2026-09-18 22:17:57.06346083 +0000 UTC m=+67.641405961 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret") pod "global-pull-secret-syncer-qfmqn" (UID: "fb35237d-fa0a-4732-9f7a-64783a41bcbf") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:17:25.070653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.070626    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pkvmd"]
Sep 18 22:17:25.070756 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.070671    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7dw4r"]
Sep 18 22:17:25.070756 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.070717    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.073168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.073013    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 22:17:25.073168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.073023    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 22:17:25.073168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.073025    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gtntj\""
Sep 18 22:17:25.164508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.164478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4629738c-7cd1-4d11-bd40-b984ba28aa39-config-volume\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.164508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.164513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxl7k\" (UniqueName: \"kubernetes.io/projected/abd43bb6-c6d0-44fa-a636-d6154185132d-kube-api-access-hxl7k\") pod \"ingress-canary-7dw4r\" (UID: \"abd43bb6-c6d0-44fa-a636-d6154185132d\") " pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.164723 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.164563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4629738c-7cd1-4d11-bd40-b984ba28aa39-tmp-dir\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.164723 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.164630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd43bb6-c6d0-44fa-a636-d6154185132d-cert\") pod \"ingress-canary-7dw4r\" (UID: \"abd43bb6-c6d0-44fa-a636-d6154185132d\") " pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.164723 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.164701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:25.164873 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.164743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpt49\" (UniqueName: \"kubernetes.io/projected/4629738c-7cd1-4d11-bd40-b984ba28aa39-kube-api-access-hpt49\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.164873 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.164806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.164956 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.164874    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:17:25.164956 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.164932    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:17:57.164918265 +0000 UTC m=+67.742863388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:17:25.265446 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4629738c-7cd1-4d11-bd40-b984ba28aa39-config-volume\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.265446 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxl7k\" (UniqueName: \"kubernetes.io/projected/abd43bb6-c6d0-44fa-a636-d6154185132d-kube-api-access-hxl7k\") pod \"ingress-canary-7dw4r\" (UID: \"abd43bb6-c6d0-44fa-a636-d6154185132d\") " pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.265670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:25.265670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4629738c-7cd1-4d11-bd40-b984ba28aa39-tmp-dir\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.265670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd43bb6-c6d0-44fa-a636-d6154185132d-cert\") pod \"ingress-canary-7dw4r\" (UID: \"abd43bb6-c6d0-44fa-a636-d6154185132d\") " pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.265670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpt49\" (UniqueName: \"kubernetes.io/projected/4629738c-7cd1-4d11-bd40-b984ba28aa39-kube-api-access-hpt49\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.265670 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.265653    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:17:25.265670 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.265673    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:17:25.265966 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.265702    2570 projected.go:196] Error preparing data for projected volume kube-api-access-mdqf8 for pod openshift-network-diagnostics/network-check-target-4g5cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:17:25.265966 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.265766    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8 podName:62680257-0184-4adc-a796-610d2149fbff nodeName:}" failed. No retries permitted until 2026-09-18 22:17:57.265749125 +0000 UTC m=+67.843694251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mdqf8" (UniqueName: "kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8") pod "network-check-target-4g5cx" (UID: "62680257-0184-4adc-a796-610d2149fbff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:17:25.265966 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.265966 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.265879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4629738c-7cd1-4d11-bd40-b984ba28aa39-tmp-dir\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.265966 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.265921    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:17:25.266154 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.265977    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls podName:4629738c-7cd1-4d11-bd40-b984ba28aa39 nodeName:}" failed. No retries permitted until 2026-09-18 22:17:25.765963793 +0000 UTC m=+36.343908931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls") pod "dns-default-pkvmd" (UID: "4629738c-7cd1-4d11-bd40-b984ba28aa39") : secret "dns-default-metrics-tls" not found
Sep 18 22:17:25.266154 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.266086    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4629738c-7cd1-4d11-bd40-b984ba28aa39-config-volume\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.269935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.269905    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd43bb6-c6d0-44fa-a636-d6154185132d-cert\") pod \"ingress-canary-7dw4r\" (UID: \"abd43bb6-c6d0-44fa-a636-d6154185132d\") " pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.274429 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.274400    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxl7k\" (UniqueName: \"kubernetes.io/projected/abd43bb6-c6d0-44fa-a636-d6154185132d-kube-api-access-hxl7k\") pod \"ingress-canary-7dw4r\" (UID: \"abd43bb6-c6d0-44fa-a636-d6154185132d\") " pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.274970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.274950    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpt49\" (UniqueName: \"kubernetes.io/projected/4629738c-7cd1-4d11-bd40-b984ba28aa39-kube-api-access-hpt49\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.363914 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.363874    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7dw4r"
Sep 18 22:17:25.400022 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.399987    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:25.400241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.400211    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:25.402462 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.402441    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 22:17:25.402589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.402478    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-95pvs\""
Sep 18 22:17:25.402589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.402524    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 22:17:25.402589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.402478    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 22:17:25.769536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:25.769460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:25.769811 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.769629    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:17:25.769811 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:25.769704    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls podName:4629738c-7cd1-4d11-bd40-b984ba28aa39 nodeName:}" failed. No retries permitted until 2026-09-18 22:17:26.769685378 +0000 UTC m=+37.347630505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls") pod "dns-default-pkvmd" (UID: "4629738c-7cd1-4d11-bd40-b984ba28aa39") : secret "dns-default-metrics-tls" not found
Sep 18 22:17:26.397131 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:26.397098    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:26.400066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:26.399840    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 22:17:26.400066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:26.399858    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dq7t2\""
Sep 18 22:17:26.778079 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:26.778007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:26.778211 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:26.778119    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:17:26.778211 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:26.778176    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls podName:4629738c-7cd1-4d11-bd40-b984ba28aa39 nodeName:}" failed. No retries permitted until 2026-09-18 22:17:28.778161469 +0000 UTC m=+39.356106605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls") pod "dns-default-pkvmd" (UID: "4629738c-7cd1-4d11-bd40-b984ba28aa39") : secret "dns-default-metrics-tls" not found
Sep 18 22:17:27.119671 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:27.119641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7dw4r"]
Sep 18 22:17:27.141906 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:17:27.141878    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd43bb6_c6d0_44fa_a636_d6154185132d.slice/crio-3151a520951e30e732d6c2da297ffea0067a89e510d7cfe984c09dbc7c48d5ea WatchSource:0}: Error finding container 3151a520951e30e732d6c2da297ffea0067a89e510d7cfe984c09dbc7c48d5ea: Status 404 returned error can't find the container with id 3151a520951e30e732d6c2da297ffea0067a89e510d7cfe984c09dbc7c48d5ea
Sep 18 22:17:27.336868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:27.336662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:27.436969 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:27.436944    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:27.708008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:27.707918    2570 generic.go:356] "Generic (PLEG): container finished" podID="b93cfc3c-e1f9-43db-945a-15a8992d02c6" containerID="bf4a0da0ca18b447604a06522babb75a63c607d68f17f31feb1288c9049f14f2" exitCode=0
Sep 18 22:17:27.708008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:27.707958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerDied","Data":"bf4a0da0ca18b447604a06522babb75a63c607d68f17f31feb1288c9049f14f2"}
Sep 18 22:17:27.709672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:27.709645    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7dw4r" event={"ID":"abd43bb6-c6d0-44fa-a636-d6154185132d","Type":"ContainerStarted","Data":"3151a520951e30e732d6c2da297ffea0067a89e510d7cfe984c09dbc7c48d5ea"}
Sep 18 22:17:27.843163 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:27.843137    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:28.005609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:28.005456    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:28.715765 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:28.715730    2570 generic.go:356] "Generic (PLEG): container finished" podID="b93cfc3c-e1f9-43db-945a-15a8992d02c6" containerID="fe5b3719ce6de45e49e023338911887ba371350a3b0adca0c360581b28bd97b9" exitCode=0
Sep 18 22:17:28.716238 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:28.715814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerDied","Data":"fe5b3719ce6de45e49e023338911887ba371350a3b0adca0c360581b28bd97b9"}
Sep 18 22:17:28.793218 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:28.793183    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:28.793465 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:28.793372    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:17:28.793465 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:28.793447    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls podName:4629738c-7cd1-4d11-bd40-b984ba28aa39 nodeName:}" failed. No retries permitted until 2026-09-18 22:17:32.793423968 +0000 UTC m=+43.371369105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls") pod "dns-default-pkvmd" (UID: "4629738c-7cd1-4d11-bd40-b984ba28aa39") : secret "dns-default-metrics-tls" not found
Sep 18 22:17:28.813518 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:28.813490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:29.031844 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.031708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:29.504541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.504510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:29.569741 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.569706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:29.722260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.722172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqngn" event={"ID":"b93cfc3c-e1f9-43db-945a-15a8992d02c6","Type":"ContainerStarted","Data":"476ac489d04b8ce35a39b9f2fde87e7d4dcd801a518e9a2be3b5d9d365b46b7c"}
Sep 18 22:17:29.723490 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.723461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7dw4r" event={"ID":"abd43bb6-c6d0-44fa-a636-d6154185132d","Type":"ContainerStarted","Data":"f6f017298bf29c5d29b20b59ea97b78fdb2c3fb89b3a97c604e7768fdc721383"}
Sep 18 22:17:29.746774 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.746690    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mqngn" podStartSLOduration=9.859975643 podStartE2EDuration="38.746672664s" totalImagesPullingTime="28.886697021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:29.745270486 +0000 UTC m=+40.323215630" watchObservedRunningTime="2026-09-18 22:17:29.746672664 +0000 UTC m=+40.324617811"
Sep 18 22:17:29.760679 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.760639    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7dw4r" podStartSLOduration=2.496017142 podStartE2EDuration="4.760626428s" totalImagesPullingTime="2.264609286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:29.759763194 +0000 UTC m=+40.337708339" watchObservedRunningTime="2026-09-18 22:17:29.760626428 +0000 UTC m=+40.338571573"
Sep 18 22:17:29.873702 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.873671    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:29.973592 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:29.973523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:32.821083 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:32.821050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:32.821479 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:32.821211    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:17:32.821479 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:32.821293    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls podName:4629738c-7cd1-4d11-bd40-b984ba28aa39 nodeName:}" failed. No retries permitted until 2026-09-18 22:17:40.821270054 +0000 UTC m=+51.399215182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls") pod "dns-default-pkvmd" (UID: "4629738c-7cd1-4d11-bd40-b984ba28aa39") : secret "dns-default-metrics-tls" not found
Sep 18 22:17:35.028682 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:35.028648    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:35.088851 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:35.088821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:36.610369 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:36.610325    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:36.688014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:36.687980    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:40.880412 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:40.877352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:40.880895 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:40.877906    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:17:40.880895 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:40.880855    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls podName:4629738c-7cd1-4d11-bd40-b984ba28aa39 nodeName:}" failed. No retries permitted until 2026-09-18 22:17:56.880833052 +0000 UTC m=+67.458778187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls") pod "dns-default-pkvmd" (UID: "4629738c-7cd1-4d11-bd40-b984ba28aa39") : secret "dns-default-metrics-tls" not found
Sep 18 22:17:49.735297 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:49.735259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:49.794032 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:49.793995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:50.695811 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:50.695756    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnrp7"
Sep 18 22:17:50.858552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:50.858516    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:50.918142 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:50.918117    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:54.814370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.814336    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"]
Sep 18 22:17:54.818982 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.818962    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.821534 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.821510    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 22:17:54.822422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.822401    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jxrrg\""
Sep 18 22:17:54.822422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.822415    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 22:17:54.822727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.822713    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 18 22:17:54.824083 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.824067    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 18 22:17:54.829737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.829718    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"]
Sep 18 22:17:54.879707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.879671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc6c2313-84db-4974-9821-c10d7f800b0f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.879909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.879718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.879909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.879738    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7s4\" (UniqueName: \"kubernetes.io/projected/bc6c2313-84db-4974-9821-c10d7f800b0f-kube-api-access-lh7s4\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.921672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.921639    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"]
Sep 18 22:17:54.924108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.924083    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-685768998d-vj8pc"]
Sep 18 22:17:54.924234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.924132    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:54.926595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.926574    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:54.927401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.927382    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7kmrh\""
Sep 18 22:17:54.927672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.927659    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:17:54.927976 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.927956    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 18 22:17:54.928200 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.928050    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 18 22:17:54.928584 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.928568    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 18 22:17:54.929197 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.929181    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 22:17:54.929286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.929201    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 22:17:54.929286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.929226    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 22:17:54.929556 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.929532    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 22:17:54.929678 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.929590    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 22:17:54.929736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.929680    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qndwt\""
Sep 18 22:17:54.930560 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.930545    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 22:17:54.937911 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.937891    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"]
Sep 18 22:17:54.943026 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.943006    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-685768998d-vj8pc"]
Sep 18 22:17:54.980113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980078    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc6c2313-84db-4974-9821-c10d7f800b0f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.980298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980131    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:54.980298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-stats-auth\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:54.980298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45f0850d-98f6-4875-8f6c-aef91d832769-serving-cert\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:54.980298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.980298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7s4\" (UniqueName: \"kubernetes.io/projected/bc6c2313-84db-4974-9821-c10d7f800b0f-kube-api-access-lh7s4\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.980298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45f0850d-98f6-4875-8f6c-aef91d832769-config\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:54.980576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcfv8\" (UniqueName: \"kubernetes.io/projected/9a9561c5-308e-4618-a8d4-c49745121a7a-kube-api-access-xcfv8\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:54.980576 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:54.980376    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:54.980576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:54.980576 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:54.980458    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls podName:bc6c2313-84db-4974-9821-c10d7f800b0f nodeName:}" failed. No retries permitted until 2026-09-18 22:17:55.480418126 +0000 UTC m=+66.058363267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nxmmw" (UID: "bc6c2313-84db-4974-9821-c10d7f800b0f") : secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:54.980576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-default-certificate\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:54.980576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4shj\" (UniqueName: \"kubernetes.io/projected/45f0850d-98f6-4875-8f6c-aef91d832769-kube-api-access-c4shj\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:54.980903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.980881    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bc6c2313-84db-4974-9821-c10d7f800b0f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:54.996570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:54.996538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7s4\" (UniqueName: \"kubernetes.io/projected/bc6c2313-84db-4974-9821-c10d7f800b0f-kube-api-access-lh7s4\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:55.019948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.019920    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"]
Sep 18 22:17:55.022946 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.022931    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.025659 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.025643    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 18 22:17:55.026088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.026072    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 18 22:17:55.026405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.026303    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 18 22:17:55.026619 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.026394    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:17:55.026683 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.026646    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-24shh\""
Sep 18 22:17:55.041535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.041513    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"]
Sep 18 22:17:55.081462 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.081462 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-default-certificate\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.081626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6551bf-1cdc-445e-87dd-05ab71984d12-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.081626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4shj\" (UniqueName: \"kubernetes.io/projected/45f0850d-98f6-4875-8f6c-aef91d832769-kube-api-access-c4shj\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:55.081626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.081626 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.081546    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:17:55.081853 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081570    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-stats-auth\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.081853 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.081650    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:17:55.581625319 +0000 UTC m=+66.159570447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : secret "router-metrics-certs-default" not found
Sep 18 22:17:55.081853 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.081738    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:17:55.581716199 +0000 UTC m=+66.159661330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : configmap references non-existent config key: service-ca.crt
Sep 18 22:17:55.081853 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081797    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88sjs\" (UniqueName: \"kubernetes.io/projected/1b6551bf-1cdc-445e-87dd-05ab71984d12-kube-api-access-88sjs\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.082034 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45f0850d-98f6-4875-8f6c-aef91d832769-serving-cert\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:55.082034 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45f0850d-98f6-4875-8f6c-aef91d832769-config\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:55.082034 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcfv8\" (UniqueName: \"kubernetes.io/projected/9a9561c5-308e-4618-a8d4-c49745121a7a-kube-api-access-xcfv8\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.082034 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.081956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b6551bf-1cdc-445e-87dd-05ab71984d12-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.082460 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.082440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45f0850d-98f6-4875-8f6c-aef91d832769-config\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:55.084025 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.084002    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45f0850d-98f6-4875-8f6c-aef91d832769-serving-cert\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:55.084504 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.084484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-default-certificate\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.084625 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.084606    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-stats-auth\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.089707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.089685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4shj\" (UniqueName: \"kubernetes.io/projected/45f0850d-98f6-4875-8f6c-aef91d832769-kube-api-access-c4shj\") pod \"service-ca-operator-57cdc4b768-qgnsh\" (UID: \"45f0850d-98f6-4875-8f6c-aef91d832769\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:55.093270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.093248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcfv8\" (UniqueName: \"kubernetes.io/projected/9a9561c5-308e-4618-a8d4-c49745121a7a-kube-api-access-xcfv8\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.133604 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.133559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:55.182803 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.182768    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b6551bf-1cdc-445e-87dd-05ab71984d12-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.182908 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.182838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6551bf-1cdc-445e-87dd-05ab71984d12-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.182908 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.182898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88sjs\" (UniqueName: \"kubernetes.io/projected/1b6551bf-1cdc-445e-87dd-05ab71984d12-kube-api-access-88sjs\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.183325 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.183305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b6551bf-1cdc-445e-87dd-05ab71984d12-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.185133 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.185114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b6551bf-1cdc-445e-87dd-05ab71984d12-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.190693 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.190674    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88sjs\" (UniqueName: \"kubernetes.io/projected/1b6551bf-1cdc-445e-87dd-05ab71984d12-kube-api-access-88sjs\") pod \"kube-storage-version-migrator-operator-55889f7b47-8jq4f\" (UID: \"1b6551bf-1cdc-445e-87dd-05ab71984d12\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.233697 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.233667    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"
Sep 18 22:17:55.234050 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.234028    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:55.333163 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.333085    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"
Sep 18 22:17:55.485726 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.485690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:55.485919 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.485879    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:55.485991 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.485975    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls podName:bc6c2313-84db-4974-9821-c10d7f800b0f nodeName:}" failed. No retries permitted until 2026-09-18 22:17:56.485952595 +0000 UTC m=+67.063897725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nxmmw" (UID: "bc6c2313-84db-4974-9821-c10d7f800b0f") : secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:55.506846 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.506820    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh"]
Sep 18 22:17:55.509993 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:17:55.509969    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f0850d_98f6_4875_8f6c_aef91d832769.slice/crio-12b9902a833253234679acd2b4c98b103a0cc772b67827b23156b61dba64dce1 WatchSource:0}: Error finding container 12b9902a833253234679acd2b4c98b103a0cc772b67827b23156b61dba64dce1: Status 404 returned error can't find the container with id 12b9902a833253234679acd2b4c98b103a0cc772b67827b23156b61dba64dce1
Sep 18 22:17:55.586353 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.586326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.586488 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.586423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:55.586488 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.586469    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:17:55.586556 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.586533    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:17:56.586519781 +0000 UTC m=+67.164464920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : configmap references non-existent config key: service-ca.crt
Sep 18 22:17:55.586556 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:55.586549    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:17:56.586542497 +0000 UTC m=+67.164487620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : secret "router-metrics-certs-default" not found
Sep 18 22:17:55.599440 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.599413    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f"]
Sep 18 22:17:55.602416 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:17:55.602385    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6551bf_1cdc_445e_87dd_05ab71984d12.slice/crio-08d03ee3882c76addaca4aa265ef9af3d770fff4d70874a5011784321f157214 WatchSource:0}: Error finding container 08d03ee3882c76addaca4aa265ef9af3d770fff4d70874a5011784321f157214: Status 404 returned error can't find the container with id 08d03ee3882c76addaca4aa265ef9af3d770fff4d70874a5011784321f157214
Sep 18 22:17:55.785099 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.785057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f" event={"ID":"1b6551bf-1cdc-445e-87dd-05ab71984d12","Type":"ContainerStarted","Data":"08d03ee3882c76addaca4aa265ef9af3d770fff4d70874a5011784321f157214"}
Sep 18 22:17:55.786283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:55.786259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh" event={"ID":"45f0850d-98f6-4875-8f6c-aef91d832769","Type":"ContainerStarted","Data":"12b9902a833253234679acd2b4c98b103a0cc772b67827b23156b61dba64dce1"}
Sep 18 22:17:56.493308 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:56.493259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:56.493741 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:56.493404    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:56.493741 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:56.493482    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls podName:bc6c2313-84db-4974-9821-c10d7f800b0f nodeName:}" failed. No retries permitted until 2026-09-18 22:17:58.493461731 +0000 UTC m=+69.071406873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nxmmw" (UID: "bc6c2313-84db-4974-9821-c10d7f800b0f") : secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:56.594043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:56.594008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:56.594207 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:56.594124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:56.594207 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:56.594179    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:17:56.594316 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:56.594257    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:17:58.594234947 +0000 UTC m=+69.172180087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : secret "router-metrics-certs-default" not found
Sep 18 22:17:56.594316 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:56.594280    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:17:58.594269973 +0000 UTC m=+69.172215112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : configmap references non-existent config key: service-ca.crt
Sep 18 22:17:56.896805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:56.896757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:17:56.896980 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:56.896902    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:17:56.896980 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:56.896966    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls podName:4629738c-7cd1-4d11-bd40-b984ba28aa39 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:28.896952048 +0000 UTC m=+99.474897190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls") pod "dns-default-pkvmd" (UID: "4629738c-7cd1-4d11-bd40-b984ba28aa39") : secret "dns-default-metrics-tls" not found
Sep 18 22:17:56.987982 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:56.987941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:57.051491 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.051446    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:57.098658 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.098630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:57.101426 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.101214    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 22:17:57.111925 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.111900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb35237d-fa0a-4732-9f7a-64783a41bcbf-original-pull-secret\") pod \"global-pull-secret-syncer-qfmqn\" (UID: \"fb35237d-fa0a-4732-9f7a-64783a41bcbf\") " pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:57.199561 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.199480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:17:57.202324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.202301    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 22:17:57.210524 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:57.210507    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 22:17:57.210627 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:57.210568    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs podName:c8f92073-6622-4825-8f48-ec08f7bff5ef nodeName:}" failed. No retries permitted until 2026-09-18 22:19:01.210550868 +0000 UTC m=+131.788496004 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs") pod "network-metrics-daemon-8rdzh" (UID: "c8f92073-6622-4825-8f48-ec08f7bff5ef") : secret "metrics-daemon-secret" not found
Sep 18 22:17:57.216955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.216932    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qfmqn"
Sep 18 22:17:57.300670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.300626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:57.303467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.303435    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 22:17:57.314521 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.314494    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 22:17:57.325245 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.325224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdqf8\" (UniqueName: \"kubernetes.io/projected/62680257-0184-4adc-a796-610d2149fbff-kube-api-access-mdqf8\") pod \"network-check-target-4g5cx\" (UID: \"62680257-0184-4adc-a796-610d2149fbff\") " pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:57.514014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.513930    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-95pvs\""
Sep 18 22:17:57.521884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:57.521850    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:17:58.142066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.141998    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4g5cx"]
Sep 18 22:17:58.144552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.144512    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qfmqn"]
Sep 18 22:17:58.145381 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:17:58.145351    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62680257_0184_4adc_a796_610d2149fbff.slice/crio-10028f2951474126db04303a477aee9b1d86e020fc250efad776d97e448a58e6 WatchSource:0}: Error finding container 10028f2951474126db04303a477aee9b1d86e020fc250efad776d97e448a58e6: Status 404 returned error can't find the container with id 10028f2951474126db04303a477aee9b1d86e020fc250efad776d97e448a58e6
Sep 18 22:17:58.147694 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:17:58.147667    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb35237d_fa0a_4732_9f7a_64783a41bcbf.slice/crio-596ba88725dafcab7483d4e553d8b35af20c76f9190309c28c0985f9a6d1d29e WatchSource:0}: Error finding container 596ba88725dafcab7483d4e553d8b35af20c76f9190309c28c0985f9a6d1d29e: Status 404 returned error can't find the container with id 596ba88725dafcab7483d4e553d8b35af20c76f9190309c28c0985f9a6d1d29e
Sep 18 22:17:58.509389 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.509304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:17:58.509533 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:58.509472    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:58.509587 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:58.509550    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls podName:bc6c2313-84db-4974-9821-c10d7f800b0f nodeName:}" failed. No retries permitted until 2026-09-18 22:18:02.50953014 +0000 UTC m=+73.087475286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nxmmw" (UID: "bc6c2313-84db-4974-9821-c10d7f800b0f") : secret "cluster-monitoring-operator-tls" not found
Sep 18 22:17:58.610422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.610386    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:58.610907 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.610448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:17:58.610907 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:58.610585    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:17:58.610907 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:58.610649    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:18:02.610630164 +0000 UTC m=+73.188575304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : secret "router-metrics-certs-default" not found
Sep 18 22:17:58.611110 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:17:58.611088    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:18:02.611070093 +0000 UTC m=+73.189015231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : configmap references non-existent config key: service-ca.crt
Sep 18 22:17:58.797607 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.797473    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g5cx" event={"ID":"62680257-0184-4adc-a796-610d2149fbff","Type":"ContainerStarted","Data":"10028f2951474126db04303a477aee9b1d86e020fc250efad776d97e448a58e6"}
Sep 18 22:17:58.800841 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.800250    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f" event={"ID":"1b6551bf-1cdc-445e-87dd-05ab71984d12","Type":"ContainerStarted","Data":"52ee93d202c6cec73616c694ea6b4164865a087afdbadd3b31f3e6931d58ebdf"}
Sep 18 22:17:58.803923 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.803875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh" event={"ID":"45f0850d-98f6-4875-8f6c-aef91d832769","Type":"ContainerStarted","Data":"520f57a1f6b719be07fb82fd6162c2df1a9b608e23f601d7a525915be1bad93e"}
Sep 18 22:17:58.805664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.805609    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qfmqn" event={"ID":"fb35237d-fa0a-4732-9f7a-64783a41bcbf","Type":"ContainerStarted","Data":"596ba88725dafcab7483d4e553d8b35af20c76f9190309c28c0985f9a6d1d29e"}
Sep 18 22:17:58.817432 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.817387    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f" podStartSLOduration=2.545466021 podStartE2EDuration="4.817373997s" totalImagesPullingTime="2.271907976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:58.816646297 +0000 UTC m=+69.394591445" watchObservedRunningTime="2026-09-18 22:17:58.817373997 +0000 UTC m=+69.395319135"
Sep 18 22:17:58.840600 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:58.840546    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh" podStartSLOduration=2.480802443 podStartE2EDuration="4.840521114s" totalImagesPullingTime="2.359718671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:58.840151754 +0000 UTC m=+69.418096902" watchObservedRunningTime="2026-09-18 22:17:58.840521114 +0000 UTC m=+69.418466259"
Sep 18 22:17:59.079469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:59.079356    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:17:59.142144 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:17:59.142105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:00.174696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.174624    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:00.195049 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.195017    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hx4t6"]
Sep 18 22:18:00.199653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.199610    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.203256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.203163    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 22:18:00.203256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.203217    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 22:18:00.203473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.203224    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 22:18:00.204754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.204572    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7xc5k\""
Sep 18 22:18:00.204754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.204580    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 22:18:00.216322 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.216296    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hx4t6"]
Sep 18 22:18:00.228040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.227816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-crio-socket\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.228040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.227855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.228040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.227901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj9l8\" (UniqueName: \"kubernetes.io/projected/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-api-access-bj9l8\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.228040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.227932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-data-volume\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.228040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.227965    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.298196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.298157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:00.328333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.328302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj9l8\" (UniqueName: \"kubernetes.io/projected/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-api-access-bj9l8\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.328514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.328350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-data-volume\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.328699 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.328674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.328815 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.328764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-data-volume\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.328875 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.328848    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-crio-socket\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.328930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.328877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.328930 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.328893    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:00.329025 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.328952    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:00.828933674 +0000 UTC m=+71.406878803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:00.329025 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.328974    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:18:00.329134 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.329036    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:00.829019077 +0000 UTC m=+71.406964215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : configmap "kube-rbac-proxy" not found
Sep 18 22:18:00.329134 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.329101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-crio-socket\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.346045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.346020    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj9l8\" (UniqueName: \"kubernetes.io/projected/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-api-access-bj9l8\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.392517 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.392486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:00.833108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.833067    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.833316 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.833160    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:00.833432 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.833344    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:00.833432 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.833401    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:01.833382694 +0000 UTC m=+72.411327838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:00.833765 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.833729    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:18:00.833859 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:00.833810    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:01.833793214 +0000 UTC m=+72.411738354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : configmap "kube-rbac-proxy" not found
Sep 18 22:18:00.904229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.904182    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:00.992045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:00.992012    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:01.843275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:01.843236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:01.843696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:01.843329    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:01.843696 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:01.843375    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:18:01.843696 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:01.843450    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:03.843429959 +0000 UTC m=+74.421375098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : configmap "kube-rbac-proxy" not found
Sep 18 22:18:01.843696 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:01.843490    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:01.843696 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:01.843556    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:03.843540245 +0000 UTC m=+74.421485387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:01.912096 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:01.912071    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6wbkd_bf6d6f80-59ad-457e-b964-5cd20aa3d4e2/dns-node-resolver/0.log"
Sep 18 22:18:02.411240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.411202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:02.494697 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.494666    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-jwldr"]
Sep 18 22:18:02.499045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.498364    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.501431 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.501198    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qk566\""
Sep 18 22:18:02.501431 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.501216    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 18 22:18:02.502166 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.502041    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 18 22:18:02.502166 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.502071    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 18 22:18:02.502166 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.502094    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 18 22:18:02.510144 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.510121    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-jwldr"]
Sep 18 22:18:02.537414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.537376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:02.548506 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.548476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:18:02.548654 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.548553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/795c4c05-a0f7-4d34-baa0-d3843fda27c6-signing-key\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.548654 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.548579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96lpc\" (UniqueName: \"kubernetes.io/projected/795c4c05-a0f7-4d34-baa0-d3843fda27c6-kube-api-access-96lpc\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.548654 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.548609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/795c4c05-a0f7-4d34-baa0-d3843fda27c6-signing-cabundle\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.548654 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:02.548634    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 22:18:02.548893 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:02.548727    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls podName:bc6c2313-84db-4974-9821-c10d7f800b0f nodeName:}" failed. No retries permitted until 2026-09-18 22:18:10.548704492 +0000 UTC m=+81.126649632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nxmmw" (UID: "bc6c2313-84db-4974-9821-c10d7f800b0f") : secret "cluster-monitoring-operator-tls" not found
Sep 18 22:18:02.603011 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.602974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:02.649646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.649618    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:02.649817 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.649674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:02.649817 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.649696    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/795c4c05-a0f7-4d34-baa0-d3843fda27c6-signing-key\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.649817 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.649712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96lpc\" (UniqueName: \"kubernetes.io/projected/795c4c05-a0f7-4d34-baa0-d3843fda27c6-kube-api-access-96lpc\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.649817 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.649731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/795c4c05-a0f7-4d34-baa0-d3843fda27c6-signing-cabundle\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.650029 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:02.649822    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:18:10.649800774 +0000 UTC m=+81.227745911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : configmap references non-existent config key: service-ca.crt
Sep 18 22:18:02.650029 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:02.649857    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:18:02.650029 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:02.649929    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs podName:9a9561c5-308e-4618-a8d4-c49745121a7a nodeName:}" failed. No retries permitted until 2026-09-18 22:18:10.649911814 +0000 UTC m=+81.227856950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs") pod "router-default-685768998d-vj8pc" (UID: "9a9561c5-308e-4618-a8d4-c49745121a7a") : secret "router-metrics-certs-default" not found
Sep 18 22:18:02.650362 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.650344    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/795c4c05-a0f7-4d34-baa0-d3843fda27c6-signing-cabundle\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.652168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.652147    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/795c4c05-a0f7-4d34-baa0-d3843fda27c6-signing-key\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.664672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.664623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96lpc\" (UniqueName: \"kubernetes.io/projected/795c4c05-a0f7-4d34-baa0-d3843fda27c6-kube-api-access-96lpc\") pod \"service-ca-55f6fc7b86-jwldr\" (UID: \"795c4c05-a0f7-4d34-baa0-d3843fda27c6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.810202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.810171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr"
Sep 18 22:18:02.819725 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.819694    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:02.823045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.823005    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qfmqn" event={"ID":"fb35237d-fa0a-4732-9f7a-64783a41bcbf","Type":"ContainerStarted","Data":"d45960c4b9cbd356772bac0b9e0f06f11d4f6b461cfc365fd26ec0204b4c7e22"}
Sep 18 22:18:02.825385 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.825363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4g5cx" event={"ID":"62680257-0184-4adc-a796-610d2149fbff","Type":"ContainerStarted","Data":"7cbeb6f0920676c2a7e3c23857700906966efdf233938eddeaedc38d32fb5767"}
Sep 18 22:18:02.825496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.825484    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:18:02.843084 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.843039    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qfmqn" podStartSLOduration=67.292870682 podStartE2EDuration="1m11.843022714s" totalImagesPullingTime="4.550152032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:02.841395625 +0000 UTC m=+73.419340772" watchObservedRunningTime="2026-09-18 22:18:02.843022714 +0000 UTC m=+73.420967859"
Sep 18 22:18:02.859590 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.859527    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4g5cx" podStartSLOduration=67.31093889 podStartE2EDuration="1m11.859505823s" totalImagesPullingTime="4.548566933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:02.859191143 +0000 UTC m=+73.437136288" watchObservedRunningTime="2026-09-18 22:18:02.859505823 +0000 UTC m=+73.437450971"
Sep 18 22:18:02.920746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:02.920639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:03.088021 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.087991    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-jwldr"]
Sep 18 22:18:03.090817 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:03.090769    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795c4c05_a0f7_4d34_baa0_d3843fda27c6.slice/crio-de28b0f2b7c94a6daeb4a9ab059aed8f0744646dfedb5a9f9658149087c323ff WatchSource:0}: Error finding container de28b0f2b7c94a6daeb4a9ab059aed8f0744646dfedb5a9f9658149087c323ff: Status 404 returned error can't find the container with id de28b0f2b7c94a6daeb4a9ab059aed8f0744646dfedb5a9f9658149087c323ff
Sep 18 22:18:03.113006 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.112987    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghg7l_3da85a87-b538-439c-bb22-7d6614f772a8/node-ca/0.log"
Sep 18 22:18:03.575448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.575419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:03.829978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.829885    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr" event={"ID":"795c4c05-a0f7-4d34-baa0-d3843fda27c6","Type":"ContainerStarted","Data":"d785ea3e091ffede095d5a63636a2c72ea2601286218a6e74729b5c022751a3e"}
Sep 18 22:18:03.829978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.829945    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr" event={"ID":"795c4c05-a0f7-4d34-baa0-d3843fda27c6","Type":"ContainerStarted","Data":"de28b0f2b7c94a6daeb4a9ab059aed8f0744646dfedb5a9f9658149087c323ff"}
Sep 18 22:18:03.858891 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.858861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:03.859020 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.858914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:03.859020 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:03.859013    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:03.859129 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:03.859056    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:07.859043245 +0000 UTC m=+78.436988368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:03.859129 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:03.859093    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:18:03.859129 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:03.859122    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:07.859115219 +0000 UTC m=+78.437060343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : configmap "kube-rbac-proxy" not found
Sep 18 22:18:03.862149 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.862107    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-jwldr" podStartSLOduration=1.862091527 podStartE2EDuration="1.862091527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:03.860656561 +0000 UTC m=+74.438601718" watchObservedRunningTime="2026-09-18 22:18:03.862091527 +0000 UTC m=+74.440036673"
Sep 18 22:18:03.915998 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:03.915969    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7dw4r_abd43bb6-c6d0-44fa-a636-d6154185132d/serve-healthcheck-canary/0.log"
Sep 18 22:18:04.491410 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:04.491371    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:04.799891 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:04.799807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:04.985335 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:04.985287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:05.084730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:05.084700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:05.200903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:05.200856    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:06.398559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:06.398530    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:06.611690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:06.611654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:06.788530 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:06.788444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:06.993720 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:06.993690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:07.188950 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:07.188907    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:07.426394 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:07.426350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:07.890959 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:07.890918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:07.891169 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:07.890979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:07.891169 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:07.891113    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:18:07.891169 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:07.891161    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:07.891315 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:07.891195    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:15.891177211 +0000 UTC m=+86.469122333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : configmap "kube-rbac-proxy" not found
Sep 18 22:18:07.891315 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:07.891236    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls podName:a43f2cdc-c758-4b59-9f16-5e79ffc4f242 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:15.891217713 +0000 UTC m=+86.469162853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hx4t6" (UID: "a43f2cdc-c758-4b59-9f16-5e79ffc4f242") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:18:08.057019 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:08.056979    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:08.183149 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:08.183048    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:08.283345 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:08.283307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:08.594589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:08.594555    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:08.798217 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:08.798183    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:08.898311 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:08.898210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:09.054816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:09.054773    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:09.397591 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:09.397560    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:10.191503 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.191468    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:10.590889 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.590863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:10.610984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.610956    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:18:10.611114 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:10.611099    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 22:18:10.611177 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:10.611159    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls podName:bc6c2313-84db-4974-9821-c10d7f800b0f nodeName:}" failed. No retries permitted until 2026-09-18 22:18:26.611142195 +0000 UTC m=+97.189087337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nxmmw" (UID: "bc6c2313-84db-4974-9821-c10d7f800b0f") : secret "cluster-monitoring-operator-tls" not found
Sep 18 22:18:10.691703 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.691669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:10.711743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.711718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:10.711856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.711800    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:10.712323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.712305    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a9561c5-308e-4618-a8d4-c49745121a7a-service-ca-bundle\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:10.714213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.714192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a9561c5-308e-4618-a8d4-c49745121a7a-metrics-certs\") pod \"router-default-685768998d-vj8pc\" (UID: \"9a9561c5-308e-4618-a8d4-c49745121a7a\") " pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:10.793195 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.793167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:10.840062 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.840031    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:10.989623 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:10.989593    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:11.114935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:11.114864    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-685768998d-vj8pc"]
Sep 18 22:18:11.118516 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:11.118489    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9561c5_308e_4618_a8d4_c49745121a7a.slice/crio-66261d1c4ee97fef8caa3392dab293c7c732df9c1ee66f6a4b9bae3716632f67 WatchSource:0}: Error finding container 66261d1c4ee97fef8caa3392dab293c7c732df9c1ee66f6a4b9bae3716632f67: Status 404 returned error can't find the container with id 66261d1c4ee97fef8caa3392dab293c7c732df9c1ee66f6a4b9bae3716632f67
Sep 18 22:18:11.393448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:11.393371    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:11.863327 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:11.863291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-685768998d-vj8pc" event={"ID":"9a9561c5-308e-4618-a8d4-c49745121a7a","Type":"ContainerStarted","Data":"4ba6ad1d01ae6be28efe0f91ac66650a5b0153dd3d24fdd96a1e84dff59f3b00"}
Sep 18 22:18:11.863508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:11.863346    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-685768998d-vj8pc" event={"ID":"9a9561c5-308e-4618-a8d4-c49745121a7a","Type":"ContainerStarted","Data":"66261d1c4ee97fef8caa3392dab293c7c732df9c1ee66f6a4b9bae3716632f67"}
Sep 18 22:18:11.882680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:11.882631    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-685768998d-vj8pc" podStartSLOduration=17.882615848 podStartE2EDuration="17.882615848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:11.881346092 +0000 UTC m=+82.459291231" watchObservedRunningTime="2026-09-18 22:18:11.882615848 +0000 UTC m=+82.460560993"
Sep 18 22:18:12.191164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.191078    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:12.390511 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.390475    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:12.788588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.788547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:12.841006 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.840981    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:12.843540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.843519    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:12.866832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.866800    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:12.867987 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.867970    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-685768998d-vj8pc"
Sep 18 22:18:12.992622 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:12.992590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:13.296081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:13.296049    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:13.594469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:13.594437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:13.987283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:13.987200    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:14.193010 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:14.192976    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:14.595405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:14.595374    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:14.994351 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:14.994275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:15.188582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:15.188553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:15.289296 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:15.289211    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:15.952529 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:15.952499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:15.952712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:15.952545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:15.953109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:15.953085    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:15.955048 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:15.955029    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a43f2cdc-c758-4b59-9f16-5e79ffc4f242-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hx4t6\" (UID: \"a43f2cdc-c758-4b59-9f16-5e79ffc4f242\") " pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:16.112113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:16.112077    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hx4t6"
Sep 18 22:18:16.388941 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:16.388913    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hx4t6"]
Sep 18 22:18:16.392182 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:16.392158    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43f2cdc_c758_4b59_9f16_5e79ffc4f242.slice/crio-3132f3241e65fe8a4081c7d888fa91388052494ff56ede0b743cb89343bfd8c4 WatchSource:0}: Error finding container 3132f3241e65fe8a4081c7d888fa91388052494ff56ede0b743cb89343bfd8c4: Status 404 returned error can't find the container with id 3132f3241e65fe8a4081c7d888fa91388052494ff56ede0b743cb89343bfd8c4
Sep 18 22:18:16.881232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:16.881200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hx4t6" event={"ID":"a43f2cdc-c758-4b59-9f16-5e79ffc4f242","Type":"ContainerStarted","Data":"aeb65d2c373ba3a169ac3d8e8de94a46bbabaaeabd890a7af056103e2d58a840"}
Sep 18 22:18:16.881401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:16.881253    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hx4t6" event={"ID":"a43f2cdc-c758-4b59-9f16-5e79ffc4f242","Type":"ContainerStarted","Data":"3132f3241e65fe8a4081c7d888fa91388052494ff56ede0b743cb89343bfd8c4"}
Sep 18 22:18:17.886573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:17.886538    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hx4t6" event={"ID":"a43f2cdc-c758-4b59-9f16-5e79ffc4f242","Type":"ContainerStarted","Data":"7862990e0b9ba0f6ce011eb3aa8969047e90ec95fd8edfda7fcf691a21208a03"}
Sep 18 22:18:18.352246 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:18.352204    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:18.453043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:18.452999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:18.510934 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:18.510545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:18.662524 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:18.662453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:18.891343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:18.891310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hx4t6" event={"ID":"a43f2cdc-c758-4b59-9f16-5e79ffc4f242","Type":"ContainerStarted","Data":"d974ca1e479dd487c02bf76d76c6ab541a3501a62dce8bb06d36add4015111b3"}
Sep 18 22:18:18.911909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:18.911861    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hx4t6" podStartSLOduration=16.908982308 podStartE2EDuration="18.911842116s" totalImagesPullingTime="2.002859808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:18:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:18.910878593 +0000 UTC m=+89.488823743" watchObservedRunningTime="2026-09-18 22:18:18.911842116 +0000 UTC m=+89.489787262"
Sep 18 22:18:19.048145 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:19.048061    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:19.116293 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:19.116260    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:19.433270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:19.433240    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:19.494224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:19.494192    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:19.848290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:19.848258    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:20.047008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:20.046977    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:20.099101 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:20.099034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:22.665037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:22.665005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:22.725231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:22.725200    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:23.057307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.057233    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"]
Sep 18 22:18:23.060406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.060391    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.064315 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.064290    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 18 22:18:23.064436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.064290    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 22:18:23.064436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.064292    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zld2h\""
Sep 18 22:18:23.069917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.069899    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 22:18:23.070035 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.069976    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 22:18:23.081374 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.081355    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"]
Sep 18 22:18:23.104066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.104041    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5457644cf4-ph2kg"]
Sep 18 22:18:23.106938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.106922    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.110138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.110121    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 22:18:23.110248 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.110187    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 22:18:23.111178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.111161    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x79ck\""
Sep 18 22:18:23.111458 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.111438    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 22:18:23.117765 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.117741    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 22:18:23.126174 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.126146    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5457644cf4-ph2kg"]
Sep 18 22:18:23.207391 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207356    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xthxx\" (UniqueName: \"kubernetes.io/projected/7b46545f-de64-4d8c-8dce-e04b44584573-kube-api-access-xthxx\") pod \"managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn\" (UID: \"7b46545f-de64-4d8c-8dce-e04b44584573\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.207579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207423    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8td9\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-kube-api-access-w8td9\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.207579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-ca-trust-extracted\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.207732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-trusted-ca\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.207732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-registry-tls\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.207732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-bound-sa-token\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.207732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-registry-certificates\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.207967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b46545f-de64-4d8c-8dce-e04b44584573-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn\" (UID: \"7b46545f-de64-4d8c-8dce-e04b44584573\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.207967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-image-registry-private-configuration\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.207967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.207882    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-installation-pull-secrets\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.241438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.241356    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:23.308449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-registry-tls\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.308449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-bound-sa-token\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.308449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-registry-certificates\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.308449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b46545f-de64-4d8c-8dce-e04b44584573-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn\" (UID: \"7b46545f-de64-4d8c-8dce-e04b44584573\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.308769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-image-registry-private-configuration\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.308769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-installation-pull-secrets\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.308769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xthxx\" (UniqueName: \"kubernetes.io/projected/7b46545f-de64-4d8c-8dce-e04b44584573-kube-api-access-xthxx\") pod \"managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn\" (UID: \"7b46545f-de64-4d8c-8dce-e04b44584573\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.308769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308730    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8td9\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-kube-api-access-w8td9\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.309021 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-ca-trust-extracted\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.309021 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.308868    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-trusted-ca\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.309340 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.309199    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-ca-trust-extracted\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.309680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.309654    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-trusted-ca\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.309846 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.309826    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-registry-certificates\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.311323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.311298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-image-registry-private-configuration\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.311395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.311343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-installation-pull-secrets\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.311458 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.311439    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-registry-tls\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.311597 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.311579    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7b46545f-de64-4d8c-8dce-e04b44584573-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn\" (UID: \"7b46545f-de64-4d8c-8dce-e04b44584573\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.324795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.321758    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xthxx\" (UniqueName: \"kubernetes.io/projected/7b46545f-de64-4d8c-8dce-e04b44584573-kube-api-access-xthxx\") pod \"managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn\" (UID: \"7b46545f-de64-4d8c-8dce-e04b44584573\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.324795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.323978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-bound-sa-token\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.329795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.326748    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8td9\" (UniqueName: \"kubernetes.io/projected/2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2-kube-api-access-w8td9\") pod \"image-registry-5457644cf4-ph2kg\" (UID: \"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2\") " pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.354630 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.354598    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:23.377953 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.377922    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"
Sep 18 22:18:23.417285 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.417260    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.646037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.646008    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn"]
Sep 18 22:18:23.649146 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:23.649112    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b46545f_de64_4d8c_8dce_e04b44584573.slice/crio-cd69fe8489ab1cd490b6a83de3e29f5743b773c861b280bdbd4a891c5fb8d55d WatchSource:0}: Error finding container cd69fe8489ab1cd490b6a83de3e29f5743b773c861b280bdbd4a891c5fb8d55d: Status 404 returned error can't find the container with id cd69fe8489ab1cd490b6a83de3e29f5743b773c861b280bdbd4a891c5fb8d55d
Sep 18 22:18:23.697230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.697203    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5457644cf4-ph2kg"]
Sep 18 22:18:23.699949 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:23.699924    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2572fe1e_2cc0_42f4_8f7d_8cc9ae173cb2.slice/crio-a993e59cda2e245552ee9f57e425d305dce1cec63b6ce3b8d4d92986e15b210b WatchSource:0}: Error finding container a993e59cda2e245552ee9f57e425d305dce1cec63b6ce3b8d4d92986e15b210b: Status 404 returned error can't find the container with id a993e59cda2e245552ee9f57e425d305dce1cec63b6ce3b8d4d92986e15b210b
Sep 18 22:18:23.910408 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.910325    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg" event={"ID":"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2","Type":"ContainerStarted","Data":"3ec718a740338cd4f48c0b41d1aacef090f3c0e800cdcd7a19f2b5e43a8a238e"}
Sep 18 22:18:23.910408 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.910372    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg" event={"ID":"2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2","Type":"ContainerStarted","Data":"a993e59cda2e245552ee9f57e425d305dce1cec63b6ce3b8d4d92986e15b210b"}
Sep 18 22:18:23.910636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.910414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:23.911652 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.911626    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn" event={"ID":"7b46545f-de64-4d8c-8dce-e04b44584573","Type":"ContainerStarted","Data":"cd69fe8489ab1cd490b6a83de3e29f5743b773c861b280bdbd4a891c5fb8d55d"}
Sep 18 22:18:23.928708 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:23.928666    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg" podStartSLOduration=0.928652406 podStartE2EDuration="928.652406ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:23.927929526 +0000 UTC m=+94.505874672" watchObservedRunningTime="2026-09-18 22:18:23.928652406 +0000 UTC m=+94.506597550"
Sep 18 22:18:25.965659 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:25.965620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:26.056906 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:26.056870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:26.639898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:26.639850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:18:26.642403 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:26.642375    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc6c2313-84db-4974-9821-c10d7f800b0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nxmmw\" (UID: \"bc6c2313-84db-4974-9821-c10d7f800b0f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:18:26.924703 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:26.924624    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn" event={"ID":"7b46545f-de64-4d8c-8dce-e04b44584573","Type":"ContainerStarted","Data":"af011d96984c4cc1d42827209f14317ae2e289b2d978b039bc146e225bef5323"}
Sep 18 22:18:26.926969 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:26.926950    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"
Sep 18 22:18:26.941818 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:26.941758    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5696f8bfd4-w4sgn" podStartSLOduration=1.318469108 podStartE2EDuration="3.941741878s" totalImagesPullingTime="2.62327277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:26.940890084 +0000 UTC m=+97.518835230" watchObservedRunningTime="2026-09-18 22:18:26.941741878 +0000 UTC m=+97.519687022"
Sep 18 22:18:27.196176 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:27.196100    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw"]
Sep 18 22:18:27.199000 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:27.198971    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6c2313_84db_4974_9821_c10d7f800b0f.slice/crio-e592ca7fd63998aafdce301c31af5caf9aeb70b70d3bed065467f541ea55c19c WatchSource:0}: Error finding container e592ca7fd63998aafdce301c31af5caf9aeb70b70d3bed065467f541ea55c19c: Status 404 returned error can't find the container with id e592ca7fd63998aafdce301c31af5caf9aeb70b70d3bed065467f541ea55c19c
Sep 18 22:18:27.829857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:27.829818    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:27.901028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:27.900989    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:27.929469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:27.929432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw" event={"ID":"bc6c2313-84db-4974-9821-c10d7f800b0f","Type":"ContainerStarted","Data":"e592ca7fd63998aafdce301c31af5caf9aeb70b70d3bed065467f541ea55c19c"}
Sep 18 22:18:28.957033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:28.957012    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:18:28.959168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:28.959142    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4629738c-7cd1-4d11-bd40-b984ba28aa39-metrics-tls\") pod \"dns-default-pkvmd\" (UID: \"4629738c-7cd1-4d11-bd40-b984ba28aa39\") " pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:18:28.984538 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:28.984514    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gtntj\""
Sep 18 22:18:28.992601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:28.992574    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:18:29.238218 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.238112    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:29.275696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.275667    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pkvmd"]
Sep 18 22:18:29.278630 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:29.278602    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4629738c_7cd1_4d11_bd40_b984ba28aa39.slice/crio-115107714c559c6de154f354f6d8a51666b628ad0b16415ccc810d554e26b940 WatchSource:0}: Error finding container 115107714c559c6de154f354f6d8a51666b628ad0b16415ccc810d554e26b940: Status 404 returned error can't find the container with id 115107714c559c6de154f354f6d8a51666b628ad0b16415ccc810d554e26b940
Sep 18 22:18:29.337850 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.337803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:29.395566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.395526    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"]
Sep 18 22:18:29.400219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.400195    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"
Sep 18 22:18:29.402712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.402688    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 18 22:18:29.402842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.402723    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9n8bv\""
Sep 18 22:18:29.408498 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.408472    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"]
Sep 18 22:18:29.411274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.411249    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:29.511072 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.510988    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:29.562138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.562095    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6544207c-b4ff-44cf-838d-4480a545300a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-xr2br\" (UID: \"6544207c-b4ff-44cf-838d-4480a545300a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"
Sep 18 22:18:29.662938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.662906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6544207c-b4ff-44cf-838d-4480a545300a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-xr2br\" (UID: \"6544207c-b4ff-44cf-838d-4480a545300a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"
Sep 18 22:18:29.665409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.665391    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6544207c-b4ff-44cf-838d-4480a545300a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-xr2br\" (UID: \"6544207c-b4ff-44cf-838d-4480a545300a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"
Sep 18 22:18:29.711205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.711166    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"
Sep 18 22:18:29.936743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.936712    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pkvmd" event={"ID":"4629738c-7cd1-4d11-bd40-b984ba28aa39","Type":"ContainerStarted","Data":"115107714c559c6de154f354f6d8a51666b628ad0b16415ccc810d554e26b940"}
Sep 18 22:18:29.938530 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.938502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw" event={"ID":"bc6c2313-84db-4974-9821-c10d7f800b0f","Type":"ContainerStarted","Data":"1c1130a7e9e70a6d444a574575927be36ee9d94a996f1c06364127ebd8a3089d"}
Sep 18 22:18:29.956499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.956451    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nxmmw" podStartSLOduration=34.25054589 podStartE2EDuration="35.956436202s" totalImagesPullingTime="1.705890312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:29.955272605 +0000 UTC m=+100.533217752" watchObservedRunningTime="2026-09-18 22:18:29.956436202 +0000 UTC m=+100.534381374"
Sep 18 22:18:29.986441 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:29.986405    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"]
Sep 18 22:18:29.989710 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:29.989682    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6544207c_b4ff_44cf_838d_4480a545300a.slice/crio-5aee88ee86abfd95f9a12ebe471964132c0bd1bce5b15aec9d4b388f27dd2b00 WatchSource:0}: Error finding container 5aee88ee86abfd95f9a12ebe471964132c0bd1bce5b15aec9d4b388f27dd2b00: Status 404 returned error can't find the container with id 5aee88ee86abfd95f9a12ebe471964132c0bd1bce5b15aec9d4b388f27dd2b00
Sep 18 22:18:30.944566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:30.944527    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br" event={"ID":"6544207c-b4ff-44cf-838d-4480a545300a","Type":"ContainerStarted","Data":"5aee88ee86abfd95f9a12ebe471964132c0bd1bce5b15aec9d4b388f27dd2b00"}
Sep 18 22:18:31.951001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.950970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pkvmd" event={"ID":"4629738c-7cd1-4d11-bd40-b984ba28aa39","Type":"ContainerStarted","Data":"8f99413ed11f1a0e6c09c8291b2bca7a9cce73bdc69fb82b48b120829a08b862"}
Sep 18 22:18:31.951459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.951021    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pkvmd" event={"ID":"4629738c-7cd1-4d11-bd40-b984ba28aa39","Type":"ContainerStarted","Data":"cbd4d9da23c8cf2e23c1c1788379b7714606adcef09ae6f17088ff2d0979d690"}
Sep 18 22:18:31.951459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.951077    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:18:31.952523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.952502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br" event={"ID":"6544207c-b4ff-44cf-838d-4480a545300a","Type":"ContainerStarted","Data":"3d9fe6c0b1e96b2d5a95644e315e4ff217432a3b7b0bcc0141b1bca4364d33ec"}
Sep 18 22:18:31.952720 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.952687    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"
Sep 18 22:18:31.957548 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.957526    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br"
Sep 18 22:18:31.969746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.969706    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pkvmd" podStartSLOduration=64.831021518 podStartE2EDuration="1m6.96969446s" totalImagesPullingTime="2.138672942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:31.968074293 +0000 UTC m=+102.546019439" watchObservedRunningTime="2026-09-18 22:18:31.96969446 +0000 UTC m=+102.547639605"
Sep 18 22:18:31.981837 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:31.981793    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-xr2br" podStartSLOduration=1.554100054 podStartE2EDuration="2.981767703s" totalImagesPullingTime="1.427667649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:31.981682593 +0000 UTC m=+102.559627738" watchObservedRunningTime="2026-09-18 22:18:31.981767703 +0000 UTC m=+102.559712847"
Sep 18 22:18:32.432055 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:32.432022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:32.504904 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:32.504876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:32.655805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:32.655746    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:33.733277 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:33.733241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:33.832541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:33.832512    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4g5cx"
Sep 18 22:18:33.833236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:33.833211    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:34.856769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.856740    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7bfdd455-g8nvw"]
Sep 18 22:18:34.878893 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.878857    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7bfdd455-g8nvw"]
Sep 18 22:18:34.879033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.878972    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:34.882816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.882790    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 22:18:34.883815 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.883770    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 22:18:34.884008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.883903    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 22:18:34.884008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.883955    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 22:18:34.884137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.884112    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 22:18:34.884137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.884121    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tz6wt\""
Sep 18 22:18:34.884237 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.884145    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 22:18:34.884693 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.884675    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 22:18:34.887659 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:34.887643    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 22:18:35.003931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.003898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-oauth-config\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.003931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.003930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-trusted-ca-bundle\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.004156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.003957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-oauth-serving-cert\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.004156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.003999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-console-config\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.004156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.004044    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5vp\" (UniqueName: \"kubernetes.io/projected/382cb64d-b501-4728-982e-57f47ab4fbbd-kube-api-access-zs5vp\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.004156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.004068    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-service-ca\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.004156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.004095    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-serving-cert\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.105179 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.105146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-oauth-serving-cert\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.105400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.105191    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-console-config\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.105400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.105212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5vp\" (UniqueName: \"kubernetes.io/projected/382cb64d-b501-4728-982e-57f47ab4fbbd-kube-api-access-zs5vp\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.105400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.105292    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-service-ca\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.105400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.105363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-serving-cert\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.105400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.105400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-oauth-config\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.105660 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.105426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-trusted-ca-bundle\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.106033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.106011    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-service-ca\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.106151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.106046    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-console-config\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.106151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.106075    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-oauth-serving-cert\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.106485 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.106466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-trusted-ca-bundle\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.107903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.107850    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-serving-cert\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.108029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.107987    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-oauth-config\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.113616 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.113590    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5vp\" (UniqueName: \"kubernetes.io/projected/382cb64d-b501-4728-982e-57f47ab4fbbd-kube-api-access-zs5vp\") pod \"console-5c7bfdd455-g8nvw\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") " pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.189018 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.188983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:35.490689 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.490613    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7bfdd455-g8nvw"]
Sep 18 22:18:35.493229 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:35.493199    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382cb64d_b501_4728_982e_57f47ab4fbbd.slice/crio-2df14e3e54fb4e477b25706a9100c0f64d7751af7c474c58dcc15179766eec10 WatchSource:0}: Error finding container 2df14e3e54fb4e477b25706a9100c0f64d7751af7c474c58dcc15179766eec10: Status 404 returned error can't find the container with id 2df14e3e54fb4e477b25706a9100c0f64d7751af7c474c58dcc15179766eec10
Sep 18 22:18:35.971734 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:35.971699    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bfdd455-g8nvw" event={"ID":"382cb64d-b501-4728-982e-57f47ab4fbbd","Type":"ContainerStarted","Data":"2df14e3e54fb4e477b25706a9100c0f64d7751af7c474c58dcc15179766eec10"}
Sep 18 22:18:36.676007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:36.675966    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:36.737489 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:36.737447    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:39.990632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:39.990597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bfdd455-g8nvw" event={"ID":"382cb64d-b501-4728-982e-57f47ab4fbbd","Type":"ContainerStarted","Data":"6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f"}
Sep 18 22:18:40.010660 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:40.010613    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7bfdd455-g8nvw" podStartSLOduration=2.031692438 podStartE2EDuration="6.010598295s" totalImagesPullingTime="3.978905857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:40.008824902 +0000 UTC m=+110.586770047" watchObservedRunningTime="2026-09-18 22:18:40.010598295 +0000 UTC m=+110.588543494"
Sep 18 22:18:40.086093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:40.086063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:40.142404 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:40.142370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:41.486793 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:41.486742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:41.587154 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:41.587109    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:41.961142 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:41.961117    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pkvmd"
Sep 18 22:18:42.125395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:42.125339    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:42.225979 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:42.225909    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:42.451936 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:42.451901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:43.421556 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:43.421524    2570 patch_prober.go:28] interesting pod/image-registry-5457644cf4-ph2kg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 22:18:43.421939 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:43.421572    2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg" podUID="2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:18:44.569492 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.569436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:44.789084 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.789041    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:44.826227 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.826144    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-52rbq"]
Sep 18 22:18:44.830736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.830716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:44.833198 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.833174    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8k7q"]
Sep 18 22:18:44.837800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.834937    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 22:18:44.837800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.835542    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 22:18:44.837800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.835770    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fffsz\""
Sep 18 22:18:44.837800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.835902    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 22:18:44.837800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.836578    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 22:18:44.839356 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.839336    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.842946 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.842920    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 22:18:44.844188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.843904    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 22:18:44.844188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.843985    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-825pr\""
Sep 18 22:18:44.844188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.844049    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 22:18:44.850806 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.850761    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-52rbq"]
Sep 18 22:18:44.891237 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.891212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:44.920867 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.920843    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5457644cf4-ph2kg"
Sep 18 22:18:44.989196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvlpf\" (UniqueName: \"kubernetes.io/projected/35afdf9d-93c4-46c0-88d8-065c52368692-kube-api-access-wvlpf\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989342 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67178a84-1075-4569-a05c-4a6e2d2c3b44-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:44.989342 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989236    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-sys\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989342 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67178a84-1075-4569-a05c-4a6e2d2c3b44-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:44.989342 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:44.989342 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:44.989509 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-textfile\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989509 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989509 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-tls\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989509 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989674 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:44.989752 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-root\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989768    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35afdf9d-93c4-46c0-88d8-065c52368692-metrics-client-ca\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-wtmp\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:44.989894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.989847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwngf\" (UniqueName: \"kubernetes.io/projected/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-api-access-hwngf\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:44.994122 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:44.994093    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.089255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.089222    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.090304 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090284    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.090358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.090488 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090469    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-root\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.090573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35afdf9d-93c4-46c0-88d8-065c52368692-metrics-client-ca\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.090573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-wtmp\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.090573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090562    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwngf\" (UniqueName: \"kubernetes.io/projected/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-api-access-hwngf\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.090730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvlpf\" (UniqueName: \"kubernetes.io/projected/35afdf9d-93c4-46c0-88d8-065c52368692-kube-api-access-wvlpf\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.090730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090617    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67178a84-1075-4569-a05c-4a6e2d2c3b44-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.090730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-sys\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.090730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67178a84-1075-4569-a05c-4a6e2d2c3b44-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.090730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090717    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.091002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-root\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.091002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090772    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-sys\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.091002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090865    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.091002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090904    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-textfile\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.091002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.090961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.091243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.091035    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-tls\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.091243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.091085    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-wtmp\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.091397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67178a84-1075-4569-a05c-4a6e2d2c3b44-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:45.091478    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:45.091553    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-tls podName:35afdf9d-93c4-46c0-88d8-065c52368692 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:45.5915325 +0000 UTC m=+116.169477625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-tls") pod "node-exporter-s8k7q" (UID: "35afdf9d-93c4-46c0-88d8-065c52368692") : secret "node-exporter-tls" not found
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:45.091679    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:18:45.091739    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-tls podName:67178a84-1075-4569-a05c-4a6e2d2c3b44 nodeName:}" failed. No retries permitted until 2026-09-18 22:18:45.59172305 +0000 UTC m=+116.169668176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-52rbq" (UID: "67178a84-1075-4569-a05c-4a6e2d2c3b44") : secret "kube-state-metrics-tls" not found
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.091858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.092122    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-textfile\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.092279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.092223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35afdf9d-93c4-46c0-88d8-065c52368692-metrics-client-ca\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.092642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.092360    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.092642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.092421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67178a84-1075-4569-a05c-4a6e2d2c3b44-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.093378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.093341    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.093677 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.093659    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.100355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.100330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvlpf\" (UniqueName: \"kubernetes.io/projected/35afdf9d-93c4-46c0-88d8-065c52368692-kube-api-access-wvlpf\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.101511 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.101471    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwngf\" (UniqueName: \"kubernetes.io/projected/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-api-access-hwngf\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.186687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.186653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.189495 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.189475    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:45.189595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.189530    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:45.195569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.195546    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:45.287274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.287239    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.387588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.387506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.487748 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.487713    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.589727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.589694    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.595856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.595832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.596017 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.595900    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-tls\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.598482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.598450    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/35afdf9d-93c4-46c0-88d8-065c52368692-node-exporter-tls\") pod \"node-exporter-s8k7q\" (UID: \"35afdf9d-93c4-46c0-88d8-065c52368692\") " pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.598604 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.598518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67178a84-1075-4569-a05c-4a6e2d2c3b44-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-52rbq\" (UID: \"67178a84-1075-4569-a05c-4a6e2d2c3b44\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.753826 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.753727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq"
Sep 18 22:18:45.760291 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.760245    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8k7q"
Sep 18 22:18:45.771945 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:45.771914    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35afdf9d_93c4_46c0_88d8_065c52368692.slice/crio-d952013253fe0d372f791002f4f50c2889aab4745faf03c6eecae0515cefaf1d WatchSource:0}: Error finding container d952013253fe0d372f791002f4f50c2889aab4745faf03c6eecae0515cefaf1d: Status 404 returned error can't find the container with id d952013253fe0d372f791002f4f50c2889aab4745faf03c6eecae0515cefaf1d
Sep 18 22:18:45.796899 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.796864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:45.868161 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:45.868121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:46.015308 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.015227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8k7q" event={"ID":"35afdf9d-93c4-46c0-88d8-065c52368692","Type":"ContainerStarted","Data":"d952013253fe0d372f791002f4f50c2889aab4745faf03c6eecae0515cefaf1d"}
Sep 18 22:18:46.019592 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.019556    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:18:46.037063 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.037037    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-52rbq"]
Sep 18 22:18:46.040914 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:46.040890    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67178a84_1075_4569_a05c_4a6e2d2c3b44.slice/crio-a058cc8266716c7c99edc594128475edbfcbe3556044627fae34d66d224092bf WatchSource:0}: Error finding container a058cc8266716c7c99edc594128475edbfcbe3556044627fae34d66d224092bf: Status 404 returned error can't find the container with id a058cc8266716c7c99edc594128475edbfcbe3556044627fae34d66d224092bf
Sep 18 22:18:46.129458 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.129427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:46.226198 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.226163    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:46.328901 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.328817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:46.534850 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.534806    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:46.639841 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:46.639740    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:47.021834 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.021767    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq" event={"ID":"67178a84-1075-4569-a05c-4a6e2d2c3b44","Type":"ContainerStarted","Data":"a058cc8266716c7c99edc594128475edbfcbe3556044627fae34d66d224092bf"}
Sep 18 22:18:47.023695 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.023663    2570 generic.go:356] "Generic (PLEG): container finished" podID="35afdf9d-93c4-46c0-88d8-065c52368692" containerID="f62a86a09041e4a5ddeb6bbc3890b37ca32d0422e96c3bb29b2fd9124a31619a" exitCode=0
Sep 18 22:18:47.023847 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.023765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8k7q" event={"ID":"35afdf9d-93c4-46c0-88d8-065c52368692","Type":"ContainerDied","Data":"f62a86a09041e4a5ddeb6bbc3890b37ca32d0422e96c3bb29b2fd9124a31619a"}
Sep 18 22:18:47.765984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.765950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:47.809816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.809767    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"]
Sep 18 22:18:47.814320 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.814296    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.817250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.817051    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 22:18:47.817250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.817067    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 22:18:47.817250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.817086    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 22:18:47.817250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.817151    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zmgj2\""
Sep 18 22:18:47.817250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.817074    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 22:18:47.817558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.817384    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c6frjtvup878p\""
Sep 18 22:18:47.817558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.817452    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 22:18:47.827485 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.827461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"]
Sep 18 22:18:47.857401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.857363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:47.916595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.916750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.916750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916634    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66c6b42f-6e91-46c0-baa5-68d21c642b0d-metrics-client-ca\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.916750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916692    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.916750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-grpc-tls\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.916959 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916812    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdbgc\" (UniqueName: \"kubernetes.io/projected/66c6b42f-6e91-46c0-baa5-68d21c642b0d-kube-api-access-sdbgc\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.916959 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-tls\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:47.916959 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:47.916860    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017348 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017348 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017348 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66c6b42f-6e91-46c0-baa5-68d21c642b0d-metrics-client-ca\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017581 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017581 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-grpc-tls\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017581 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdbgc\" (UniqueName: \"kubernetes.io/projected/66c6b42f-6e91-46c0-baa5-68d21c642b0d-kube-api-access-sdbgc\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017725 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017608    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-tls\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.017814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.017741    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.018170 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.018121    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66c6b42f-6e91-46c0-baa5-68d21c642b0d-metrics-client-ca\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.020396 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.020372    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.020547 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.020497    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-tls\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.020673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.020648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.020880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.020858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-grpc-tls\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.020935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.020873    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.021303 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.021282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/66c6b42f-6e91-46c0-baa5-68d21c642b0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.026191 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.026171    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdbgc\" (UniqueName: \"kubernetes.io/projected/66c6b42f-6e91-46c0-baa5-68d21c642b0d-kube-api-access-sdbgc\") pod \"thanos-querier-54d66f6ddd-gbqtm\" (UID: \"66c6b42f-6e91-46c0-baa5-68d21c642b0d\") " pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.030177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.030146    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8k7q" event={"ID":"35afdf9d-93c4-46c0-88d8-065c52368692","Type":"ContainerStarted","Data":"3434c842070c66feab2afb683d444397c235a33f9fc9aaf3e09efa36345f5c94"}
Sep 18 22:18:48.030265 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.030211    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8k7q" event={"ID":"35afdf9d-93c4-46c0-88d8-065c52368692","Type":"ContainerStarted","Data":"94340c81cdcec96bb5ebdd6a409c398621f0df1247856448e3057ce01bf4aa50"}
Sep 18 22:18:48.032424 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.032402    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq" event={"ID":"67178a84-1075-4569-a05c-4a6e2d2c3b44","Type":"ContainerStarted","Data":"e488e83386e0b92e37e748cad479a84356d7db1b2fd2e2fc0434f8de68078d02"}
Sep 18 22:18:48.032523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.032459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq" event={"ID":"67178a84-1075-4569-a05c-4a6e2d2c3b44","Type":"ContainerStarted","Data":"15fb429560a1b3d15c54214548b953afdaf7331a6384c6f9e4632aa60e9034bc"}
Sep 18 22:18:48.032523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.032490    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq" event={"ID":"67178a84-1075-4569-a05c-4a6e2d2c3b44","Type":"ContainerStarted","Data":"345ae91c75167470440c9416414a69a78449ab55010693c4c746aae986b492d0"}
Sep 18 22:18:48.040316 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.040297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:48.050552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.050509    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8k7q" podStartSLOduration=2.980915858 podStartE2EDuration="4.050495569s" totalImagesPullingTime="990.238712ms" totalInitContainerRuntime="79.340999ms" isStatefulPod=true podCreationTimestamp="2026-09-18 22:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:48.048888163 +0000 UTC m=+118.626833309" watchObservedRunningTime="2026-09-18 22:18:48.050495569 +0000 UTC m=+118.628440705"
Sep 18 22:18:48.069710 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.069672    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-52rbq" podStartSLOduration=2.7823778040000002 podStartE2EDuration="4.069659258s" totalImagesPullingTime="1.287281454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:48.068734254 +0000 UTC m=+118.646679399" watchObservedRunningTime="2026-09-18 22:18:48.069659258 +0000 UTC m=+118.647604403"
Sep 18 22:18:48.126133 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.126102    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:48.237314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.237284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:48.318205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.318121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:48.409066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.409036    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"]
Sep 18 22:18:48.411639 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:48.411604    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:48.412647 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:48.412626    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c6b42f_6e91_46c0_baa5_68d21c642b0d.slice/crio-16576e6f54a4e4418c411fff2954c427ba95a86c8eec3e6d06886af75440d211 WatchSource:0}: Error finding container 16576e6f54a4e4418c411fff2954c427ba95a86c8eec3e6d06886af75440d211: Status 404 returned error can't find the container with id 16576e6f54a4e4418c411fff2954c427ba95a86c8eec3e6d06886af75440d211
Sep 18 22:18:49.038060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.038014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" event={"ID":"66c6b42f-6e91-46c0-baa5-68d21c642b0d","Type":"ContainerStarted","Data":"16576e6f54a4e4418c411fff2954c427ba95a86c8eec3e6d06886af75440d211"}
Sep 18 22:18:49.606444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.606401    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:49.628612 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.628586    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"]
Sep 18 22:18:49.632212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.632184    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:49.635858 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.635826    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dfhcc\""
Sep 18 22:18:49.637657 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.637639    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 22:18:49.648753 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.648718    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"]
Sep 18 22:18:49.705264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.705228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:49.732744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.732718    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c352fdd7-7f56-4982-9dc3-71ed2956ee2b-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-k2pn6\" (UID: \"c352fdd7-7f56-4982-9dc3-71ed2956ee2b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:49.732934 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.732750    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dqvv\" (UniqueName: \"kubernetes.io/projected/c352fdd7-7f56-4982-9dc3-71ed2956ee2b-kube-api-access-7dqvv\") pod \"monitoring-plugin-5984459ff8-k2pn6\" (UID: \"c352fdd7-7f56-4982-9dc3-71ed2956ee2b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:49.834137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.834101    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c352fdd7-7f56-4982-9dc3-71ed2956ee2b-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-k2pn6\" (UID: \"c352fdd7-7f56-4982-9dc3-71ed2956ee2b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:49.834137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.834146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dqvv\" (UniqueName: \"kubernetes.io/projected/c352fdd7-7f56-4982-9dc3-71ed2956ee2b-kube-api-access-7dqvv\") pod \"monitoring-plugin-5984459ff8-k2pn6\" (UID: \"c352fdd7-7f56-4982-9dc3-71ed2956ee2b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:49.837157 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.837132    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c352fdd7-7f56-4982-9dc3-71ed2956ee2b-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-k2pn6\" (UID: \"c352fdd7-7f56-4982-9dc3-71ed2956ee2b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:49.843872 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.843851    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dqvv\" (UniqueName: \"kubernetes.io/projected/c352fdd7-7f56-4982-9dc3-71ed2956ee2b-kube-api-access-7dqvv\") pod \"monitoring-plugin-5984459ff8-k2pn6\" (UID: \"c352fdd7-7f56-4982-9dc3-71ed2956ee2b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:49.943726 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:49.943641    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:50.305699 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.305672    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74b9857d58-tt82r"]
Sep 18 22:18:50.309408 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.309387    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.325440 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.325417    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b9857d58-tt82r"]
Sep 18 22:18:50.338939 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.338903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-console-config\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.339055 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.338949    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknnt\" (UniqueName: \"kubernetes.io/projected/cde35234-383b-4917-9d7e-b5416d4ef19c-kube-api-access-vknnt\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.339055 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.339005    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-serving-cert\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.339182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.339056    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-service-ca\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.339182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.339103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-oauth-serving-cert\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.339258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.339197    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-oauth-config\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.339258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.339253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-trusted-ca-bundle\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.389530 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.389503    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"]
Sep 18 22:18:50.395612 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:50.395586    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc352fdd7_7f56_4982_9dc3_71ed2956ee2b.slice/crio-17abf3a7abe5de3529c15cac9a07c1b534a4bf556de34aa20cbee85c1ea8b5be WatchSource:0}: Error finding container 17abf3a7abe5de3529c15cac9a07c1b534a4bf556de34aa20cbee85c1ea8b5be: Status 404 returned error can't find the container with id 17abf3a7abe5de3529c15cac9a07c1b534a4bf556de34aa20cbee85c1ea8b5be
Sep 18 22:18:50.440368 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.440343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-trusted-ca-bundle\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.440480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.440393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-console-config\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.440535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.440517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknnt\" (UniqueName: \"kubernetes.io/projected/cde35234-383b-4917-9d7e-b5416d4ef19c-kube-api-access-vknnt\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.440617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.440595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-serving-cert\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.440730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.440623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-service-ca\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.440730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.440647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-oauth-serving-cert\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.440730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.440692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-oauth-config\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.441169 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.441146    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-console-config\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.441313 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.441207    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-trusted-ca-bundle\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.441404 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.441332    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-service-ca\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.441464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.441409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-oauth-serving-cert\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.444454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.444403    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-oauth-config\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.444705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.444685    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-serving-cert\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.450680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.450632    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknnt\" (UniqueName: \"kubernetes.io/projected/cde35234-383b-4917-9d7e-b5416d4ef19c-kube-api-access-vknnt\") pod \"console-74b9857d58-tt82r\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") " pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.548659 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.548546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:50.614847 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.614764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:50.628796 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.628749    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:18:50.917423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:50.917388    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b9857d58-tt82r"]
Sep 18 22:18:50.919942 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:18:50.919911    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde35234_383b_4917_9d7e_b5416d4ef19c.slice/crio-d3a1cc7ccfd988f5dd20e895214c9a77f9c049030975e20724960f4c3dae2f2f WatchSource:0}: Error finding container d3a1cc7ccfd988f5dd20e895214c9a77f9c049030975e20724960f4c3dae2f2f: Status 404 returned error can't find the container with id d3a1cc7ccfd988f5dd20e895214c9a77f9c049030975e20724960f4c3dae2f2f
Sep 18 22:18:51.052467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.052427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" event={"ID":"66c6b42f-6e91-46c0-baa5-68d21c642b0d","Type":"ContainerStarted","Data":"762cd122d93b3a65b0ef9178b1368d1b4a6b8b2087e5835d4babdf3c01330a38"}
Sep 18 22:18:51.052661 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.052509    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" event={"ID":"66c6b42f-6e91-46c0-baa5-68d21c642b0d","Type":"ContainerStarted","Data":"fce20a41d78e2030c5514ae2e9e0e76be198fcd971afc652e7d06d81a8954240"}
Sep 18 22:18:51.052661 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.052553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" event={"ID":"66c6b42f-6e91-46c0-baa5-68d21c642b0d","Type":"ContainerStarted","Data":"22edb87530ce7a256cfa572f14c5140aedf415fec820a415da3fe17257e8cad0"}
Sep 18 22:18:51.054129 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.054099    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6" event={"ID":"c352fdd7-7f56-4982-9dc3-71ed2956ee2b","Type":"ContainerStarted","Data":"17abf3a7abe5de3529c15cac9a07c1b534a4bf556de34aa20cbee85c1ea8b5be"}
Sep 18 22:18:51.056062 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.056009    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9857d58-tt82r" event={"ID":"cde35234-383b-4917-9d7e-b5416d4ef19c","Type":"ContainerStarted","Data":"9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc"}
Sep 18 22:18:51.056062 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.056056    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9857d58-tt82r" event={"ID":"cde35234-383b-4917-9d7e-b5416d4ef19c","Type":"ContainerStarted","Data":"d3a1cc7ccfd988f5dd20e895214c9a77f9c049030975e20724960f4c3dae2f2f"}
Sep 18 22:18:51.110910 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.109159    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74b9857d58-tt82r" podStartSLOduration=1.109135481 podStartE2EDuration="1.109135481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:51.1068548 +0000 UTC m=+121.684799946" watchObservedRunningTime="2026-09-18 22:18:51.109135481 +0000 UTC m=+121.687080628"
Sep 18 22:18:51.213121 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.213046    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:51.300159 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:51.300120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:52.062482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.062442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" event={"ID":"66c6b42f-6e91-46c0-baa5-68d21c642b0d","Type":"ContainerStarted","Data":"f4fa9d6b581bfb42a4383f0cb0a3541cbfb376ec1eb6589a04f3ff28a59f5923"}
Sep 18 22:18:52.062956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.062513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" event={"ID":"66c6b42f-6e91-46c0-baa5-68d21c642b0d","Type":"ContainerStarted","Data":"01e467a55482c868f176ec0743b881dc697550f478e3416c10bd83ff7734de4c"}
Sep 18 22:18:52.062956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.062547    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" event={"ID":"66c6b42f-6e91-46c0-baa5-68d21c642b0d","Type":"ContainerStarted","Data":"536552a070443d57c49cd4270c80f83e9511854c054c08f61c289ce5c3e5eb12"}
Sep 18 22:18:52.062956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.062593    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:18:52.064250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.064223    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6" event={"ID":"c352fdd7-7f56-4982-9dc3-71ed2956ee2b","Type":"ContainerStarted","Data":"53cdd536587dcd927aa33f0d1966f02662f26246c919c24b4e872ba9e52e6669"}
Sep 18 22:18:52.064346 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.064262    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:52.069420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.069398    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6"
Sep 18 22:18:52.089646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.089608    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm" podStartSLOduration=2.45061554 podStartE2EDuration="5.089594006s" totalImagesPullingTime="2.638978466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:52.087392681 +0000 UTC m=+122.665337825" watchObservedRunningTime="2026-09-18 22:18:52.089594006 +0000 UTC m=+122.667539186"
Sep 18 22:18:52.105670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:52.105628    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-k2pn6" podStartSLOduration=1.623155251 podStartE2EDuration="3.105615746s" totalImagesPullingTime="1.482460495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:52.104483016 +0000 UTC m=+122.682428164" watchObservedRunningTime="2026-09-18 22:18:52.105615746 +0000 UTC m=+122.683560890"
Sep 18 22:18:56.298097 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:56.298059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:56.398565 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:56.398537    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:18:58.074419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:18:58.074392    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54d66f6ddd-gbqtm"
Sep 18 22:19:00.342090 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:00.342060    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:00.466206 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:00.466161    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:00.629901 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:00.629809    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:19:00.630062 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:00.629917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:19:00.634518 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:00.634496    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:19:01.102366 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.102338    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:19:01.176338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.176295    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7bfdd455-g8nvw"]
Sep 18 22:19:01.225098 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.225043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:01.234216 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.234188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:19:01.236580 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.236553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f92073-6622-4825-8f48-ec08f7bff5ef-metrics-certs\") pod \"network-metrics-daemon-8rdzh\" (UID: \"c8f92073-6622-4825-8f48-ec08f7bff5ef\") " pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:19:01.318573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.318539    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:01.418334 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.418255    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:01.510199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.510171    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dq7t2\""
Sep 18 22:19:01.516581 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.516551    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:01.518057 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.518042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rdzh"
Sep 18 22:19:01.787161 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:01.787027    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rdzh"]
Sep 18 22:19:01.789611 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:19:01.789585    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f92073_6622_4825_8f48_ec08f7bff5ef.slice/crio-b6c5403fa8df4a5a2a63e2653b52da744b960cf5388a522fa1794e548127630b WatchSource:0}: Error finding container b6c5403fa8df4a5a2a63e2653b52da744b960cf5388a522fa1794e548127630b: Status 404 returned error can't find the container with id b6c5403fa8df4a5a2a63e2653b52da744b960cf5388a522fa1794e548127630b
Sep 18 22:19:02.104028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:02.103988    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rdzh" event={"ID":"c8f92073-6622-4825-8f48-ec08f7bff5ef","Type":"ContainerStarted","Data":"b6c5403fa8df4a5a2a63e2653b52da744b960cf5388a522fa1794e548127630b"}
Sep 18 22:19:03.110078 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:03.110045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rdzh" event={"ID":"c8f92073-6622-4825-8f48-ec08f7bff5ef","Type":"ContainerStarted","Data":"bf1bc304df8efc202700d0def9949096cd038457526478a864cf0b28020d14b8"}
Sep 18 22:19:04.116811 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:04.116755    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rdzh" event={"ID":"c8f92073-6622-4825-8f48-ec08f7bff5ef","Type":"ContainerStarted","Data":"cdfe80b1cfc9476891e2155896ae6bd637d9e830fade1f751548d0d5559cc360"}
Sep 18 22:19:04.134772 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:04.134720    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8rdzh" podStartSLOduration=131.984364651 podStartE2EDuration="2m13.134704695s" totalImagesPullingTime="1.150340044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:19:04.133660177 +0000 UTC m=+134.711605321" watchObservedRunningTime="2026-09-18 22:19:04.134704695 +0000 UTC m=+134.712649840"
Sep 18 22:19:04.241461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:04.241426    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:04.345138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:04.345105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:04.745436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:04.745394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:04.869344 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:04.869315    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:04.967888 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:04.967855    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:05.122767 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:05.122732    2570 generic.go:356] "Generic (PLEG): container finished" podID="1b6551bf-1cdc-445e-87dd-05ab71984d12" containerID="52ee93d202c6cec73616c694ea6b4164865a087afdbadd3b31f3e6931d58ebdf" exitCode=0
Sep 18 22:19:05.123191 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:05.122810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f" event={"ID":"1b6551bf-1cdc-445e-87dd-05ab71984d12","Type":"ContainerDied","Data":"52ee93d202c6cec73616c694ea6b4164865a087afdbadd3b31f3e6931d58ebdf"}
Sep 18 22:19:05.123191 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:05.123162    2570 scope.go:117] "RemoveContainer" containerID="52ee93d202c6cec73616c694ea6b4164865a087afdbadd3b31f3e6931d58ebdf"
Sep 18 22:19:05.361177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:05.361125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:05.461439 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:05.461350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:06.129549 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:06.129518    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-8jq4f" event={"ID":"1b6551bf-1cdc-445e-87dd-05ab71984d12","Type":"ContainerStarted","Data":"4b9e770f361e680982ced944324896b860423210adfa94306894448a337cdb15"}
Sep 18 22:19:09.350996 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:09.350945    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:09.412110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:09.412084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:12.832867 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:12.832828    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:12.894086 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:12.894052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:14.162848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:14.162813    2570 generic.go:356] "Generic (PLEG): container finished" podID="45f0850d-98f6-4875-8f6c-aef91d832769" containerID="520f57a1f6b719be07fb82fd6162c2df1a9b608e23f601d7a525915be1bad93e" exitCode=0
Sep 18 22:19:14.163243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:14.162882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh" event={"ID":"45f0850d-98f6-4875-8f6c-aef91d832769","Type":"ContainerDied","Data":"520f57a1f6b719be07fb82fd6162c2df1a9b608e23f601d7a525915be1bad93e"}
Sep 18 22:19:14.163243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:14.163195    2570 scope.go:117] "RemoveContainer" containerID="520f57a1f6b719be07fb82fd6162c2df1a9b608e23f601d7a525915be1bad93e"
Sep 18 22:19:15.168343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:15.168311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-qgnsh" event={"ID":"45f0850d-98f6-4875-8f6c-aef91d832769","Type":"ContainerStarted","Data":"515729b4b501e3cb3e4755d56e458f931e3ad794ce584ca66f563700b17fc28b"}
Sep 18 22:19:26.201144 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.201089    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c7bfdd455-g8nvw" podUID="382cb64d-b501-4728-982e-57f47ab4fbbd" containerName="console" containerID="cri-o://6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f" gracePeriod=15
Sep 18 22:19:26.441643 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.441620    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:19:26.561714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.561634    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-oauth-serving-cert\") pod \"382cb64d-b501-4728-982e-57f47ab4fbbd\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") "
Sep 18 22:19:26.561714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.561672    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-serving-cert\") pod \"382cb64d-b501-4728-982e-57f47ab4fbbd\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") "
Sep 18 22:19:26.561714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.561692    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-service-ca\") pod \"382cb64d-b501-4728-982e-57f47ab4fbbd\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") "
Sep 18 22:19:26.561714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.561710    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-oauth-config\") pod \"382cb64d-b501-4728-982e-57f47ab4fbbd\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") "
Sep 18 22:19:26.562074 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.561737    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-console-config\") pod \"382cb64d-b501-4728-982e-57f47ab4fbbd\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") "
Sep 18 22:19:26.562074 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.561772    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs5vp\" (UniqueName: \"kubernetes.io/projected/382cb64d-b501-4728-982e-57f47ab4fbbd-kube-api-access-zs5vp\") pod \"382cb64d-b501-4728-982e-57f47ab4fbbd\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") "
Sep 18 22:19:26.562074 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.561851    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-trusted-ca-bundle\") pod \"382cb64d-b501-4728-982e-57f47ab4fbbd\" (UID: \"382cb64d-b501-4728-982e-57f47ab4fbbd\") "
Sep 18 22:19:26.562333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.562301    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-service-ca" (OuterVolumeSpecName: "service-ca") pod "382cb64d-b501-4728-982e-57f47ab4fbbd" (UID: "382cb64d-b501-4728-982e-57f47ab4fbbd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:26.562506 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.562042    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "382cb64d-b501-4728-982e-57f47ab4fbbd" (UID: "382cb64d-b501-4728-982e-57f47ab4fbbd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:26.562679 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.562652    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-console-config" (OuterVolumeSpecName: "console-config") pod "382cb64d-b501-4728-982e-57f47ab4fbbd" (UID: "382cb64d-b501-4728-982e-57f47ab4fbbd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:26.562752 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.562721    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "382cb64d-b501-4728-982e-57f47ab4fbbd" (UID: "382cb64d-b501-4728-982e-57f47ab4fbbd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:26.565339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.565307    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382cb64d-b501-4728-982e-57f47ab4fbbd-kube-api-access-zs5vp" (OuterVolumeSpecName: "kube-api-access-zs5vp") pod "382cb64d-b501-4728-982e-57f47ab4fbbd" (UID: "382cb64d-b501-4728-982e-57f47ab4fbbd"). InnerVolumeSpecName "kube-api-access-zs5vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:26.569211 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.569182    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "382cb64d-b501-4728-982e-57f47ab4fbbd" (UID: "382cb64d-b501-4728-982e-57f47ab4fbbd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:19:26.569211 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.569199    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "382cb64d-b501-4728-982e-57f47ab4fbbd" (UID: "382cb64d-b501-4728-982e-57f47ab4fbbd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:19:26.663202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.663176    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-oauth-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:19:26.663202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.663200    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:19:26.663378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.663210    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:19:26.663378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.663218    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382cb64d-b501-4728-982e-57f47ab4fbbd-console-oauth-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:19:26.663378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.663226    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-console-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:19:26.663378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.663235    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs5vp\" (UniqueName: \"kubernetes.io/projected/382cb64d-b501-4728-982e-57f47ab4fbbd-kube-api-access-zs5vp\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:19:26.663378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:26.663243    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382cb64d-b501-4728-982e-57f47ab4fbbd-trusted-ca-bundle\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:19:27.225037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.224998    2570 generic.go:356] "Generic (PLEG): container finished" podID="382cb64d-b501-4728-982e-57f47ab4fbbd" containerID="6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f" exitCode=0
Sep 18 22:19:27.225526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.225066    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bfdd455-g8nvw"
Sep 18 22:19:27.225526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.225090    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bfdd455-g8nvw" event={"ID":"382cb64d-b501-4728-982e-57f47ab4fbbd","Type":"ContainerDied","Data":"6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f"}
Sep 18 22:19:27.225526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.225191    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bfdd455-g8nvw" event={"ID":"382cb64d-b501-4728-982e-57f47ab4fbbd","Type":"ContainerDied","Data":"2df14e3e54fb4e477b25706a9100c0f64d7751af7c474c58dcc15179766eec10"}
Sep 18 22:19:27.225526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.225237    2570 scope.go:117] "RemoveContainer" containerID="6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f"
Sep 18 22:19:27.234645 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.234624    2570 scope.go:117] "RemoveContainer" containerID="6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f"
Sep 18 22:19:27.234941 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:19:27.234919    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f\": container with ID starting with 6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f not found: ID does not exist" containerID="6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f"
Sep 18 22:19:27.235001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.234948    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f"} err="failed to get container status \"6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f\": rpc error: code = NotFound desc = could not find container \"6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f\": container with ID starting with 6a0ba5915fcdb046a980130bcb4deec3520bbf9bb72ee08bf648f6c420d6861f not found: ID does not exist"
Sep 18 22:19:27.245792 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.245762    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7bfdd455-g8nvw"]
Sep 18 22:19:27.249486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.249466    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7bfdd455-g8nvw"]
Sep 18 22:19:27.401853 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.401824    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382cb64d-b501-4728-982e-57f47ab4fbbd" path="/var/lib/kubelet/pods/382cb64d-b501-4728-982e-57f47ab4fbbd/volumes"
Sep 18 22:19:27.830588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.830558    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:27.901443 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:27.901418    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:28.109918 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:28.109891    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:19:56.062466 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:19:56.062430    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:04.130360 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:04.130323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:04.229229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:04.229199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:13.587364 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.587325    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75955dcc6c-tl4xc"]
Sep 18 22:20:13.587948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.587633    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382cb64d-b501-4728-982e-57f47ab4fbbd" containerName="console"
Sep 18 22:20:13.587948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.587647    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="382cb64d-b501-4728-982e-57f47ab4fbbd" containerName="console"
Sep 18 22:20:13.587948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.587715    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="382cb64d-b501-4728-982e-57f47ab4fbbd" containerName="console"
Sep 18 22:20:13.590627 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.590611    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.605376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.605349    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75955dcc6c-tl4xc"]
Sep 18 22:20:13.656643 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.656598    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:13.726774 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.726741    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-oauth-config\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.726970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.726830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-serving-cert\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.726970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.726868    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-service-ca\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.726970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.726889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-trusted-ca-bundle\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.726970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.726936    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-oauth-serving-cert\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.726970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.726963    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-config\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.727184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.726984    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbl4m\" (UniqueName: \"kubernetes.io/projected/bd76cda9-6cb3-4470-8f0f-b616c5546d74-kube-api-access-hbl4m\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.727597 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.727577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:13.827703 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.827669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-service-ca\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.827703 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.827701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-trusted-ca-bundle\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.827929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.827723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-oauth-serving-cert\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.827929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.827852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-config\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.827929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.827914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbl4m\" (UniqueName: \"kubernetes.io/projected/bd76cda9-6cb3-4470-8f0f-b616c5546d74-kube-api-access-hbl4m\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.828048 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.828021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-oauth-config\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.828099 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.828070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-serving-cert\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.828643 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.828609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-service-ca\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.828943 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.828647    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-oauth-serving-cert\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.828943 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.828669    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-config\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.829329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.829303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-trusted-ca-bundle\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.830602 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.830578    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-oauth-config\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.830799 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.830760    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-serving-cert\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.841548 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.838424    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbl4m\" (UniqueName: \"kubernetes.io/projected/bd76cda9-6cb3-4470-8f0f-b616c5546d74-kube-api-access-hbl4m\") pod \"console-75955dcc6c-tl4xc\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") " pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:13.900676 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:13.900635    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:14.172535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:14.172512    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75955dcc6c-tl4xc"]
Sep 18 22:20:14.174762 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:20:14.174733    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd76cda9_6cb3_4470_8f0f_b616c5546d74.slice/crio-fbbf105ee273458adfd37e98b9c58ab2e5f47686a9883df193c1f1ec860bde03 WatchSource:0}: Error finding container fbbf105ee273458adfd37e98b9c58ab2e5f47686a9883df193c1f1ec860bde03: Status 404 returned error can't find the container with id fbbf105ee273458adfd37e98b9c58ab2e5f47686a9883df193c1f1ec860bde03
Sep 18 22:20:14.406515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:14.406476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75955dcc6c-tl4xc" event={"ID":"bd76cda9-6cb3-4470-8f0f-b616c5546d74","Type":"ContainerStarted","Data":"1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376"}
Sep 18 22:20:14.406684 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:14.406532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75955dcc6c-tl4xc" event={"ID":"bd76cda9-6cb3-4470-8f0f-b616c5546d74","Type":"ContainerStarted","Data":"fbbf105ee273458adfd37e98b9c58ab2e5f47686a9883df193c1f1ec860bde03"}
Sep 18 22:20:14.426002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:14.425900    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75955dcc6c-tl4xc" podStartSLOduration=1.425883407 podStartE2EDuration="1.425883407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:14.423950974 +0000 UTC m=+205.001896119" watchObservedRunningTime="2026-09-18 22:20:14.425883407 +0000 UTC m=+205.003828576"
Sep 18 22:20:15.456837 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:15.456807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:16.651868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:16.651832    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:19.308243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:19.308211    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:19.421297 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:19.421262    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:23.901263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:23.901227    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:23.901661 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:23.901287    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:23.906546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:23.906522    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:24.449834 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.449808    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:20:24.501677 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.501634    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b9857d58-tt82r"]
Sep 18 22:20:24.634740 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.634709    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-596db75ffc-vnb2j"]
Sep 18 22:20:24.638236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.638214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.653081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.653057    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596db75ffc-vnb2j"]
Sep 18 22:20:24.670792 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.670761    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:24.724164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.724084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-console-config\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.724164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.724121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-trusted-ca-bundle\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.724339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.724167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-serving-cert\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.724339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.724212    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-oauth-serving-cert\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.724339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.724231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-oauth-config\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.724339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.724258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-service-ca\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.724339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.724286    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljtf\" (UniqueName: \"kubernetes.io/projected/df1925e7-5f92-4fec-8735-0c444efc3515-kube-api-access-8ljtf\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.767157 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.767128    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:24.824975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.824945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-console-config\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.825138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.824981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-trusted-ca-bundle\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.825138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.825121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-serving-cert\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.825305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.825162    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-oauth-serving-cert\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.825365 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.825294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-oauth-config\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.825365 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.825340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-service-ca\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.825473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.825372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljtf\" (UniqueName: \"kubernetes.io/projected/df1925e7-5f92-4fec-8735-0c444efc3515-kube-api-access-8ljtf\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.825956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.825924    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-console-config\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.826066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.825927    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-oauth-serving-cert\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.826066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.826025    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-service-ca\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.826310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.826289    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-trusted-ca-bundle\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.827851 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.827831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-serving-cert\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.827938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.827892    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-oauth-config\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.835750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.835727    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljtf\" (UniqueName: \"kubernetes.io/projected/df1925e7-5f92-4fec-8735-0c444efc3515-kube-api-access-8ljtf\") pod \"console-596db75ffc-vnb2j\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") " pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:24.948066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:24.948036    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:25.152934 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:25.152895    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:25.220359 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:25.220324    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596db75ffc-vnb2j"]
Sep 18 22:20:25.223457 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:20:25.223429    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1925e7_5f92_4fec_8735_0c444efc3515.slice/crio-6f78078038929bd7b7aa4f9b3ff3b9e882f47d0b53470f869a40eb36ca51fd78 WatchSource:0}: Error finding container 6f78078038929bd7b7aa4f9b3ff3b9e882f47d0b53470f869a40eb36ca51fd78: Status 404 returned error can't find the container with id 6f78078038929bd7b7aa4f9b3ff3b9e882f47d0b53470f869a40eb36ca51fd78
Sep 18 22:20:25.223887 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:25.223861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:25.451310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:25.451270    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596db75ffc-vnb2j" event={"ID":"df1925e7-5f92-4fec-8735-0c444efc3515","Type":"ContainerStarted","Data":"5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd"}
Sep 18 22:20:25.451490 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:25.451329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596db75ffc-vnb2j" event={"ID":"df1925e7-5f92-4fec-8735-0c444efc3515","Type":"ContainerStarted","Data":"6f78078038929bd7b7aa4f9b3ff3b9e882f47d0b53470f869a40eb36ca51fd78"}
Sep 18 22:20:25.475052 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:25.475002    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-596db75ffc-vnb2j" podStartSLOduration=1.474988328 podStartE2EDuration="1.474988328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:25.474149751 +0000 UTC m=+216.052094896" watchObservedRunningTime="2026-09-18 22:20:25.474988328 +0000 UTC m=+216.052933473"
Sep 18 22:20:31.058359 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:31.058327    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:31.114216 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:31.114186    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:34.948375 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:34.948343    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:34.948745 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:34.948392    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:34.953060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:34.953044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:35.496716 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:35.496684    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:20:35.538096 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:35.538067    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75955dcc6c-tl4xc"]
Sep 18 22:20:35.625908 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:35.625882    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:35.727536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:35.727509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:35.782373 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:35.782303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:41.069069 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:41.069037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:41.140644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:41.140616    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:42.827001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:42.826971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:42.926647 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:42.926613    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:20:49.525413 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.525372    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74b9857d58-tt82r" podUID="cde35234-383b-4917-9d7e-b5416d4ef19c" containerName="console" containerID="cri-o://9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc" gracePeriod=15
Sep 18 22:20:49.766042 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.766019    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:20:49.816890 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.816814    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-console-config\") pod \"cde35234-383b-4917-9d7e-b5416d4ef19c\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") "
Sep 18 22:20:49.816890 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.816855    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-serving-cert\") pod \"cde35234-383b-4917-9d7e-b5416d4ef19c\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") "
Sep 18 22:20:49.816890 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.816880    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-trusted-ca-bundle\") pod \"cde35234-383b-4917-9d7e-b5416d4ef19c\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") "
Sep 18 22:20:49.817190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.816903    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-oauth-config\") pod \"cde35234-383b-4917-9d7e-b5416d4ef19c\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") "
Sep 18 22:20:49.817190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.816924    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-oauth-serving-cert\") pod \"cde35234-383b-4917-9d7e-b5416d4ef19c\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") "
Sep 18 22:20:49.817190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.816965    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vknnt\" (UniqueName: \"kubernetes.io/projected/cde35234-383b-4917-9d7e-b5416d4ef19c-kube-api-access-vknnt\") pod \"cde35234-383b-4917-9d7e-b5416d4ef19c\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") "
Sep 18 22:20:49.817190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.816997    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-service-ca\") pod \"cde35234-383b-4917-9d7e-b5416d4ef19c\" (UID: \"cde35234-383b-4917-9d7e-b5416d4ef19c\") "
Sep 18 22:20:49.817399 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.817273    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-console-config" (OuterVolumeSpecName: "console-config") pod "cde35234-383b-4917-9d7e-b5416d4ef19c" (UID: "cde35234-383b-4917-9d7e-b5416d4ef19c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:20:49.817522 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.817491    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cde35234-383b-4917-9d7e-b5416d4ef19c" (UID: "cde35234-383b-4917-9d7e-b5416d4ef19c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:20:49.817596 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.817508    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cde35234-383b-4917-9d7e-b5416d4ef19c" (UID: "cde35234-383b-4917-9d7e-b5416d4ef19c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:20:49.817651 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.817616    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-service-ca" (OuterVolumeSpecName: "service-ca") pod "cde35234-383b-4917-9d7e-b5416d4ef19c" (UID: "cde35234-383b-4917-9d7e-b5416d4ef19c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:20:49.819203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.819183    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cde35234-383b-4917-9d7e-b5416d4ef19c" (UID: "cde35234-383b-4917-9d7e-b5416d4ef19c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:20:49.819263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.819229    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde35234-383b-4917-9d7e-b5416d4ef19c-kube-api-access-vknnt" (OuterVolumeSpecName: "kube-api-access-vknnt") pod "cde35234-383b-4917-9d7e-b5416d4ef19c" (UID: "cde35234-383b-4917-9d7e-b5416d4ef19c"). InnerVolumeSpecName "kube-api-access-vknnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:20:49.819329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.819309    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cde35234-383b-4917-9d7e-b5416d4ef19c" (UID: "cde35234-383b-4917-9d7e-b5416d4ef19c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:20:49.917650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.917615    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-console-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:20:49.917650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.917645    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:20:49.917650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.917654    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-trusted-ca-bundle\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:20:49.917650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.917663    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cde35234-383b-4917-9d7e-b5416d4ef19c-console-oauth-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:20:49.917935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.917674    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-oauth-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:20:49.917935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.917685    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vknnt\" (UniqueName: \"kubernetes.io/projected/cde35234-383b-4917-9d7e-b5416d4ef19c-kube-api-access-vknnt\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:20:49.917935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:49.917693    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cde35234-383b-4917-9d7e-b5416d4ef19c-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:20:50.550648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.550607    2570 generic.go:356] "Generic (PLEG): container finished" podID="cde35234-383b-4917-9d7e-b5416d4ef19c" containerID="9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc" exitCode=0
Sep 18 22:20:50.550648 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.550654    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9857d58-tt82r"
Sep 18 22:20:50.551100 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.550686    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9857d58-tt82r" event={"ID":"cde35234-383b-4917-9d7e-b5416d4ef19c","Type":"ContainerDied","Data":"9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc"}
Sep 18 22:20:50.551100 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.550737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9857d58-tt82r" event={"ID":"cde35234-383b-4917-9d7e-b5416d4ef19c","Type":"ContainerDied","Data":"d3a1cc7ccfd988f5dd20e895214c9a77f9c049030975e20724960f4c3dae2f2f"}
Sep 18 22:20:50.551100 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.550757    2570 scope.go:117] "RemoveContainer" containerID="9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc"
Sep 18 22:20:50.559569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.559549    2570 scope.go:117] "RemoveContainer" containerID="9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc"
Sep 18 22:20:50.559913 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:20:50.559895    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc\": container with ID starting with 9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc not found: ID does not exist" containerID="9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc"
Sep 18 22:20:50.559986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.559921    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc"} err="failed to get container status \"9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc\": rpc error: code = NotFound desc = could not find container \"9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc\": container with ID starting with 9716d1694b7bdb647c69682bb72d6c78ab53d6be2796b0dd35fcda87107d45fc not found: ID does not exist"
Sep 18 22:20:50.572324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.572301    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b9857d58-tt82r"]
Sep 18 22:20:50.577680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:50.576706    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74b9857d58-tt82r"]
Sep 18 22:20:51.401931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:20:51.401900    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde35234-383b-4917-9d7e-b5416d4ef19c" path="/var/lib/kubelet/pods/cde35234-383b-4917-9d7e-b5416d4ef19c/volumes"
Sep 18 22:21:00.561482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.561412    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75955dcc6c-tl4xc" podUID="bd76cda9-6cb3-4470-8f0f-b616c5546d74" containerName="console" containerID="cri-o://1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376" gracePeriod=15
Sep 18 22:21:00.803040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.803016    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:21:00.896093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896060    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-oauth-serving-cert\") pod \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") "
Sep 18 22:21:00.896093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896096    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-oauth-config\") pod \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") "
Sep 18 22:21:00.896317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896111    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-config\") pod \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") "
Sep 18 22:21:00.896317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896129    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-trusted-ca-bundle\") pod \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") "
Sep 18 22:21:00.896317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896153    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-serving-cert\") pod \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") "
Sep 18 22:21:00.896317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896212    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-service-ca\") pod \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") "
Sep 18 22:21:00.896317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896258    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbl4m\" (UniqueName: \"kubernetes.io/projected/bd76cda9-6cb3-4470-8f0f-b616c5546d74-kube-api-access-hbl4m\") pod \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\" (UID: \"bd76cda9-6cb3-4470-8f0f-b616c5546d74\") "
Sep 18 22:21:00.896554 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896496    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd76cda9-6cb3-4470-8f0f-b616c5546d74" (UID: "bd76cda9-6cb3-4470-8f0f-b616c5546d74"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:00.896554 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896519    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-config" (OuterVolumeSpecName: "console-config") pod "bd76cda9-6cb3-4470-8f0f-b616c5546d74" (UID: "bd76cda9-6cb3-4470-8f0f-b616c5546d74"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:00.896950 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896926    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd76cda9-6cb3-4470-8f0f-b616c5546d74" (UID: "bd76cda9-6cb3-4470-8f0f-b616c5546d74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:00.897024 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.896969    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd76cda9-6cb3-4470-8f0f-b616c5546d74" (UID: "bd76cda9-6cb3-4470-8f0f-b616c5546d74"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:21:00.898521 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.898498    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd76cda9-6cb3-4470-8f0f-b616c5546d74-kube-api-access-hbl4m" (OuterVolumeSpecName: "kube-api-access-hbl4m") pod "bd76cda9-6cb3-4470-8f0f-b616c5546d74" (UID: "bd76cda9-6cb3-4470-8f0f-b616c5546d74"). InnerVolumeSpecName "kube-api-access-hbl4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:21:00.899018 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.898997    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd76cda9-6cb3-4470-8f0f-b616c5546d74" (UID: "bd76cda9-6cb3-4470-8f0f-b616c5546d74"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:21:00.899115 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.899040    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd76cda9-6cb3-4470-8f0f-b616c5546d74" (UID: "bd76cda9-6cb3-4470-8f0f-b616c5546d74"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:21:00.997595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.997551    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-oauth-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:21:00.997595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.997589    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-oauth-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:21:00.997595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.997598    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:21:00.997595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.997606    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-trusted-ca-bundle\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:21:00.997903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.997614    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd76cda9-6cb3-4470-8f0f-b616c5546d74-console-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:21:00.997903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.997622    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd76cda9-6cb3-4470-8f0f-b616c5546d74-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:21:00.997903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:00.997631    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbl4m\" (UniqueName: \"kubernetes.io/projected/bd76cda9-6cb3-4470-8f0f-b616c5546d74-kube-api-access-hbl4m\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:21:01.596472 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.596435    2570 generic.go:356] "Generic (PLEG): container finished" podID="bd76cda9-6cb3-4470-8f0f-b616c5546d74" containerID="1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376" exitCode=0
Sep 18 22:21:01.596472 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.596476    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75955dcc6c-tl4xc"
Sep 18 22:21:01.596952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.596489    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75955dcc6c-tl4xc" event={"ID":"bd76cda9-6cb3-4470-8f0f-b616c5546d74","Type":"ContainerDied","Data":"1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376"}
Sep 18 22:21:01.596952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.596537    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75955dcc6c-tl4xc" event={"ID":"bd76cda9-6cb3-4470-8f0f-b616c5546d74","Type":"ContainerDied","Data":"fbbf105ee273458adfd37e98b9c58ab2e5f47686a9883df193c1f1ec860bde03"}
Sep 18 22:21:01.596952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.596562    2570 scope.go:117] "RemoveContainer" containerID="1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376"
Sep 18 22:21:01.604960 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.604939    2570 scope.go:117] "RemoveContainer" containerID="1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376"
Sep 18 22:21:01.605223 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:21:01.605207    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376\": container with ID starting with 1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376 not found: ID does not exist" containerID="1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376"
Sep 18 22:21:01.605288 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.605231    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376"} err="failed to get container status \"1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376\": rpc error: code = NotFound desc = could not find container \"1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376\": container with ID starting with 1652f9b44dc9cb62e33a1f8c376e707d8bd4305eb5d2d4574122dfc79dc1f376 not found: ID does not exist"
Sep 18 22:21:01.612611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.612588    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75955dcc6c-tl4xc"]
Sep 18 22:21:01.616721 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:01.616702    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75955dcc6c-tl4xc"]
Sep 18 22:21:03.402184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:03.402095    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd76cda9-6cb3-4470-8f0f-b616c5546d74" path="/var/lib/kubelet/pods/bd76cda9-6cb3-4470-8f0f-b616c5546d74/volumes"
Sep 18 22:21:11.024496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:11.024460    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:11.124543 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:11.124507    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:32.756009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:32.755974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:33.820875 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:33.820837    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:36.372695 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:36.372662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:36.473634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:36.473595    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:38.130537 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:38.130507    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:38.238248 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:38.238196    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:38.338738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:38.338703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:40.524288 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:40.524256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:40.714805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:40.714762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:43.174318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:43.174287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:43.274321 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:43.274288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:46.094312 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.094267    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"]
Sep 18 22:21:46.094680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.094579    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd76cda9-6cb3-4470-8f0f-b616c5546d74" containerName="console"
Sep 18 22:21:46.094680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.094591    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd76cda9-6cb3-4470-8f0f-b616c5546d74" containerName="console"
Sep 18 22:21:46.094680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.094605    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde35234-383b-4917-9d7e-b5416d4ef19c" containerName="console"
Sep 18 22:21:46.094680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.094614    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde35234-383b-4917-9d7e-b5416d4ef19c" containerName="console"
Sep 18 22:21:46.094857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.094682    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde35234-383b-4917-9d7e-b5416d4ef19c" containerName="console"
Sep 18 22:21:46.094857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.094697    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd76cda9-6cb3-4470-8f0f-b616c5546d74" containerName="console"
Sep 18 22:21:46.097698 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.097681    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.100113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.100092    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 22:21:46.100919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.100904    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 22:21:46.101013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.100912    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zgtkl\""
Sep 18 22:21:46.108454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.108431    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"]
Sep 18 22:21:46.257005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.256967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd2rx\" (UniqueName: \"kubernetes.io/projected/fe4f157f-37c3-43cc-9627-740fc0e39c4f-kube-api-access-fd2rx\") pod \"cert-manager-cainjector-559cdd8c87-bdjjn\" (UID: \"fe4f157f-37c3-43cc-9627-740fc0e39c4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.257176 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.257046    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe4f157f-37c3-43cc-9627-740fc0e39c4f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bdjjn\" (UID: \"fe4f157f-37c3-43cc-9627-740fc0e39c4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.358381 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.358310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe4f157f-37c3-43cc-9627-740fc0e39c4f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bdjjn\" (UID: \"fe4f157f-37c3-43cc-9627-740fc0e39c4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.358381 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.358364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd2rx\" (UniqueName: \"kubernetes.io/projected/fe4f157f-37c3-43cc-9627-740fc0e39c4f-kube-api-access-fd2rx\") pod \"cert-manager-cainjector-559cdd8c87-bdjjn\" (UID: \"fe4f157f-37c3-43cc-9627-740fc0e39c4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.367252 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.367218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe4f157f-37c3-43cc-9627-740fc0e39c4f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bdjjn\" (UID: \"fe4f157f-37c3-43cc-9627-740fc0e39c4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.367367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.367301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd2rx\" (UniqueName: \"kubernetes.io/projected/fe4f157f-37c3-43cc-9627-740fc0e39c4f-kube-api-access-fd2rx\") pod \"cert-manager-cainjector-559cdd8c87-bdjjn\" (UID: \"fe4f157f-37c3-43cc-9627-740fc0e39c4f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.406655 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.406630    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"
Sep 18 22:21:46.676754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.676729    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn"]
Sep 18 22:21:46.679599 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:21:46.679572    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe4f157f_37c3_43cc_9627_740fc0e39c4f.slice/crio-0e8b36f58f173356dc377c162c4870eb56cfba73667ae64b4175ac1205937f10 WatchSource:0}: Error finding container 0e8b36f58f173356dc377c162c4870eb56cfba73667ae64b4175ac1205937f10: Status 404 returned error can't find the container with id 0e8b36f58f173356dc377c162c4870eb56cfba73667ae64b4175ac1205937f10
Sep 18 22:21:46.769201 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:46.769171    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn" event={"ID":"fe4f157f-37c3-43cc-9627-740fc0e39c4f","Type":"ContainerStarted","Data":"0e8b36f58f173356dc377c162c4870eb56cfba73667ae64b4175ac1205937f10"}
Sep 18 22:21:48.324111 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:48.324074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:49.512396 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:49.512354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:49.612143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:49.612091    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:50.569445 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:50.569417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:50.789108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:50.789074    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn" event={"ID":"fe4f157f-37c3-43cc-9627-740fc0e39c4f","Type":"ContainerStarted","Data":"347d237e5d24e7d5a21c38ad345013e1c95d0895c14a75a795ce1e75b3f6913e"}
Sep 18 22:21:50.808421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:50.808369    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bdjjn" podStartSLOduration=1.710473779 podStartE2EDuration="4.808348216s" totalImagesPullingTime="3.097874437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:50.806440295 +0000 UTC m=+301.384385442" watchObservedRunningTime="2026-09-18 22:21:50.808348216 +0000 UTC m=+301.386293361"
Sep 18 22:21:51.313345 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:51.313320    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:21:51.319658 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:51.319614    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:21:51.320029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:51.320011    2570 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 22:21:54.779217 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:54.779178    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:21:54.874542 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:21:54.874512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:01.633635 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:01.633597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:01.730633 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:01.730602    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:03.358628 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:03.358593    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:08.597110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:08.597075    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:09.658982 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:09.658932    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:09.757795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:09.757754    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:15.935165 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:15.935128    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.081506 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.081440    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.294694 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.294661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.358109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.358081    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"]
Sep 18 22:22:17.361514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.361492    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.364208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.364186    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 22:22:17.364314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.364243    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6vdvw\""
Sep 18 22:22:17.365376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.365361    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 22:22:17.365461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.365392    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 22:22:17.366593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.366579    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 22:22:17.396883 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.396853    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"]
Sep 18 22:22:17.419382 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.419355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-manifests\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.419514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.419391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-tmp\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.419514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.419414    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.419514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.419463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kk27\" (UniqueName: \"kubernetes.io/projected/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-kube-api-access-7kk27\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.419627 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.419532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.520007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.519972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.520224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.520032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-manifests\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.520224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.520059    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-tmp\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.520224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.520080    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.520224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.520100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kk27\" (UniqueName: \"kubernetes.io/projected/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-kube-api-access-7kk27\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.520589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.520560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-manifests\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.522984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.522959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.523101 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.523010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-tmp\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.523240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.523216    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.531536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.531512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kk27\" (UniqueName: \"kubernetes.io/projected/327177e8-0ff4-4419-9fa3-5e69f5b71d2a-kube-api-access-7kk27\") pod \"opendatahub-operator-controller-manager-65c85dbc8b-w8qqh\" (UID: \"327177e8-0ff4-4419-9fa3-5e69f5b71d2a\") " pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.532480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.532459    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.633801 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.633702    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.672158 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.672129    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:17.750277 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.750252    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.849789 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.849758    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.955076 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.955052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:17.955601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.955579    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"]
Sep 18 22:22:17.957256 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:22:17.957237    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327177e8_0ff4_4419_9fa3_5e69f5b71d2a.slice/crio-b04d6d3bc663c71439d2947f38c8b4adb9e27eee2300f2e1d7f2c70dd4f47d3a WatchSource:0}: Error finding container b04d6d3bc663c71439d2947f38c8b4adb9e27eee2300f2e1d7f2c70dd4f47d3a: Status 404 returned error can't find the container with id b04d6d3bc663c71439d2947f38c8b4adb9e27eee2300f2e1d7f2c70dd4f47d3a
Sep 18 22:22:17.958987 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:17.958972    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:22:18.047373 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:18.047337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:18.902930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:18.902895    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh" event={"ID":"327177e8-0ff4-4419-9fa3-5e69f5b71d2a","Type":"ContainerStarted","Data":"b04d6d3bc663c71439d2947f38c8b4adb9e27eee2300f2e1d7f2c70dd4f47d3a"}
Sep 18 22:22:21.919170 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:21.919136    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh" event={"ID":"327177e8-0ff4-4419-9fa3-5e69f5b71d2a","Type":"ContainerStarted","Data":"23c872e84d66a1ff2dbe8488c89804b3215a1277560a5e4849bc4c2eed983025"}
Sep 18 22:22:22.924579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:22.924546    2570 generic.go:356] "Generic (PLEG): container finished" podID="327177e8-0ff4-4419-9fa3-5e69f5b71d2a" containerID="23c872e84d66a1ff2dbe8488c89804b3215a1277560a5e4849bc4c2eed983025" exitCode=0
Sep 18 22:22:22.924955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:22.924637    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh" event={"ID":"327177e8-0ff4-4419-9fa3-5e69f5b71d2a","Type":"ContainerDied","Data":"23c872e84d66a1ff2dbe8488c89804b3215a1277560a5e4849bc4c2eed983025"}
Sep 18 22:22:23.930601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:23.930567    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh" event={"ID":"327177e8-0ff4-4419-9fa3-5e69f5b71d2a","Type":"ContainerStarted","Data":"6588896e3589dd708b5cdcb0b7c66575443d1f4622b63e08d3353d18e4fe8f22"}
Sep 18 22:22:23.931007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:23.930676    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:23.954510 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:23.954396    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh" podStartSLOduration=2.421484436 podStartE2EDuration="6.954376203s" totalImagesPullingTime="3.471108997s" totalInitContainerRuntime="1.06178277s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:22:23.953058092 +0000 UTC m=+334.531003237" watchObservedRunningTime="2026-09-18 22:22:23.954376203 +0000 UTC m=+334.532321349"
Sep 18 22:22:27.619106 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:27.619073    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:27.758295 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:27.758266    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:34.937932 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:34.937854    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65c85dbc8b-w8qqh"
Sep 18 22:22:36.672449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:36.672392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:36.831771 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:36.831725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:37.231958 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.231921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:37.233217 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.233197    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"]
Sep 18 22:22:37.236479 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.236464    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.241121 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.241104    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 18 22:22:37.241200 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.241187    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 18 22:22:37.268195 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.268169    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"]
Sep 18 22:22:37.383684 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.383636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wkfq\" (UniqueName: \"kubernetes.io/projected/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-kube-api-access-6wkfq\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.383893 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.383740    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tls-certs\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.383893 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.383837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tmp\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.484356 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.484271    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wkfq\" (UniqueName: \"kubernetes.io/projected/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-kube-api-access-6wkfq\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.484356 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.484325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tls-certs\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.484586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.484439    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tmp\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.484586 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:22:37.484445    2570 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 18 22:22:37.484586 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:22:37.484514    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tls-certs podName:2a1adce9-0c0c-4da8-9eee-92e60d09c3ac nodeName:}" failed. No retries permitted until 2026-09-18 22:22:37.98449412 +0000 UTC m=+348.562439270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tls-certs") pod "kube-auth-proxy-6b786b9564-lhwbt" (UID: "2a1adce9-0c0c-4da8-9eee-92e60d09c3ac") : secret "kube-auth-proxy-tls" not found
Sep 18 22:22:37.486891 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.486870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tmp\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.513715 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.513681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wkfq\" (UniqueName: \"kubernetes.io/projected/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-kube-api-access-6wkfq\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.988882 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.988843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tls-certs\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:37.991707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:37.991681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a1adce9-0c0c-4da8-9eee-92e60d09c3ac-tls-certs\") pod \"kube-auth-proxy-6b786b9564-lhwbt\" (UID: \"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac\") " pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:38.051074 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:38.051044    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:38.146053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:38.146017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"
Sep 18 22:22:38.438617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:38.438593    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt"]
Sep 18 22:22:38.440925 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:22:38.440896    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1adce9_0c0c_4da8_9eee_92e60d09c3ac.slice/crio-5a23393c62d9b6b197c6e159139ab9b7f1d41a5202185e5e8ecd86475829c868 WatchSource:0}: Error finding container 5a23393c62d9b6b197c6e159139ab9b7f1d41a5202185e5e8ecd86475829c868: Status 404 returned error can't find the container with id 5a23393c62d9b6b197c6e159139ab9b7f1d41a5202185e5e8ecd86475829c868
Sep 18 22:22:38.994383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:38.994349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt" event={"ID":"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac","Type":"ContainerStarted","Data":"5a23393c62d9b6b197c6e159139ab9b7f1d41a5202185e5e8ecd86475829c868"}
Sep 18 22:22:39.178524 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.178490    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"]
Sep 18 22:22:39.181991 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.181965    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.182316 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.182294    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:39.186003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.185972    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 22:22:39.186124 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.186056    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 22:22:39.186358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.186339    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4t99f\""
Sep 18 22:22:39.186477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.186407    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 22:22:39.186477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.186422    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 22:22:39.204043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.203979    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"]
Sep 18 22:22:39.273210 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.273124    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:39.301057 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.301023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce003e2-214d-41e2-801c-c8eaed23caee-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.301231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.301082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcw6\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-kube-api-access-txcw6\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.301231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.301164    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.301231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.301201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.301420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.301284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.301420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.301338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.301420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.301403    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.401921 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.401886    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.402116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.401942    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.402116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.401993    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.402116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.402033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.402116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.402081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.402116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.402118    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce003e2-214d-41e2-801c-c8eaed23caee-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.402389 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.402156    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcw6\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-kube-api-access-txcw6\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.404457 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.402939    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.405993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.405948    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.406287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.406260    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.406903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.406858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce003e2-214d-41e2-801c-c8eaed23caee-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.407922 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.407899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.412200 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.412159    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.412200 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.412174    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcw6\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-kube-api-access-txcw6\") pod \"istiod-openshift-gateway-7b7995d5cd-wqlz6\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.496304 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.496269    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:39.796214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:39.796174    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"]
Sep 18 22:22:40.694331 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:40.694298    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:41.110488 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:22:41.110437    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce003e2_214d_41e2_801c_c8eaed23caee.slice/crio-237eecf625d73fcf3e32ca00e58996461268cf585b413b03630a57fe0e7645aa WatchSource:0}: Error finding container 237eecf625d73fcf3e32ca00e58996461268cf585b413b03630a57fe0e7645aa: Status 404 returned error can't find the container with id 237eecf625d73fcf3e32ca00e58996461268cf585b413b03630a57fe0e7645aa
Sep 18 22:22:42.008582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:42.008542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt" event={"ID":"2a1adce9-0c0c-4da8-9eee-92e60d09c3ac","Type":"ContainerStarted","Data":"0df12799bd7c934ab166e1987ad6c3a03a5393aade5bf5ba603d47c2d799cf65"}
Sep 18 22:22:42.009771 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:42.009747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6" event={"ID":"6ce003e2-214d-41e2-801c-c8eaed23caee","Type":"ContainerStarted","Data":"237eecf625d73fcf3e32ca00e58996461268cf585b413b03630a57fe0e7645aa"}
Sep 18 22:22:42.026839 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:42.026798    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt" podStartSLOduration=2.307108642 podStartE2EDuration="5.026767892s" totalImagesPullingTime="2.71965925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:22:42.024933311 +0000 UTC m=+352.602878458" watchObservedRunningTime="2026-09-18 22:22:42.026767892 +0000 UTC m=+352.604713090"
Sep 18 22:22:42.196819 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:42.196770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:42.262677 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:42.262599    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:47.515535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:47.515504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:47.614475 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:47.614432    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:47.714829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:47.714771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:47.836672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:47.836642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:48.219150 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:48.219070    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:54.873005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:54.872966    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:22:54.873279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:54.873037    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:22:55.070914 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:55.070870    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6" event={"ID":"6ce003e2-214d-41e2-801c-c8eaed23caee","Type":"ContainerStarted","Data":"be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5"}
Sep 18 22:22:55.071109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:55.071090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:55.072847 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:55.072824    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-wqlz6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:22:55.072965 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:55.072868    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6" podUID="6ce003e2-214d-41e2-801c-c8eaed23caee" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:22:55.661144 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:55.661105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:55.776184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:55.776148    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:56.052276 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.052187    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6" podStartSLOduration=3.291959152 podStartE2EDuration="17.05216943s" totalImagesPullingTime="13.760210278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:22:55.099572543 +0000 UTC m=+365.677517690" watchObservedRunningTime="2026-09-18 22:22:56.05216943 +0000 UTC m=+366.630114574"
Sep 18 22:22:56.052693 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.052675    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"]
Sep 18 22:22:56.060727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.060708    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.068892 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.063764    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vql96\""
Sep 18 22:22:56.073276 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.073253    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"]
Sep 18 22:22:56.079038 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.079003    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:56.079324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.079305    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:56.148580 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.148543    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.148758 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.148585    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.148758 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.148678    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.148758 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.148701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7c86ab-3f40-4257-9040-d8bf3304964e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.148758 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.148751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.149063 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.148793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.149063 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.148919    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-287zb\" (UniqueName: \"kubernetes.io/projected/9e7c86ab-3f40-4257-9040-d8bf3304964e-kube-api-access-287zb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.149063 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.149053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.149208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.149165    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.249833 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.249767    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.249833 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.249835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.249889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.249911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7c86ab-3f40-4257-9040-d8bf3304964e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.249958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.249980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250031    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-287zb\" (UniqueName: \"kubernetes.io/projected/9e7c86ab-3f40-4257-9040-d8bf3304964e-kube-api-access-287zb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250311 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250311 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250418 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250392    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250611    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250656    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250727    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7c86ab-3f40-4257-9040-d8bf3304964e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.250800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.250748    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.252892 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.252870    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.253037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.253024    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.259520 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.259496    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-287zb\" (UniqueName: \"kubernetes.io/projected/9e7c86ab-3f40-4257-9040-d8bf3304964e-kube-api-access-287zb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.259632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.259590    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7c86ab-3f40-4257-9040-d8bf3304964e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb\" (UID: \"9e7c86ab-3f40-4257-9040-d8bf3304964e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.277210 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.277185    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:56.377959 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.377926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:22:56.685651 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.685608    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"]
Sep 18 22:22:56.689522 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:22:56.689476    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7c86ab_3f40_4257_9040_d8bf3304964e.slice/crio-f0b38dbc320467e7c04471c6ae9f01efb0576551290a4dee88dae762d439a3fd WatchSource:0}: Error finding container f0b38dbc320467e7c04471c6ae9f01efb0576551290a4dee88dae762d439a3fd: Status 404 returned error can't find the container with id f0b38dbc320467e7c04471c6ae9f01efb0576551290a4dee88dae762d439a3fd
Sep 18 22:22:56.785479 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:56.785442    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:57.084064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.084030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb" event={"ID":"9e7c86ab-3f40-4257-9040-d8bf3304964e","Type":"ContainerStarted","Data":"f0b38dbc320467e7c04471c6ae9f01efb0576551290a4dee88dae762d439a3fd"}
Sep 18 22:22:57.788665 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.788627    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:57.910476 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.910440    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"]
Sep 18 22:22:57.913686 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.913669    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:57.917322 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.917301    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vq4xr\""
Sep 18 22:22:57.929306 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.929285    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 18 22:22:57.941358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.941330    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"]
Sep 18 22:22:57.955626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.955603    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:57.964624 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.964597    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acdb403a-0273-4907-9eee-c95be4eb980e-cert\") pod \"kserve-controller-manager-d6f4b65b8-62zgr\" (UID: \"acdb403a-0273-4907-9eee-c95be4eb980e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:57.964755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.964735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kp5c\" (UniqueName: \"kubernetes.io/projected/acdb403a-0273-4907-9eee-c95be4eb980e-kube-api-access-7kp5c\") pod \"kserve-controller-manager-d6f4b65b8-62zgr\" (UID: \"acdb403a-0273-4907-9eee-c95be4eb980e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:57.965829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.965807    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"]
Sep 18 22:22:57.969611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.969589    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:57.973576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.973555    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 18 22:22:57.974145 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:57.974122    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tzwmr\""
Sep 18 22:22:58.009360 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.009281    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"]
Sep 18 22:22:58.065286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.065201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp8dv\" (UniqueName: \"kubernetes.io/projected/a2b169e5-e868-4b63-86e8-eef7304f093d-kube-api-access-jp8dv\") pod \"llmisvc-controller-manager-777c6bd7d5-mg49l\" (UID: \"a2b169e5-e868-4b63-86e8-eef7304f093d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:58.065286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.065254    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kp5c\" (UniqueName: \"kubernetes.io/projected/acdb403a-0273-4907-9eee-c95be4eb980e-kube-api-access-7kp5c\") pod \"kserve-controller-manager-d6f4b65b8-62zgr\" (UID: \"acdb403a-0273-4907-9eee-c95be4eb980e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:58.065510 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.065305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acdb403a-0273-4907-9eee-c95be4eb980e-cert\") pod \"kserve-controller-manager-d6f4b65b8-62zgr\" (UID: \"acdb403a-0273-4907-9eee-c95be4eb980e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:58.065510 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.065324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2b169e5-e868-4b63-86e8-eef7304f093d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mg49l\" (UID: \"a2b169e5-e868-4b63-86e8-eef7304f093d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:58.065510 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:22:58.065433    2570 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 18 22:22:58.065510 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:22:58.065511    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb403a-0273-4907-9eee-c95be4eb980e-cert podName:acdb403a-0273-4907-9eee-c95be4eb980e nodeName:}" failed. No retries permitted until 2026-09-18 22:22:58.565482878 +0000 UTC m=+369.143428008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/acdb403a-0273-4907-9eee-c95be4eb980e-cert") pod "kserve-controller-manager-d6f4b65b8-62zgr" (UID: "acdb403a-0273-4907-9eee-c95be4eb980e") : secret "kserve-webhook-server-cert" not found
Sep 18 22:22:58.090753 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.090721    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kp5c\" (UniqueName: \"kubernetes.io/projected/acdb403a-0273-4907-9eee-c95be4eb980e-kube-api-access-7kp5c\") pod \"kserve-controller-manager-d6f4b65b8-62zgr\" (UID: \"acdb403a-0273-4907-9eee-c95be4eb980e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:58.166501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.166299    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2b169e5-e868-4b63-86e8-eef7304f093d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mg49l\" (UID: \"a2b169e5-e868-4b63-86e8-eef7304f093d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:58.166501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.166424    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp8dv\" (UniqueName: \"kubernetes.io/projected/a2b169e5-e868-4b63-86e8-eef7304f093d-kube-api-access-jp8dv\") pod \"llmisvc-controller-manager-777c6bd7d5-mg49l\" (UID: \"a2b169e5-e868-4b63-86e8-eef7304f093d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:58.166501 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:22:58.166475    2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 18 22:22:58.166859 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:22:58.166579    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2b169e5-e868-4b63-86e8-eef7304f093d-cert podName:a2b169e5-e868-4b63-86e8-eef7304f093d nodeName:}" failed. No retries permitted until 2026-09-18 22:22:58.666558984 +0000 UTC m=+369.244504123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2b169e5-e868-4b63-86e8-eef7304f093d-cert") pod "llmisvc-controller-manager-777c6bd7d5-mg49l" (UID: "a2b169e5-e868-4b63-86e8-eef7304f093d") : secret "llmisvc-webhook-server-cert" not found
Sep 18 22:22:58.188216 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.188183    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp8dv\" (UniqueName: \"kubernetes.io/projected/a2b169e5-e868-4b63-86e8-eef7304f093d-kube-api-access-jp8dv\") pod \"llmisvc-controller-manager-777c6bd7d5-mg49l\" (UID: \"a2b169e5-e868-4b63-86e8-eef7304f093d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:58.237241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.237211    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:58.349424 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.349363    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:58.526411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.526380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:58.570754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.570673    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acdb403a-0273-4907-9eee-c95be4eb980e-cert\") pod \"kserve-controller-manager-d6f4b65b8-62zgr\" (UID: \"acdb403a-0273-4907-9eee-c95be4eb980e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:58.573971 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.573940    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acdb403a-0273-4907-9eee-c95be4eb980e-cert\") pod \"kserve-controller-manager-d6f4b65b8-62zgr\" (UID: \"acdb403a-0273-4907-9eee-c95be4eb980e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:58.671734 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.671656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2b169e5-e868-4b63-86e8-eef7304f093d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mg49l\" (UID: \"a2b169e5-e868-4b63-86e8-eef7304f093d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:58.674214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.674192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2b169e5-e868-4b63-86e8-eef7304f093d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mg49l\" (UID: \"a2b169e5-e868-4b63-86e8-eef7304f093d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:58.701334 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.701305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:22:58.824516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.824488    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:22:58.882840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:58.882569    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:22:59.141556 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.141520    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"]
Sep 18 22:22:59.145442 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:22:59.145418    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacdb403a_0273_4907_9eee_c95be4eb980e.slice/crio-c1ff47b5e08eaca0ff7c3a0fbf02b271b1575acc308fc244c4f017138749de45 WatchSource:0}: Error finding container c1ff47b5e08eaca0ff7c3a0fbf02b271b1575acc308fc244c4f017138749de45: Status 404 returned error can't find the container with id c1ff47b5e08eaca0ff7c3a0fbf02b271b1575acc308fc244c4f017138749de45
Sep 18 22:22:59.175737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.175714    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"]
Sep 18 22:22:59.177030 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:22:59.177005    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2b169e5_e868_4b63_86e8_eef7304f093d.slice/crio-ba78a9d3beb6be19375818f31dfc7c03aa8fd32350fef6868d6b77ac1dfd5263 WatchSource:0}: Error finding container ba78a9d3beb6be19375818f31dfc7c03aa8fd32350fef6868d6b77ac1dfd5263: Status 404 returned error can't find the container with id ba78a9d3beb6be19375818f31dfc7c03aa8fd32350fef6868d6b77ac1dfd5263
Sep 18 22:22:59.320109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.320014    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"]
Sep 18 22:22:59.320301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.320228    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6" podUID="6ce003e2-214d-41e2-801c-c8eaed23caee" containerName="discovery" containerID="cri-o://be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5" gracePeriod=30
Sep 18 22:22:59.594761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.594717    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:22:59.680716 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.680278    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txcw6\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-kube-api-access-txcw6\") pod \"6ce003e2-214d-41e2-801c-c8eaed23caee\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") "
Sep 18 22:22:59.680716 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.680339    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-cacerts\") pod \"6ce003e2-214d-41e2-801c-c8eaed23caee\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") "
Sep 18 22:22:59.680716 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.680519    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-dns-cert\") pod \"6ce003e2-214d-41e2-801c-c8eaed23caee\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") "
Sep 18 22:22:59.680716 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.680705    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-ca-configmap\") pod \"6ce003e2-214d-41e2-801c-c8eaed23caee\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") "
Sep 18 22:22:59.681225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.680804    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-kubeconfig\") pod \"6ce003e2-214d-41e2-801c-c8eaed23caee\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") "
Sep 18 22:22:59.681225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.680839    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-token\") pod \"6ce003e2-214d-41e2-801c-c8eaed23caee\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") "
Sep 18 22:22:59.681225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.680887    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce003e2-214d-41e2-801c-c8eaed23caee-local-certs\") pod \"6ce003e2-214d-41e2-801c-c8eaed23caee\" (UID: \"6ce003e2-214d-41e2-801c-c8eaed23caee\") "
Sep 18 22:22:59.681225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.681216    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6ce003e2-214d-41e2-801c-c8eaed23caee" (UID: "6ce003e2-214d-41e2-801c-c8eaed23caee"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:22:59.684615 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.684582    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6ce003e2-214d-41e2-801c-c8eaed23caee" (UID: "6ce003e2-214d-41e2-801c-c8eaed23caee"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:22:59.684839 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.684757    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-kube-api-access-txcw6" (OuterVolumeSpecName: "kube-api-access-txcw6") pod "6ce003e2-214d-41e2-801c-c8eaed23caee" (UID: "6ce003e2-214d-41e2-801c-c8eaed23caee"). InnerVolumeSpecName "kube-api-access-txcw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:22:59.685027 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.684988    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-cacerts" (OuterVolumeSpecName: "cacerts") pod "6ce003e2-214d-41e2-801c-c8eaed23caee" (UID: "6ce003e2-214d-41e2-801c-c8eaed23caee"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:22:59.685130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.685083    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6ce003e2-214d-41e2-801c-c8eaed23caee" (UID: "6ce003e2-214d-41e2-801c-c8eaed23caee"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:22:59.685277 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.685253    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce003e2-214d-41e2-801c-c8eaed23caee-local-certs" (OuterVolumeSpecName: "local-certs") pod "6ce003e2-214d-41e2-801c-c8eaed23caee" (UID: "6ce003e2-214d-41e2-801c-c8eaed23caee"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:22:59.685906 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.685873    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ce003e2-214d-41e2-801c-c8eaed23caee" (UID: "6ce003e2-214d-41e2-801c-c8eaed23caee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:22:59.781989 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.781956    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-cacerts\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:22:59.781989 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.781988    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-dns-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:22:59.782222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.782003    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-csr-ca-configmap\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:22:59.782222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.782017    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-kubeconfig\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:22:59.782222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.782025    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:22:59.782222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.782033    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ce003e2-214d-41e2-801c-c8eaed23caee-local-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:22:59.782222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:22:59.782041    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txcw6\" (UniqueName: \"kubernetes.io/projected/6ce003e2-214d-41e2-801c-c8eaed23caee-kube-api-access-txcw6\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:23:00.102056 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.102012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr" event={"ID":"acdb403a-0273-4907-9eee-c95be4eb980e","Type":"ContainerStarted","Data":"c1ff47b5e08eaca0ff7c3a0fbf02b271b1575acc308fc244c4f017138749de45"}
Sep 18 22:23:00.103749 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.103717    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ce003e2-214d-41e2-801c-c8eaed23caee" containerID="be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5" exitCode=0
Sep 18 22:23:00.103883 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.103804    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"
Sep 18 22:23:00.103883 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.103814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6" event={"ID":"6ce003e2-214d-41e2-801c-c8eaed23caee","Type":"ContainerDied","Data":"be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5"}
Sep 18 22:23:00.103883 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.103869    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6" event={"ID":"6ce003e2-214d-41e2-801c-c8eaed23caee","Type":"ContainerDied","Data":"237eecf625d73fcf3e32ca00e58996461268cf585b413b03630a57fe0e7645aa"}
Sep 18 22:23:00.104026 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.103898    2570 scope.go:117] "RemoveContainer" containerID="be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5"
Sep 18 22:23:00.105989 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.105969    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" event={"ID":"a2b169e5-e868-4b63-86e8-eef7304f093d","Type":"ContainerStarted","Data":"ba78a9d3beb6be19375818f31dfc7c03aa8fd32350fef6868d6b77ac1dfd5263"}
Sep 18 22:23:00.137473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.137444    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"]
Sep 18 22:23:00.145406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.145382    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6"]
Sep 18 22:23:00.734886 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.734866    2570 scope.go:117] "RemoveContainer" containerID="be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5"
Sep 18 22:23:00.735248 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:23:00.735228    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5\": container with ID starting with be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5 not found: ID does not exist" containerID="be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5"
Sep 18 22:23:00.735293 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:00.735260    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5"} err="failed to get container status \"be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5\": rpc error: code = NotFound desc = could not find container \"be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5\": container with ID starting with be68a1fd43760abbf6973460e87167d50e1f403192d8d0cba7e5fef413becaf5 not found: ID does not exist"
Sep 18 22:23:01.341557 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:01.341505    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:23:01.341870 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:01.341597    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:23:01.341870 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:01.341637    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:23:01.403630 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:01.403605    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce003e2-214d-41e2-801c-c8eaed23caee" path="/var/lib/kubelet/pods/6ce003e2-214d-41e2-801c-c8eaed23caee/volumes"
Sep 18 22:23:02.122243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:02.122202    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr" event={"ID":"acdb403a-0273-4907-9eee-c95be4eb980e","Type":"ContainerStarted","Data":"8aad0de1fe5d90d0592cf9dfe34c08129b6e9be954c2a08a681ef05e507b82ba"}
Sep 18 22:23:02.122528 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:02.122463    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:23:02.124155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:02.124128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb" event={"ID":"9e7c86ab-3f40-4257-9040-d8bf3304964e","Type":"ContainerStarted","Data":"e8f2bb3dbd1e53613eeff2559d0758009cc64ad13759eee790f4af9207b36793"}
Sep 18 22:23:02.172816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:02.172373    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb" podStartSLOduration=1.523328016 podStartE2EDuration="6.172337575s" totalImagesPullingTime="4.649009559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:23:02.171812307 +0000 UTC m=+372.749757453" watchObservedRunningTime="2026-09-18 22:23:02.172337575 +0000 UTC m=+372.750282721"
Sep 18 22:23:02.173368 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:02.173325    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr" podStartSLOduration=2.9777184979999998 podStartE2EDuration="5.173307798s" totalImagesPullingTime="2.1955893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:23:02.150824882 +0000 UTC m=+372.728770028" watchObservedRunningTime="2026-09-18 22:23:02.173307798 +0000 UTC m=+372.751252944"
Sep 18 22:23:02.378370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:02.378285    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:23:02.384727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:02.384692    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:23:03.129561 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:03.129529    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:23:03.130411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:03.130388    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb"
Sep 18 22:23:04.134819 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:04.134761    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" event={"ID":"a2b169e5-e868-4b63-86e8-eef7304f093d","Type":"ContainerStarted","Data":"cf6e73e805c571272faffc19f8fafe191dc6183be8e70903ee92282bd7620c5f"}
Sep 18 22:23:04.152815 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:04.152754    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" podStartSLOduration=2.946307539 podStartE2EDuration="7.152738518s" totalImagesPullingTime="4.206430979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:23:04.152057753 +0000 UTC m=+374.730002897" watchObservedRunningTime="2026-09-18 22:23:04.152738518 +0000 UTC m=+374.730683664"
Sep 18 22:23:05.139307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:05.139277    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:23:30.186963 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.186924    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd677d89d-t4kb7"]
Sep 18 22:23:30.187388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.187261    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce003e2-214d-41e2-801c-c8eaed23caee" containerName="discovery"
Sep 18 22:23:30.187388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.187272    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce003e2-214d-41e2-801c-c8eaed23caee" containerName="discovery"
Sep 18 22:23:30.187388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.187325    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce003e2-214d-41e2-801c-c8eaed23caee" containerName="discovery"
Sep 18 22:23:30.207658 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.207630    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd677d89d-t4kb7"]
Sep 18 22:23:30.207840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.207729    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.248627 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.248599    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:30.350616 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.350586    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:30.354814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.354761    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-oauth-serving-cert\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.354962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.354832    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7htx\" (UniqueName: \"kubernetes.io/projected/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-kube-api-access-g7htx\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.354962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.354874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-oauth-config\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.354962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.354892    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-config\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.354962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.354930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-service-ca\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.354962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.354950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-trusted-ca-bundle\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.355147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.354990    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-serving-cert\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.451429 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.451351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:30.456414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.456394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-oauth-serving-cert\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.456482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.456424    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7htx\" (UniqueName: \"kubernetes.io/projected/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-kube-api-access-g7htx\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.456482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.456445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-oauth-config\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.456482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.456468    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-config\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.456650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.456494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-service-ca\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.456650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.456519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-trusted-ca-bundle\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.456650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.456573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-serving-cert\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.457242 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.457204    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-service-ca\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.457428 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.457298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-config\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.457564 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.457412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-trusted-ca-bundle\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.457564 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.457501    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-oauth-serving-cert\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.459118 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.459098    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-serving-cert\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.459208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.459181    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-console-oauth-config\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.465773 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.465738    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7htx\" (UniqueName: \"kubernetes.io/projected/c475ad21-3d04-4b6f-98c7-c818cd4c37d3-kube-api-access-g7htx\") pod \"console-6fd677d89d-t4kb7\" (UID: \"c475ad21-3d04-4b6f-98c7-c818cd4c37d3\") " pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.517650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.517618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:30.796717 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.796688    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd677d89d-t4kb7"]
Sep 18 22:23:30.799044 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:23:30.799016    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc475ad21_3d04_4b6f_98c7_c818cd4c37d3.slice/crio-c6411d4b50f1eea73a2617b24010491d06af1e92f551e60af7565492e073d065 WatchSource:0}: Error finding container c6411d4b50f1eea73a2617b24010491d06af1e92f551e60af7565492e073d065: Status 404 returned error can't find the container with id c6411d4b50f1eea73a2617b24010491d06af1e92f551e60af7565492e073d065
Sep 18 22:23:30.986973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:30.986936    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:31.045505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:31.045472    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:31.255189 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:31.255154    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd677d89d-t4kb7" event={"ID":"c475ad21-3d04-4b6f-98c7-c818cd4c37d3","Type":"ContainerStarted","Data":"c28a3c01e39200eaf030e9e02fb44075f893fa60cd8a7222d0e094ab763fb270"}
Sep 18 22:23:31.255581 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:31.255233    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd677d89d-t4kb7" event={"ID":"c475ad21-3d04-4b6f-98c7-c818cd4c37d3","Type":"ContainerStarted","Data":"c6411d4b50f1eea73a2617b24010491d06af1e92f551e60af7565492e073d065"}
Sep 18 22:23:31.273617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:31.273566    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd677d89d-t4kb7" podStartSLOduration=1.273533539 podStartE2EDuration="1.273533539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:23:31.272795709 +0000 UTC m=+401.850740847" watchObservedRunningTime="2026-09-18 22:23:31.273533539 +0000 UTC m=+401.851478683"
Sep 18 22:23:33.134249 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:33.134217    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:23:36.146364 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:36.146336    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:23:40.518374 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:40.518329    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:40.518763 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:40.518409    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:40.523000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:40.522978    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:41.309387 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:41.309356    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fd677d89d-t4kb7"
Sep 18 22:23:41.360722 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:41.360685    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596db75ffc-vnb2j"]
Sep 18 22:23:41.460940 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:41.460909    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:41.522857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:41.522808    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:41.581440 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:41.581365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:48.635535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:48.635507    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:23:48.734218 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:23:48.734186    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:02.690968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:02.690935    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:04.748230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.748198    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"]
Sep 18 22:24:04.751094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.751074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:04.754115 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.754095    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 22:24:04.754808 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.754762    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 22:24:04.754808 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.754803    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jhccw\""
Sep 18 22:24:04.764966 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.764945    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"]
Sep 18 22:24:04.865725 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.865692    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptd4b\" (UniqueName: \"kubernetes.io/projected/5533eee3-62ed-48c9-a04d-69c38ba8c872-kube-api-access-ptd4b\") pod \"limitador-operator-controller-manager-74495c69f8-hs4fh\" (UID: \"5533eee3-62ed-48c9-a04d-69c38ba8c872\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:04.966318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.966285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptd4b\" (UniqueName: \"kubernetes.io/projected/5533eee3-62ed-48c9-a04d-69c38ba8c872-kube-api-access-ptd4b\") pod \"limitador-operator-controller-manager-74495c69f8-hs4fh\" (UID: \"5533eee3-62ed-48c9-a04d-69c38ba8c872\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:04.979482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:04.979451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptd4b\" (UniqueName: \"kubernetes.io/projected/5533eee3-62ed-48c9-a04d-69c38ba8c872-kube-api-access-ptd4b\") pod \"limitador-operator-controller-manager-74495c69f8-hs4fh\" (UID: \"5533eee3-62ed-48c9-a04d-69c38ba8c872\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:05.061430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:05.061349    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:05.285791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:05.285755    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:05.337102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:05.337077    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"]
Sep 18 22:24:05.339801 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:24:05.339743    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5533eee3_62ed_48c9_a04d_69c38ba8c872.slice/crio-4cbf194cb925fe57b1d65287c1b3fc6b1cac8727e36532184ece1d75d50cca89 WatchSource:0}: Error finding container 4cbf194cb925fe57b1d65287c1b3fc6b1cac8727e36532184ece1d75d50cca89: Status 404 returned error can't find the container with id 4cbf194cb925fe57b1d65287c1b3fc6b1cac8727e36532184ece1d75d50cca89
Sep 18 22:24:05.411745 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:05.411713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh" event={"ID":"5533eee3-62ed-48c9-a04d-69c38ba8c872","Type":"ContainerStarted","Data":"4cbf194cb925fe57b1d65287c1b3fc6b1cac8727e36532184ece1d75d50cca89"}
Sep 18 22:24:05.686816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:05.686717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:06.100593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.100558    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:06.383073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.382978    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-596db75ffc-vnb2j" podUID="df1925e7-5f92-4fec-8735-0c444efc3515" containerName="console" containerID="cri-o://5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd" gracePeriod=15
Sep 18 22:24:06.647405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.647342    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:24:06.787851 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.787821    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-serving-cert\") pod \"df1925e7-5f92-4fec-8735-0c444efc3515\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") "
Sep 18 22:24:06.788053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.787890    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-service-ca\") pod \"df1925e7-5f92-4fec-8735-0c444efc3515\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") "
Sep 18 22:24:06.788053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.787928    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ljtf\" (UniqueName: \"kubernetes.io/projected/df1925e7-5f92-4fec-8735-0c444efc3515-kube-api-access-8ljtf\") pod \"df1925e7-5f92-4fec-8735-0c444efc3515\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") "
Sep 18 22:24:06.788053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.787956    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-oauth-serving-cert\") pod \"df1925e7-5f92-4fec-8735-0c444efc3515\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") "
Sep 18 22:24:06.788053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.787993    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-trusted-ca-bundle\") pod \"df1925e7-5f92-4fec-8735-0c444efc3515\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") "
Sep 18 22:24:06.788053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.788019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-console-config\") pod \"df1925e7-5f92-4fec-8735-0c444efc3515\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") "
Sep 18 22:24:06.788053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.788046    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-oauth-config\") pod \"df1925e7-5f92-4fec-8735-0c444efc3515\" (UID: \"df1925e7-5f92-4fec-8735-0c444efc3515\") "
Sep 18 22:24:06.788409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.788362    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df1925e7-5f92-4fec-8735-0c444efc3515" (UID: "df1925e7-5f92-4fec-8735-0c444efc3515"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:24:06.788409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.788381    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-service-ca" (OuterVolumeSpecName: "service-ca") pod "df1925e7-5f92-4fec-8735-0c444efc3515" (UID: "df1925e7-5f92-4fec-8735-0c444efc3515"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:24:06.788409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.788394    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "df1925e7-5f92-4fec-8735-0c444efc3515" (UID: "df1925e7-5f92-4fec-8735-0c444efc3515"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:24:06.788586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.788424    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-console-config" (OuterVolumeSpecName: "console-config") pod "df1925e7-5f92-4fec-8735-0c444efc3515" (UID: "df1925e7-5f92-4fec-8735-0c444efc3515"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:24:06.790685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.790658    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df1925e7-5f92-4fec-8735-0c444efc3515" (UID: "df1925e7-5f92-4fec-8735-0c444efc3515"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:24:06.790830 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.790704    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df1925e7-5f92-4fec-8735-0c444efc3515-kube-api-access-8ljtf" (OuterVolumeSpecName: "kube-api-access-8ljtf") pod "df1925e7-5f92-4fec-8735-0c444efc3515" (UID: "df1925e7-5f92-4fec-8735-0c444efc3515"). InnerVolumeSpecName "kube-api-access-8ljtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:24:06.790830 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.790739    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df1925e7-5f92-4fec-8735-0c444efc3515" (UID: "df1925e7-5f92-4fec-8735-0c444efc3515"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:24:06.888993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.888955    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-oauth-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:06.888993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.888985    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-trusted-ca-bundle\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:06.888993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.888995    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-console-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:06.888993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.889006    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-oauth-config\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:06.889324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.889014    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df1925e7-5f92-4fec-8735-0c444efc3515-console-serving-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:06.889324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.889024    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df1925e7-5f92-4fec-8735-0c444efc3515-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:06.889324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:06.889032    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ljtf\" (UniqueName: \"kubernetes.io/projected/df1925e7-5f92-4fec-8735-0c444efc3515-kube-api-access-8ljtf\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:07.425643 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.425612    2570 generic.go:356] "Generic (PLEG): container finished" podID="df1925e7-5f92-4fec-8735-0c444efc3515" containerID="5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd" exitCode=0
Sep 18 22:24:07.426070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.425671    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596db75ffc-vnb2j"
Sep 18 22:24:07.426070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.425688    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596db75ffc-vnb2j" event={"ID":"df1925e7-5f92-4fec-8735-0c444efc3515","Type":"ContainerDied","Data":"5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd"}
Sep 18 22:24:07.426070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.425738    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596db75ffc-vnb2j" event={"ID":"df1925e7-5f92-4fec-8735-0c444efc3515","Type":"ContainerDied","Data":"6f78078038929bd7b7aa4f9b3ff3b9e882f47d0b53470f869a40eb36ca51fd78"}
Sep 18 22:24:07.426070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.425758    2570 scope.go:117] "RemoveContainer" containerID="5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd"
Sep 18 22:24:07.447056 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.447032    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596db75ffc-vnb2j"]
Sep 18 22:24:07.453333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.453312    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-596db75ffc-vnb2j"]
Sep 18 22:24:07.710300 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.710277    2570 scope.go:117] "RemoveContainer" containerID="5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd"
Sep 18 22:24:07.710669 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:07.710648    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd\": container with ID starting with 5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd not found: ID does not exist" containerID="5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd"
Sep 18 22:24:07.710759 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:07.710678    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd"} err="failed to get container status \"5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd\": rpc error: code = NotFound desc = could not find container \"5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd\": container with ID starting with 5ca8ea78f76b4573c64d136c68df941a8976d2c13762ff89ed55478fe291f0fd not found: ID does not exist"
Sep 18 22:24:08.432123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.432083    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh" event={"ID":"5533eee3-62ed-48c9-a04d-69c38ba8c872","Type":"ContainerStarted","Data":"f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff"}
Sep 18 22:24:08.432583 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.432246    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:08.457646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.457560    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh" podStartSLOduration=2.029281111 podStartE2EDuration="4.457541364s" totalImagesPullingTime="2.428260253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:24:08.455309825 +0000 UTC m=+439.033254968" watchObservedRunningTime="2026-09-18 22:24:08.457541364 +0000 UTC m=+439.035486511"
Sep 18 22:24:08.850520 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.850489    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"]
Sep 18 22:24:08.850885 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.850872    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df1925e7-5f92-4fec-8735-0c444efc3515" containerName="console"
Sep 18 22:24:08.850938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.850887    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df1925e7-5f92-4fec-8735-0c444efc3515" containerName="console"
Sep 18 22:24:08.850975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.850963    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="df1925e7-5f92-4fec-8735-0c444efc3515" containerName="console"
Sep 18 22:24:08.854043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.854025    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:08.856849 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.856819    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v2hc2\""
Sep 18 22:24:08.871790 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.871755    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"]
Sep 18 22:24:08.973192 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:08.973159    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:09.006448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.006420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp4xp\" (UniqueName: \"kubernetes.io/projected/031399ca-c106-442a-9e6c-0ef53bfc13f8-kube-api-access-dp4xp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:09.006599 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.006461    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031399ca-c106-442a-9e6c-0ef53bfc13f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:09.083288 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.083259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:09.107416 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.107359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp4xp\" (UniqueName: \"kubernetes.io/projected/031399ca-c106-442a-9e6c-0ef53bfc13f8-kube-api-access-dp4xp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:09.107416 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.107398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031399ca-c106-442a-9e6c-0ef53bfc13f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:09.107722 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.107706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031399ca-c106-442a-9e6c-0ef53bfc13f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:09.117881 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.117847    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp4xp\" (UniqueName: \"kubernetes.io/projected/031399ca-c106-442a-9e6c-0ef53bfc13f8-kube-api-access-dp4xp\") pod \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:09.164887 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.164854    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:09.403562 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.403485    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df1925e7-5f92-4fec-8735-0c444efc3515" path="/var/lib/kubelet/pods/df1925e7-5f92-4fec-8735-0c444efc3515/volumes"
Sep 18 22:24:09.447676 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.447656    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"]
Sep 18 22:24:09.449821 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:24:09.449793    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031399ca_c106_442a_9e6c_0ef53bfc13f8.slice/crio-d1571155412d878ccd7739b35f7c9eff71e19aabca04c09ab2659a86ceb73208 WatchSource:0}: Error finding container d1571155412d878ccd7739b35f7c9eff71e19aabca04c09ab2659a86ceb73208: Status 404 returned error can't find the container with id d1571155412d878ccd7739b35f7c9eff71e19aabca04c09ab2659a86ceb73208
Sep 18 22:24:09.763539 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.763444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:09.984155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:09.984120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:10.090991 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:10.090957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:10.444626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:10.444539    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz" event={"ID":"031399ca-c106-442a-9e6c-0ef53bfc13f8","Type":"ContainerStarted","Data":"d1571155412d878ccd7739b35f7c9eff71e19aabca04c09ab2659a86ceb73208"}
Sep 18 22:24:11.461140 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.458514    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-znmb8"]
Sep 18 22:24:11.467091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.462567    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-znmb8"
Sep 18 22:24:11.467091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.466260    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qvdvp\""
Sep 18 22:24:11.478733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.478672    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-znmb8"]
Sep 18 22:24:11.570985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.570948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:11.629296 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.629264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbk8z\" (UniqueName: \"kubernetes.io/projected/03d5cf4c-b252-4796-9ad2-d9efef0bda0a-kube-api-access-xbk8z\") pod \"authorino-operator-76b478bd78-znmb8\" (UID: \"03d5cf4c-b252-4796-9ad2-d9efef0bda0a\") " pod="kuadrant-system/authorino-operator-76b478bd78-znmb8"
Sep 18 22:24:11.670159 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.670111    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:11.730566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.730489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbk8z\" (UniqueName: \"kubernetes.io/projected/03d5cf4c-b252-4796-9ad2-d9efef0bda0a-kube-api-access-xbk8z\") pod \"authorino-operator-76b478bd78-znmb8\" (UID: \"03d5cf4c-b252-4796-9ad2-d9efef0bda0a\") " pod="kuadrant-system/authorino-operator-76b478bd78-znmb8"
Sep 18 22:24:11.748369 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.748335    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbk8z\" (UniqueName: \"kubernetes.io/projected/03d5cf4c-b252-4796-9ad2-d9efef0bda0a-kube-api-access-xbk8z\") pod \"authorino-operator-76b478bd78-znmb8\" (UID: \"03d5cf4c-b252-4796-9ad2-d9efef0bda0a\") " pod="kuadrant-system/authorino-operator-76b478bd78-znmb8"
Sep 18 22:24:11.780287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:11.780258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-znmb8"
Sep 18 22:24:12.077759 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:12.077730    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-znmb8"]
Sep 18 22:24:12.295474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:12.295443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:12.460143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:12.460091    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-znmb8" event={"ID":"03d5cf4c-b252-4796-9ad2-d9efef0bda0a","Type":"ContainerStarted","Data":"6743d3dd44dcc35f477722220b1dd984ceb6ecb370521833fd5c8908a4c0ac37"}
Sep 18 22:24:12.946127 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:12.946088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:14.487860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:14.487756    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz" event={"ID":"031399ca-c106-442a-9e6c-0ef53bfc13f8","Type":"ContainerStarted","Data":"126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4"}
Sep 18 22:24:14.488338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:14.488100    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:14.512363 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:14.512306    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz" podStartSLOduration=2.54930251 podStartE2EDuration="6.512285415s" totalImagesPullingTime="3.962982905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:24:14.509418958 +0000 UTC m=+445.087364102" watchObservedRunningTime="2026-09-18 22:24:14.512285415 +0000 UTC m=+445.090230561"
Sep 18 22:24:15.343278 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:15.343249    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:15.495296 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:15.495197    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-znmb8" event={"ID":"03d5cf4c-b252-4796-9ad2-d9efef0bda0a","Type":"ContainerStarted","Data":"b16ee3eed29ea77410c52067e9ac4d3df3838ad07e1c7fa6b9e0b51a147b1d97"}
Sep 18 22:24:15.495296 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:15.495267    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-znmb8"
Sep 18 22:24:15.514114 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:15.514087    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:15.545536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:15.545482    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-znmb8" podStartSLOduration=1.46975529 podStartE2EDuration="4.545458901s" totalImagesPullingTime="3.075703611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:24:15.543836659 +0000 UTC m=+446.121781804" watchObservedRunningTime="2026-09-18 22:24:15.545458901 +0000 UTC m=+446.123404045"
Sep 18 22:24:16.147656 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.147628    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"]
Sep 18 22:24:16.151133 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.151118    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.154003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.153982    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 18 22:24:16.154165 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.154149    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 18 22:24:16.154254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.154240    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rsg24\""
Sep 18 22:24:16.163294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.163275    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"]
Sep 18 22:24:16.163520 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.163501    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:16.273096 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.273068    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a3c4e7-f64c-4512-9d03-a02f87a3703a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.273244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.273126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7b8r\" (UniqueName: \"kubernetes.io/projected/24a3c4e7-f64c-4512-9d03-a02f87a3703a-kube-api-access-q7b8r\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.273244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.273197    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24a3c4e7-f64c-4512-9d03-a02f87a3703a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.319265 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.319238    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:16.374519 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.374495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7b8r\" (UniqueName: \"kubernetes.io/projected/24a3c4e7-f64c-4512-9d03-a02f87a3703a-kube-api-access-q7b8r\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.374605 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.374558    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24a3c4e7-f64c-4512-9d03-a02f87a3703a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.374605 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.374594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a3c4e7-f64c-4512-9d03-a02f87a3703a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.375211 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.375189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24a3c4e7-f64c-4512-9d03-a02f87a3703a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.377079 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.377062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a3c4e7-f64c-4512-9d03-a02f87a3703a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.382547 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.382530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7b8r\" (UniqueName: \"kubernetes.io/projected/24a3c4e7-f64c-4512-9d03-a02f87a3703a-kube-api-access-q7b8r\") pod \"kuadrant-console-plugin-fbdd4f445-4s2dn\" (UID: \"24a3c4e7-f64c-4512-9d03-a02f87a3703a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.461056 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.461001    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"
Sep 18 22:24:16.732591 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:16.732519    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn"]
Sep 18 22:24:16.735830 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:24:16.735803    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24a3c4e7_f64c_4512_9d03_a02f87a3703a.slice/crio-77119eac1fa60c45e5c709a90bd8885212d6a1ef11d5a4e03a482a72edb9e60b WatchSource:0}: Error finding container 77119eac1fa60c45e5c709a90bd8885212d6a1ef11d5a4e03a482a72edb9e60b: Status 404 returned error can't find the container with id 77119eac1fa60c45e5c709a90bd8885212d6a1ef11d5a4e03a482a72edb9e60b
Sep 18 22:24:17.505736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:17.505701    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn" event={"ID":"24a3c4e7-f64c-4512-9d03-a02f87a3703a","Type":"ContainerStarted","Data":"77119eac1fa60c45e5c709a90bd8885212d6a1ef11d5a4e03a482a72edb9e60b"}
Sep 18 22:24:18.357029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:18.356999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:18.427303 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:18.427269    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:19.293141 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:19.293100    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:19.393854 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:19.393768    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:19.440607 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:19.440576    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:19.702536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:19.702486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:19.800301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:19.800260    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:19.913430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:19.913380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:20.012842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:20.012733    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:21.528957 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:21.528920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn" event={"ID":"24a3c4e7-f64c-4512-9d03-a02f87a3703a","Type":"ContainerStarted","Data":"6b7ef8a6a4bf0729e01cf9f11b8c9d27c44b04bbace4f5d2eebe3ec8c3aa4202"}
Sep 18 22:24:21.547737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:21.547690    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-4s2dn" podStartSLOduration=0.957626498 podStartE2EDuration="5.547673771s" totalImagesPullingTime="4.590047273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:24:21.546717983 +0000 UTC m=+452.124663130" watchObservedRunningTime="2026-09-18 22:24:21.547673771 +0000 UTC m=+452.125618915"
Sep 18 22:24:23.117326 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:23.117292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:25.155178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:25.155149    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:25.254561 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:25.254523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:25.498338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:25.498262    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:26.502756 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:26.502729    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-znmb8"
Sep 18 22:24:27.809478 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.808726    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"]
Sep 18 22:24:27.809478 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.809061    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" containerName="manager" containerID="cri-o://126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4" gracePeriod=2
Sep 18 22:24:27.820827 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.820676    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"]
Sep 18 22:24:27.825687 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:27.825651    2570 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"031399ca-c106-442a-9e6c-0ef53bfc13f8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-79cgz\": pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:27.840094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.839366    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"]
Sep 18 22:24:27.840094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.839627    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" containerName="manager" containerID="cri-o://f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff" gracePeriod=2
Sep 18 22:24:27.842526 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:27.842489    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:27.842804 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.842765    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"]
Sep 18 22:24:27.844757 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:27.844726    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:27.856674 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.856651    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"]
Sep 18 22:24:27.857013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.857001    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" containerName="manager"
Sep 18 22:24:27.857067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.857015    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" containerName="manager"
Sep 18 22:24:27.857067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.857027    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" containerName="manager"
Sep 18 22:24:27.857067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.857033    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" containerName="manager"
Sep 18 22:24:27.857155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.857098    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" containerName="manager"
Sep 18 22:24:27.857155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.857107    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" containerName="manager"
Sep 18 22:24:27.860010 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.859993    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:27.860980 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.860962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:27.877167 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.877142    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8gg2\" (UniqueName: \"kubernetes.io/projected/87d33474-320c-4b17-a9a7-6aa9e01546da-kube-api-access-q8gg2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7w7kw\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:27.877279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.877192    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d33474-320c-4b17-a9a7-6aa9e01546da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7w7kw\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:27.882583 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.882561    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"]
Sep 18 22:24:27.885902 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.885884    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"]
Sep 18 22:24:27.886008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.885960    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"
Sep 18 22:24:27.905376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.905352    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"]
Sep 18 22:24:27.920283 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:27.920245    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:27.922956 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:27.922925    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:27.926085 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:27.926064    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:27.931492 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:27.931473    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:27.978554 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.978521    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8gg2\" (UniqueName: \"kubernetes.io/projected/87d33474-320c-4b17-a9a7-6aa9e01546da-kube-api-access-q8gg2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7w7kw\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:27.978721 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.978563    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d33474-320c-4b17-a9a7-6aa9e01546da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7w7kw\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:27.978721 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.978606    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzgfr\" (UniqueName: \"kubernetes.io/projected/a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb-kube-api-access-qzgfr\") pod \"limitador-operator-controller-manager-74495c69f8-kqrr8\" (UID: \"a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"
Sep 18 22:24:27.978986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.978967    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d33474-320c-4b17-a9a7-6aa9e01546da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7w7kw\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:27.981045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:27.981021    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:28.002947 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.002921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8gg2\" (UniqueName: \"kubernetes.io/projected/87d33474-320c-4b17-a9a7-6aa9e01546da-kube-api-access-q8gg2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7w7kw\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:28.079276 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.079249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgfr\" (UniqueName: \"kubernetes.io/projected/a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb-kube-api-access-qzgfr\") pod \"limitador-operator-controller-manager-74495c69f8-kqrr8\" (UID: \"a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"
Sep 18 22:24:28.090996 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.090976    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.092965 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.092949    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.095444 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.095423    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.099860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.099840    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzgfr\" (UniqueName: \"kubernetes.io/projected/a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb-kube-api-access-qzgfr\") pod \"limitador-operator-controller-manager-74495c69f8-kqrr8\" (UID: \"a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"
Sep 18 22:24:28.104311 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.104291    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.109229 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.109205    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.111801 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.111757    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.130526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.130502    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:28.180559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.180529    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp4xp\" (UniqueName: \"kubernetes.io/projected/031399ca-c106-442a-9e6c-0ef53bfc13f8-kube-api-access-dp4xp\") pod \"031399ca-c106-442a-9e6c-0ef53bfc13f8\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") "
Sep 18 22:24:28.180667 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.180591    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031399ca-c106-442a-9e6c-0ef53bfc13f8-extensions-socket-volume\") pod \"031399ca-c106-442a-9e6c-0ef53bfc13f8\" (UID: \"031399ca-c106-442a-9e6c-0ef53bfc13f8\") "
Sep 18 22:24:28.180667 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.180656    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptd4b\" (UniqueName: \"kubernetes.io/projected/5533eee3-62ed-48c9-a04d-69c38ba8c872-kube-api-access-ptd4b\") pod \"5533eee3-62ed-48c9-a04d-69c38ba8c872\" (UID: \"5533eee3-62ed-48c9-a04d-69c38ba8c872\") "
Sep 18 22:24:28.181173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.181148    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/031399ca-c106-442a-9e6c-0ef53bfc13f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "031399ca-c106-442a-9e6c-0ef53bfc13f8" (UID: "031399ca-c106-442a-9e6c-0ef53bfc13f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:24:28.182900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.182872    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031399ca-c106-442a-9e6c-0ef53bfc13f8-kube-api-access-dp4xp" (OuterVolumeSpecName: "kube-api-access-dp4xp") pod "031399ca-c106-442a-9e6c-0ef53bfc13f8" (UID: "031399ca-c106-442a-9e6c-0ef53bfc13f8"). InnerVolumeSpecName "kube-api-access-dp4xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:24:28.182900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.182891    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5533eee3-62ed-48c9-a04d-69c38ba8c872-kube-api-access-ptd4b" (OuterVolumeSpecName: "kube-api-access-ptd4b") pod "5533eee3-62ed-48c9-a04d-69c38ba8c872" (UID: "5533eee3-62ed-48c9-a04d-69c38ba8c872"). InnerVolumeSpecName "kube-api-access-ptd4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:24:28.258236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.258186    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:28.266421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.266399    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"
Sep 18 22:24:28.282247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.282224    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptd4b\" (UniqueName: \"kubernetes.io/projected/5533eee3-62ed-48c9-a04d-69c38ba8c872-kube-api-access-ptd4b\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:28.282247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.282251    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp4xp\" (UniqueName: \"kubernetes.io/projected/031399ca-c106-442a-9e6c-0ef53bfc13f8-kube-api-access-dp4xp\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:28.282418 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.282266    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/031399ca-c106-442a-9e6c-0ef53bfc13f8-extensions-socket-volume\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:28.563905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.563869    2570 generic.go:356] "Generic (PLEG): container finished" podID="031399ca-c106-442a-9e6c-0ef53bfc13f8" containerID="126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4" exitCode=0
Sep 18 22:24:28.564093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.563914    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.564093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.563965    2570 scope.go:117] "RemoveContainer" containerID="126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4"
Sep 18 22:24:28.565524 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.565502    2570 generic.go:356] "Generic (PLEG): container finished" podID="5533eee3-62ed-48c9-a04d-69c38ba8c872" containerID="f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff" exitCode=0
Sep 18 22:24:28.565599 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.565560    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.566514 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.566492    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.568872 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.568851    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.570997 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.570971    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.572884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.572850    2570 scope.go:117] "RemoveContainer" containerID="126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4"
Sep 18 22:24:28.573171 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.573137    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4\": container with ID starting with 126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4 not found: ID does not exist" containerID="126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4"
Sep 18 22:24:28.573238 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.573166    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4"} err="failed to get container status \"126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4\": rpc error: code = NotFound desc = could not find container \"126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4\": container with ID starting with 126820b00e89b047cd71c1dfcf97e6b76bf032aba6189572a55e7aedc39cdfc4 not found: ID does not exist"
Sep 18 22:24:28.573238 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.573188    2570 scope.go:117] "RemoveContainer" containerID="f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff"
Sep 18 22:24:28.573324 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.573258    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.581256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.581238    2570 scope.go:117] "RemoveContainer" containerID="f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff"
Sep 18 22:24:28.581556 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.581532    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff\": container with ID starting with f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff not found: ID does not exist" containerID="f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff"
Sep 18 22:24:28.581634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.581560    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff"} err="failed to get container status \"f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff\": rpc error: code = NotFound desc = could not find container \"f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff\": container with ID starting with f323ad5934f8550549b4cb628c9b3179b83f8610ae3bfcad6b8b6fce149a45ff not found: ID does not exist"
Sep 18 22:24:28.583647 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.583623    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.584850 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.584826    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"]
Sep 18 22:24:28.589906 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.589850    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.589906 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:24:28.589866    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d33474_320c_4b17_a9a7_6aa9e01546da.slice/crio-fdfb9ffae7fd827739b0dfe663ad918bda49ae0c9a21404cd48844fd120cdad6 WatchSource:0}: Error finding container fdfb9ffae7fd827739b0dfe663ad918bda49ae0c9a21404cd48844fd120cdad6: Status 404 returned error can't find the container with id fdfb9ffae7fd827739b0dfe663ad918bda49ae0c9a21404cd48844fd120cdad6
Sep 18 22:24:28.592258 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.592237    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hs4fh\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hs4fh"
Sep 18 22:24:28.595041 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:24:28.595020    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-79cgz\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-79cgz"
Sep 18 22:24:28.618215 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:28.618192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"]
Sep 18 22:24:28.636978 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:24:28.636957    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bcab2c_ce44_4e0f_87a8_e4f8d92c32fb.slice/crio-18938701b2aded641587995c9734b9b7c99a59745a4a21188578eade92121528 WatchSource:0}: Error finding container 18938701b2aded641587995c9734b9b7c99a59745a4a21188578eade92121528: Status 404 returned error can't find the container with id 18938701b2aded641587995c9734b9b7c99a59745a4a21188578eade92121528
Sep 18 22:24:29.403203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.403158    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031399ca-c106-442a-9e6c-0ef53bfc13f8" path="/var/lib/kubelet/pods/031399ca-c106-442a-9e6c-0ef53bfc13f8/volumes"
Sep 18 22:24:29.403671 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.403623    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5533eee3-62ed-48c9-a04d-69c38ba8c872" path="/var/lib/kubelet/pods/5533eee3-62ed-48c9-a04d-69c38ba8c872/volumes"
Sep 18 22:24:29.572081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.572049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw" event={"ID":"87d33474-320c-4b17-a9a7-6aa9e01546da","Type":"ContainerStarted","Data":"016b5eebf4273d3a04e472700919b789dbb17a0c5e4a6e45475fb29948947ba7"}
Sep 18 22:24:29.572239 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.572097    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw" event={"ID":"87d33474-320c-4b17-a9a7-6aa9e01546da","Type":"ContainerStarted","Data":"fdfb9ffae7fd827739b0dfe663ad918bda49ae0c9a21404cd48844fd120cdad6"}
Sep 18 22:24:29.572239 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.572155    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:29.575691 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.575668    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8" event={"ID":"a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb","Type":"ContainerStarted","Data":"a6a18e2ea90d166c625930676c2494502a70872e0ec95b17b537090d6254ca67"}
Sep 18 22:24:29.575834 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.575703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8" event={"ID":"a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb","Type":"ContainerStarted","Data":"18938701b2aded641587995c9734b9b7c99a59745a4a21188578eade92121528"}
Sep 18 22:24:29.575834 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.575746    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"
Sep 18 22:24:29.612088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.612036    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw" podStartSLOduration=2.612020802 podStartE2EDuration="2.612020802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:24:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:24:29.611240464 +0000 UTC m=+460.189185608" watchObservedRunningTime="2026-09-18 22:24:29.612020802 +0000 UTC m=+460.189965944"
Sep 18 22:24:29.643098 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:29.643050    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8" podStartSLOduration=2.64303666 podStartE2EDuration="2.64303666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:24:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:24:29.642456173 +0000 UTC m=+460.220401319" watchObservedRunningTime="2026-09-18 22:24:29.64303666 +0000 UTC m=+460.220981804"
Sep 18 22:24:30.345495 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:30.345464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:30.449153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:30.449123    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:34.607014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:34.606984    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:34.715376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:34.715337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:38.212258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:38.212227    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:38.282513 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:38.282486    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:38.586259 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:38.586229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:38.686865 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:38.686832    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:38.787184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:38.787152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:38.887537 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:38.887464    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:40.582315 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:40.582286    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-kqrr8"
Sep 18 22:24:40.582706 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:40.582363    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:45.491004 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.490969    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"]
Sep 18 22:24:45.491444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.491163    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw" podUID="87d33474-320c-4b17-a9a7-6aa9e01546da" containerName="manager" containerID="cri-o://016b5eebf4273d3a04e472700919b789dbb17a0c5e4a6e45475fb29948947ba7" gracePeriod=10
Sep 18 22:24:45.654767 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.654733    2570 generic.go:356] "Generic (PLEG): container finished" podID="87d33474-320c-4b17-a9a7-6aa9e01546da" containerID="016b5eebf4273d3a04e472700919b789dbb17a0c5e4a6e45475fb29948947ba7" exitCode=0
Sep 18 22:24:45.654948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.654808    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw" event={"ID":"87d33474-320c-4b17-a9a7-6aa9e01546da","Type":"ContainerDied","Data":"016b5eebf4273d3a04e472700919b789dbb17a0c5e4a6e45475fb29948947ba7"}
Sep 18 22:24:45.744214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.744153    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:45.837173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.837140    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8gg2\" (UniqueName: \"kubernetes.io/projected/87d33474-320c-4b17-a9a7-6aa9e01546da-kube-api-access-q8gg2\") pod \"87d33474-320c-4b17-a9a7-6aa9e01546da\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") "
Sep 18 22:24:45.837173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.837177    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d33474-320c-4b17-a9a7-6aa9e01546da-extensions-socket-volume\") pod \"87d33474-320c-4b17-a9a7-6aa9e01546da\" (UID: \"87d33474-320c-4b17-a9a7-6aa9e01546da\") "
Sep 18 22:24:45.837610 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.837586    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d33474-320c-4b17-a9a7-6aa9e01546da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87d33474-320c-4b17-a9a7-6aa9e01546da" (UID: "87d33474-320c-4b17-a9a7-6aa9e01546da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:24:45.839437 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.839413    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d33474-320c-4b17-a9a7-6aa9e01546da-kube-api-access-q8gg2" (OuterVolumeSpecName: "kube-api-access-q8gg2") pod "87d33474-320c-4b17-a9a7-6aa9e01546da" (UID: "87d33474-320c-4b17-a9a7-6aa9e01546da"). InnerVolumeSpecName "kube-api-access-q8gg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:24:45.938023 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.937988    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d33474-320c-4b17-a9a7-6aa9e01546da-extensions-socket-volume\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:45.938023 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:45.938015    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8gg2\" (UniqueName: \"kubernetes.io/projected/87d33474-320c-4b17-a9a7-6aa9e01546da-kube-api-access-q8gg2\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:24:46.661712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:46.661683    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"
Sep 18 22:24:46.661712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:46.661701    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw" event={"ID":"87d33474-320c-4b17-a9a7-6aa9e01546da","Type":"ContainerDied","Data":"fdfb9ffae7fd827739b0dfe663ad918bda49ae0c9a21404cd48844fd120cdad6"}
Sep 18 22:24:46.662202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:46.661766    2570 scope.go:117] "RemoveContainer" containerID="016b5eebf4273d3a04e472700919b789dbb17a0c5e4a6e45475fb29948947ba7"
Sep 18 22:24:46.701421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:46.701386    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"]
Sep 18 22:24:46.713638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:46.713606    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7w7kw"]
Sep 18 22:24:47.402658 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:47.402620    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d33474-320c-4b17-a9a7-6aa9e01546da" path="/var/lib/kubelet/pods/87d33474-320c-4b17-a9a7-6aa9e01546da/volumes"
Sep 18 22:24:47.612251 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:47.612213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:47.712847 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:47.712762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:50.055584 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:50.055551    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:24:50.155616 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:24:50.155571    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:01.843550 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.843506    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"]
Sep 18 22:25:01.844075 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.844057    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d33474-320c-4b17-a9a7-6aa9e01546da" containerName="manager"
Sep 18 22:25:01.844155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.844079    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d33474-320c-4b17-a9a7-6aa9e01546da" containerName="manager"
Sep 18 22:25:01.844226 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.844212    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d33474-320c-4b17-a9a7-6aa9e01546da" containerName="manager"
Sep 18 22:25:01.866853 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.866829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.872603 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.872577    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-b44j7\""
Sep 18 22:25:01.874915 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.874576    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"]
Sep 18 22:25:01.952672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.952633    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:01.972573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96fef461-96b6-4e72-929a-2b64f97f9be1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972676    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6nlm\" (UniqueName: \"kubernetes.io/projected/96fef461-96b6-4e72-929a-2b64f97f9be1-kube-api-access-g6nlm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:01.972917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:01.972835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.073769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.073949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.073949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.073949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6nlm\" (UniqueName: \"kubernetes.io/projected/96fef461-96b6-4e72-929a-2b64f97f9be1-kube-api-access-g6nlm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.073949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073899    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.073949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073921    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073970    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.073996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.074053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96fef461-96b6-4e72-929a-2b64f97f9be1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.074161    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.074260    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.074451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074528 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.074509    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.074675 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.074658    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96fef461-96b6-4e72-929a-2b64f97f9be1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.076741 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.076720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.077077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.077057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.092448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.092420    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6nlm\" (UniqueName: \"kubernetes.io/projected/96fef461-96b6-4e72-929a-2b64f97f9be1-kube-api-access-g6nlm\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.093335 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.093315    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96fef461-96b6-4e72-929a-2b64f97f9be1-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9pkn8\" (UID: \"96fef461-96b6-4e72-929a-2b64f97f9be1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.152358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.152286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:02.178461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.178440    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:02.489814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.489714    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"]
Sep 18 22:25:02.493664 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:02.493643    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fef461_96b6_4e72_929a_2b64f97f9be1.slice/crio-0665cf84fce97cf627e337acfbb1696e37d673e541ea3899d2fdc66e284176e0 WatchSource:0}: Error finding container 0665cf84fce97cf627e337acfbb1696e37d673e541ea3899d2fdc66e284176e0: Status 404 returned error can't find the container with id 0665cf84fce97cf627e337acfbb1696e37d673e541ea3899d2fdc66e284176e0
Sep 18 22:25:02.495642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.495613    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:25:02.495698 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.495678    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:25:02.495738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.495704    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:25:02.744203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.744129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" event={"ID":"96fef461-96b6-4e72-929a-2b64f97f9be1","Type":"ContainerStarted","Data":"73ed2834c50f30531b1d639d7c2ccd0791607f25bbf5687f9b0d6ac675339c18"}
Sep 18 22:25:02.744203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.744188    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" event={"ID":"96fef461-96b6-4e72-929a-2b64f97f9be1","Type":"ContainerStarted","Data":"0665cf84fce97cf627e337acfbb1696e37d673e541ea3899d2fdc66e284176e0"}
Sep 18 22:25:02.764759 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:02.764711    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" podStartSLOduration=1.764695803 podStartE2EDuration="1.764695803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:02.762697754 +0000 UTC m=+493.340642911" watchObservedRunningTime="2026-09-18 22:25:02.764695803 +0000 UTC m=+493.342640947"
Sep 18 22:25:03.179052 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.179017    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:03.183738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.183715    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:03.730162 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.730130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:03.734310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.734279    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s6fw6"]
Sep 18 22:25:03.737609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.737589    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:03.740209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.740191    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 22:25:03.751611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.751133    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s6fw6"]
Sep 18 22:25:03.756650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.756617    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:03.757750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.757728    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:25:03.830690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.830661    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s6fw6"]
Sep 18 22:25:03.838996 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.838964    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:03.890085 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.890050    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/489dad91-1b96-427f-9481-f890538e9caf-config-file\") pod \"limitador-limitador-8588749977-s6fw6\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") " pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:03.890266 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.890167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km9zb\" (UniqueName: \"kubernetes.io/projected/489dad91-1b96-427f-9481-f890538e9caf-kube-api-access-km9zb\") pod \"limitador-limitador-8588749977-s6fw6\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") " pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:03.908913 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.908854    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:03.991215 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.991129    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km9zb\" (UniqueName: \"kubernetes.io/projected/489dad91-1b96-427f-9481-f890538e9caf-kube-api-access-km9zb\") pod \"limitador-limitador-8588749977-s6fw6\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") " pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:03.991215 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.991194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/489dad91-1b96-427f-9481-f890538e9caf-config-file\") pod \"limitador-limitador-8588749977-s6fw6\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") " pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:03.991794 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.991756    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/489dad91-1b96-427f-9481-f890538e9caf-config-file\") pod \"limitador-limitador-8588749977-s6fw6\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") " pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:03.999963 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:03.999936    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km9zb\" (UniqueName: \"kubernetes.io/projected/489dad91-1b96-427f-9481-f890538e9caf-kube-api-access-km9zb\") pod \"limitador-limitador-8588749977-s6fw6\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") " pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:04.052937 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.052899    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:04.323063 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.323037    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s6fw6"]
Sep 18 22:25:04.325701 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:04.325675    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489dad91_1b96_427f_9481_f890538e9caf.slice/crio-353a9eb82c6be23510d613ab7a84d7f470cfb900b992eb9602bc51278d8ca6d4 WatchSource:0}: Error finding container 353a9eb82c6be23510d613ab7a84d7f470cfb900b992eb9602bc51278d8ca6d4: Status 404 returned error can't find the container with id 353a9eb82c6be23510d613ab7a84d7f470cfb900b992eb9602bc51278d8ca6d4
Sep 18 22:25:04.522187 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.522156    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df4bc"]
Sep 18 22:25:04.526720 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.526694    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc"
Sep 18 22:25:04.528984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.528966    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7q7bt\""
Sep 18 22:25:04.533132 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.533109    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df4bc"]
Sep 18 22:25:04.566811 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.566764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:04.668692 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.668650    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:04.689076 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.689044    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-rhqqf"]
Sep 18 22:25:04.692401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.692378    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rhqqf"
Sep 18 22:25:04.695523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.695500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnmh\" (UniqueName: \"kubernetes.io/projected/1579a4a4-acbe-415e-b1d3-0b94385fa6c9-kube-api-access-4rnmh\") pod \"authorino-7bcfd8f9cd-df4bc\" (UID: \"1579a4a4-acbe-415e-b1d3-0b94385fa6c9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc"
Sep 18 22:25:04.700437 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.700414    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rhqqf"]
Sep 18 22:25:04.762167 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.762132    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6" event={"ID":"489dad91-1b96-427f-9481-f890538e9caf","Type":"ContainerStarted","Data":"353a9eb82c6be23510d613ab7a84d7f470cfb900b992eb9602bc51278d8ca6d4"}
Sep 18 22:25:04.797066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.797038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/4fe9f162-d738-4f4b-9d74-40cac85ee9a4-kube-api-access-r76lx\") pod \"authorino-59c974bd48-rhqqf\" (UID: \"4fe9f162-d738-4f4b-9d74-40cac85ee9a4\") " pod="kuadrant-system/authorino-59c974bd48-rhqqf"
Sep 18 22:25:04.797190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.797096    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnmh\" (UniqueName: \"kubernetes.io/projected/1579a4a4-acbe-415e-b1d3-0b94385fa6c9-kube-api-access-4rnmh\") pod \"authorino-7bcfd8f9cd-df4bc\" (UID: \"1579a4a4-acbe-415e-b1d3-0b94385fa6c9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc"
Sep 18 22:25:04.805667 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.805641    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnmh\" (UniqueName: \"kubernetes.io/projected/1579a4a4-acbe-415e-b1d3-0b94385fa6c9-kube-api-access-4rnmh\") pod \"authorino-7bcfd8f9cd-df4bc\" (UID: \"1579a4a4-acbe-415e-b1d3-0b94385fa6c9\") " pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc"
Sep 18 22:25:04.837346 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.837321    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc"
Sep 18 22:25:04.898404 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.898377    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/4fe9f162-d738-4f4b-9d74-40cac85ee9a4-kube-api-access-r76lx\") pod \"authorino-59c974bd48-rhqqf\" (UID: \"4fe9f162-d738-4f4b-9d74-40cac85ee9a4\") " pod="kuadrant-system/authorino-59c974bd48-rhqqf"
Sep 18 22:25:04.907862 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:04.907832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/4fe9f162-d738-4f4b-9d74-40cac85ee9a4-kube-api-access-r76lx\") pod \"authorino-59c974bd48-rhqqf\" (UID: \"4fe9f162-d738-4f4b-9d74-40cac85ee9a4\") " pod="kuadrant-system/authorino-59c974bd48-rhqqf"
Sep 18 22:25:05.002402 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.002321    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rhqqf"
Sep 18 22:25:05.108256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.108212    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df4bc"]
Sep 18 22:25:05.111054 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:05.111016    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1579a4a4_acbe_415e_b1d3_0b94385fa6c9.slice/crio-4a143cfe2c04f44936136fc26f63067063d3141fe4df53d9316a0eb3ace93ab8 WatchSource:0}: Error finding container 4a143cfe2c04f44936136fc26f63067063d3141fe4df53d9316a0eb3ace93ab8: Status 404 returned error can't find the container with id 4a143cfe2c04f44936136fc26f63067063d3141fe4df53d9316a0eb3ace93ab8
Sep 18 22:25:05.283733 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:05.283699    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fe9f162_d738_4f4b_9d74_40cac85ee9a4.slice/crio-47302900e7bb41845ee71d5a3a08bf57eff63a8ad61857e2f07f0d07e215d675 WatchSource:0}: Error finding container 47302900e7bb41845ee71d5a3a08bf57eff63a8ad61857e2f07f0d07e215d675: Status 404 returned error can't find the container with id 47302900e7bb41845ee71d5a3a08bf57eff63a8ad61857e2f07f0d07e215d675
Sep 18 22:25:05.294376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.294347    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rhqqf"]
Sep 18 22:25:05.769152 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.769110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6" event={"ID":"489dad91-1b96-427f-9481-f890538e9caf","Type":"ContainerStarted","Data":"251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb"}
Sep 18 22:25:05.769704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.769182    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:05.770284 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.770262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc" event={"ID":"1579a4a4-acbe-415e-b1d3-0b94385fa6c9","Type":"ContainerStarted","Data":"4a143cfe2c04f44936136fc26f63067063d3141fe4df53d9316a0eb3ace93ab8"}
Sep 18 22:25:05.771380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.771355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rhqqf" event={"ID":"4fe9f162-d738-4f4b-9d74-40cac85ee9a4","Type":"ContainerStarted","Data":"47302900e7bb41845ee71d5a3a08bf57eff63a8ad61857e2f07f0d07e215d675"}
Sep 18 22:25:05.785641 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:05.785592    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6" podStartSLOduration=1.525712656 podStartE2EDuration="2.785576716s" totalImagesPullingTime="1.25986406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:05.784664659 +0000 UTC m=+496.362609804" watchObservedRunningTime="2026-09-18 22:25:05.785576716 +0000 UTC m=+496.363521907"
Sep 18 22:25:07.783147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:07.783114    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc" event={"ID":"1579a4a4-acbe-415e-b1d3-0b94385fa6c9","Type":"ContainerStarted","Data":"2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c"}
Sep 18 22:25:07.799619 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:07.799572    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc" podStartSLOduration=2.06680303 podStartE2EDuration="3.799557178s" totalImagesPullingTime="1.732754148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:07.798553633 +0000 UTC m=+498.376498778" watchObservedRunningTime="2026-09-18 22:25:07.799557178 +0000 UTC m=+498.377502322"
Sep 18 22:25:12.808469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:12.808382    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rhqqf" event={"ID":"4fe9f162-d738-4f4b-9d74-40cac85ee9a4","Type":"ContainerStarted","Data":"31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747"}
Sep 18 22:25:12.825546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:12.825497    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-rhqqf" podStartSLOduration=1.635854675 podStartE2EDuration="8.825480708s" totalImagesPullingTime="7.189626033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:12.824073004 +0000 UTC m=+503.402018151" watchObservedRunningTime="2026-09-18 22:25:12.825480708 +0000 UTC m=+503.403425853"
Sep 18 22:25:12.854435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:12.854403    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df4bc"]
Sep 18 22:25:12.854604 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:12.854585    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc" podUID="1579a4a4-acbe-415e-b1d3-0b94385fa6c9" containerName="authorino" containerID="cri-o://2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c" gracePeriod=30
Sep 18 22:25:13.102336 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.102309    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc"
Sep 18 22:25:13.276764 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.276730    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rnmh\" (UniqueName: \"kubernetes.io/projected/1579a4a4-acbe-415e-b1d3-0b94385fa6c9-kube-api-access-4rnmh\") pod \"1579a4a4-acbe-415e-b1d3-0b94385fa6c9\" (UID: \"1579a4a4-acbe-415e-b1d3-0b94385fa6c9\") "
Sep 18 22:25:13.278946 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.278920    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1579a4a4-acbe-415e-b1d3-0b94385fa6c9-kube-api-access-4rnmh" (OuterVolumeSpecName: "kube-api-access-4rnmh") pod "1579a4a4-acbe-415e-b1d3-0b94385fa6c9" (UID: "1579a4a4-acbe-415e-b1d3-0b94385fa6c9"). InnerVolumeSpecName "kube-api-access-4rnmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:13.378177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.378147    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rnmh\" (UniqueName: \"kubernetes.io/projected/1579a4a4-acbe-415e-b1d3-0b94385fa6c9-kube-api-access-4rnmh\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:13.814497 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.814405    2570 generic.go:356] "Generic (PLEG): container finished" podID="1579a4a4-acbe-415e-b1d3-0b94385fa6c9" containerID="2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c" exitCode=0
Sep 18 22:25:13.814497 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.814467    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc"
Sep 18 22:25:13.814955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.814492    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc" event={"ID":"1579a4a4-acbe-415e-b1d3-0b94385fa6c9","Type":"ContainerDied","Data":"2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c"}
Sep 18 22:25:13.814955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.814533    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-df4bc" event={"ID":"1579a4a4-acbe-415e-b1d3-0b94385fa6c9","Type":"ContainerDied","Data":"4a143cfe2c04f44936136fc26f63067063d3141fe4df53d9316a0eb3ace93ab8"}
Sep 18 22:25:13.814955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.814549    2570 scope.go:117] "RemoveContainer" containerID="2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c"
Sep 18 22:25:13.823303 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.823286    2570 scope.go:117] "RemoveContainer" containerID="2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c"
Sep 18 22:25:13.823603 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:25:13.823580    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c\": container with ID starting with 2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c not found: ID does not exist" containerID="2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c"
Sep 18 22:25:13.823661 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.823612    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c"} err="failed to get container status \"2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c\": rpc error: code = NotFound desc = could not find container \"2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c\": container with ID starting with 2ab00e28388d7c9db724624f739d340a811ab68a532840663c074ffa9cd07c7c not found: ID does not exist"
Sep 18 22:25:13.832026 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.831993    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df4bc"]
Sep 18 22:25:13.836381 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:13.836360    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-df4bc"]
Sep 18 22:25:15.403532 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:15.403500    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1579a4a4-acbe-415e-b1d3-0b94385fa6c9" path="/var/lib/kubelet/pods/1579a4a4-acbe-415e-b1d3-0b94385fa6c9/volumes"
Sep 18 22:25:16.777628 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:16.777598    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:17.632687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:17.632647    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s6fw6"]
Sep 18 22:25:17.632914 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:17.632853    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6" podUID="489dad91-1b96-427f-9481-f890538e9caf" containerName="limitador" containerID="cri-o://251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb" gracePeriod=30
Sep 18 22:25:18.185280 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.185255    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:18.215017 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.214919    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km9zb\" (UniqueName: \"kubernetes.io/projected/489dad91-1b96-427f-9481-f890538e9caf-kube-api-access-km9zb\") pod \"489dad91-1b96-427f-9481-f890538e9caf\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") "
Sep 18 22:25:18.215191 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.215047    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/489dad91-1b96-427f-9481-f890538e9caf-config-file\") pod \"489dad91-1b96-427f-9481-f890538e9caf\" (UID: \"489dad91-1b96-427f-9481-f890538e9caf\") "
Sep 18 22:25:18.215477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.215457    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/489dad91-1b96-427f-9481-f890538e9caf-config-file" (OuterVolumeSpecName: "config-file") pod "489dad91-1b96-427f-9481-f890538e9caf" (UID: "489dad91-1b96-427f-9481-f890538e9caf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:25:18.217201 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.217177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/489dad91-1b96-427f-9481-f890538e9caf-kube-api-access-km9zb" (OuterVolumeSpecName: "kube-api-access-km9zb") pod "489dad91-1b96-427f-9481-f890538e9caf" (UID: "489dad91-1b96-427f-9481-f890538e9caf"). InnerVolumeSpecName "kube-api-access-km9zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:18.316313 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.316273    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/489dad91-1b96-427f-9481-f890538e9caf-config-file\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:18.316313 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.316313    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km9zb\" (UniqueName: \"kubernetes.io/projected/489dad91-1b96-427f-9481-f890538e9caf-kube-api-access-km9zb\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:18.842399 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.842367    2570 generic.go:356] "Generic (PLEG): container finished" podID="489dad91-1b96-427f-9481-f890538e9caf" containerID="251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb" exitCode=0
Sep 18 22:25:18.842567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.842425    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6"
Sep 18 22:25:18.842567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.842452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6" event={"ID":"489dad91-1b96-427f-9481-f890538e9caf","Type":"ContainerDied","Data":"251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb"}
Sep 18 22:25:18.842567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.842505    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-s6fw6" event={"ID":"489dad91-1b96-427f-9481-f890538e9caf","Type":"ContainerDied","Data":"353a9eb82c6be23510d613ab7a84d7f470cfb900b992eb9602bc51278d8ca6d4"}
Sep 18 22:25:18.842567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.842528    2570 scope.go:117] "RemoveContainer" containerID="251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb"
Sep 18 22:25:18.852060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.852042    2570 scope.go:117] "RemoveContainer" containerID="251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb"
Sep 18 22:25:18.852317 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:25:18.852295    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb\": container with ID starting with 251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb not found: ID does not exist" containerID="251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb"
Sep 18 22:25:18.852387 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.852325    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb"} err="failed to get container status \"251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb\": rpc error: code = NotFound desc = could not find container \"251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb\": container with ID starting with 251a2581186abe07deb4462282b63f6c859541c99b5d0ec090701e798bb317cb not found: ID does not exist"
Sep 18 22:25:18.864477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.864353    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s6fw6"]
Sep 18 22:25:18.866021 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:18.866004    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-s6fw6"]
Sep 18 22:25:19.403197 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:19.403167    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="489dad91-1b96-427f-9481-f890538e9caf" path="/var/lib/kubelet/pods/489dad91-1b96-427f-9481-f890538e9caf/volumes"
Sep 18 22:25:20.013707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.013678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:20.106902 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.106863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:20.454060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.454027    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"]
Sep 18 22:25:20.454435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.454393    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="489dad91-1b96-427f-9481-f890538e9caf" containerName="limitador"
Sep 18 22:25:20.454435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.454404    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="489dad91-1b96-427f-9481-f890538e9caf" containerName="limitador"
Sep 18 22:25:20.454435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.454420    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1579a4a4-acbe-415e-b1d3-0b94385fa6c9" containerName="authorino"
Sep 18 22:25:20.454435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.454426    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1579a4a4-acbe-415e-b1d3-0b94385fa6c9" containerName="authorino"
Sep 18 22:25:20.454582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.454481    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="489dad91-1b96-427f-9481-f890538e9caf" containerName="limitador"
Sep 18 22:25:20.454582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.454491    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1579a4a4-acbe-415e-b1d3-0b94385fa6c9" containerName="authorino"
Sep 18 22:25:20.458913 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.458891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:20.461905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.461632    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-pphdn\""
Sep 18 22:25:20.461905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.461688    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 18 22:25:20.461905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.461638    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:25:20.461905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.461639    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 22:25:20.466975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.466912    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"]
Sep 18 22:25:20.503257 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.503225    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:20.536562 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.536529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46651199-1b21-4eb1-a323-285ea147f97b-data\") pod \"postgres-69fb4594cf-qhq9k\" (UID: \"46651199-1b21-4eb1-a323-285ea147f97b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:20.536562 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.536564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts844\" (UniqueName: \"kubernetes.io/projected/46651199-1b21-4eb1-a323-285ea147f97b-kube-api-access-ts844\") pod \"postgres-69fb4594cf-qhq9k\" (UID: \"46651199-1b21-4eb1-a323-285ea147f97b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:20.637508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.637477    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46651199-1b21-4eb1-a323-285ea147f97b-data\") pod \"postgres-69fb4594cf-qhq9k\" (UID: \"46651199-1b21-4eb1-a323-285ea147f97b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:20.637669 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.637517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts844\" (UniqueName: \"kubernetes.io/projected/46651199-1b21-4eb1-a323-285ea147f97b-kube-api-access-ts844\") pod \"postgres-69fb4594cf-qhq9k\" (UID: \"46651199-1b21-4eb1-a323-285ea147f97b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:20.637988 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.637968    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/46651199-1b21-4eb1-a323-285ea147f97b-data\") pod \"postgres-69fb4594cf-qhq9k\" (UID: \"46651199-1b21-4eb1-a323-285ea147f97b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:20.648022 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.647995    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts844\" (UniqueName: \"kubernetes.io/projected/46651199-1b21-4eb1-a323-285ea147f97b-kube-api-access-ts844\") pod \"postgres-69fb4594cf-qhq9k\" (UID: \"46651199-1b21-4eb1-a323-285ea147f97b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:20.771754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:20.771657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:21.043285 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:21.043260    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"]
Sep 18 22:25:21.046028 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:21.046002    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46651199_1b21_4eb1_a323_285ea147f97b.slice/crio-910808834d7fb05d50636105c1a44b222de28be5acff26f3334d53c874b7413a WatchSource:0}: Error finding container 910808834d7fb05d50636105c1a44b222de28be5acff26f3334d53c874b7413a: Status 404 returned error can't find the container with id 910808834d7fb05d50636105c1a44b222de28be5acff26f3334d53c874b7413a
Sep 18 22:25:21.862641 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:21.862582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k" event={"ID":"46651199-1b21-4eb1-a323-285ea147f97b","Type":"ContainerStarted","Data":"910808834d7fb05d50636105c1a44b222de28be5acff26f3334d53c874b7413a"}
Sep 18 22:25:26.891518 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:26.891480    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k" event={"ID":"46651199-1b21-4eb1-a323-285ea147f97b","Type":"ContainerStarted","Data":"572a668a951fd81ce8557c523ce78e0ee6ec4d4e841c8e97465b90347db0f59c"}
Sep 18 22:25:26.892005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:26.891627    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:26.905935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:26.905884    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k" podStartSLOduration=1.947731308 podStartE2EDuration="6.905865777s" totalImagesPullingTime="4.958134469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:26.905041817 +0000 UTC m=+517.482986962" watchObservedRunningTime="2026-09-18 22:25:26.905865777 +0000 UTC m=+517.483810922"
Sep 18 22:25:32.926170 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:32.926094    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhq9k"
Sep 18 22:25:33.269638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.269561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:33.481732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.481692    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-jqpnl"]
Sep 18 22:25:33.487302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.487282    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jqpnl"
Sep 18 22:25:33.492504 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.492478    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-jqpnl"]
Sep 18 22:25:33.551730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.551667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vscn\" (UniqueName: \"kubernetes.io/projected/74e36a39-bbbe-4748-a4c4-6bdd3d158b5b-kube-api-access-6vscn\") pod \"authorino-557f876f69-jqpnl\" (UID: \"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b\") " pod="kuadrant-system/authorino-557f876f69-jqpnl"
Sep 18 22:25:33.652632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.652598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vscn\" (UniqueName: \"kubernetes.io/projected/74e36a39-bbbe-4748-a4c4-6bdd3d158b5b-kube-api-access-6vscn\") pod \"authorino-557f876f69-jqpnl\" (UID: \"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b\") " pod="kuadrant-system/authorino-557f876f69-jqpnl"
Sep 18 22:25:33.668558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.668526    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vscn\" (UniqueName: \"kubernetes.io/projected/74e36a39-bbbe-4748-a4c4-6bdd3d158b5b-kube-api-access-6vscn\") pod \"authorino-557f876f69-jqpnl\" (UID: \"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b\") " pod="kuadrant-system/authorino-557f876f69-jqpnl"
Sep 18 22:25:33.711197 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.711163    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:33.779655 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.779621    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jqpnl"]
Sep 18 22:25:33.779930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.779914    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jqpnl"
Sep 18 22:25:33.822422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.822336    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bbb5fc67c-f8nsp"]
Sep 18 22:25:33.826640 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.826619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:33.829747 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.829706    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 18 22:25:33.836929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.836762    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bbb5fc67c-f8nsp"]
Sep 18 22:25:33.955901 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.955872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbdvq\" (UniqueName: \"kubernetes.io/projected/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-kube-api-access-zbdvq\") pod \"authorino-5bbb5fc67c-f8nsp\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") " pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:33.956273 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:33.955940    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-tls-cert\") pod \"authorino-5bbb5fc67c-f8nsp\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") " pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:34.056543 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.056512    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-tls-cert\") pod \"authorino-5bbb5fc67c-f8nsp\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") " pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:34.056708 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.056599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbdvq\" (UniqueName: \"kubernetes.io/projected/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-kube-api-access-zbdvq\") pod \"authorino-5bbb5fc67c-f8nsp\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") " pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:34.057539 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.057388    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jqpnl"]
Sep 18 22:25:34.059253 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.059224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-tls-cert\") pod \"authorino-5bbb5fc67c-f8nsp\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") " pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:34.060354 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:34.060334    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74e36a39_bbbe_4748_a4c4_6bdd3d158b5b.slice/crio-5bbbe224933d86f79c03ef65b27660e39198c2a9261680167744e49ff36a4dc2 WatchSource:0}: Error finding container 5bbbe224933d86f79c03ef65b27660e39198c2a9261680167744e49ff36a4dc2: Status 404 returned error can't find the container with id 5bbbe224933d86f79c03ef65b27660e39198c2a9261680167744e49ff36a4dc2
Sep 18 22:25:34.065067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.065051    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbdvq\" (UniqueName: \"kubernetes.io/projected/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-kube-api-access-zbdvq\") pod \"authorino-5bbb5fc67c-f8nsp\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") " pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:34.146085 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.146054    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:25:34.416376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.416267    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bbb5fc67c-f8nsp"]
Sep 18 22:25:34.419188 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:34.419158    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbdcec15_fff8_48ea_a6c8_ecbc319ab9c2.slice/crio-8199a09f31a5fca066e30d379aa729792650a0875ebeb6bd35d1859cb53bb8b6 WatchSource:0}: Error finding container 8199a09f31a5fca066e30d379aa729792650a0875ebeb6bd35d1859cb53bb8b6: Status 404 returned error can't find the container with id 8199a09f31a5fca066e30d379aa729792650a0875ebeb6bd35d1859cb53bb8b6
Sep 18 22:25:34.932286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.932203    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jqpnl" event={"ID":"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b","Type":"ContainerStarted","Data":"fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52"}
Sep 18 22:25:34.932286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.932255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jqpnl" event={"ID":"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b","Type":"ContainerStarted","Data":"5bbbe224933d86f79c03ef65b27660e39198c2a9261680167744e49ff36a4dc2"}
Sep 18 22:25:34.932286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.932219    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-jqpnl" podUID="74e36a39-bbbe-4748-a4c4-6bdd3d158b5b" containerName="authorino" containerID="cri-o://fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52" gracePeriod=30
Sep 18 22:25:34.933501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.933478    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp" event={"ID":"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2","Type":"ContainerStarted","Data":"8199a09f31a5fca066e30d379aa729792650a0875ebeb6bd35d1859cb53bb8b6"}
Sep 18 22:25:34.947650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:34.947612    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-jqpnl" podStartSLOduration=1.397312033 podStartE2EDuration="1.947597368s" totalImagesPullingTime="550.285335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:34.945903652 +0000 UTC m=+525.523848797" watchObservedRunningTime="2026-09-18 22:25:34.947597368 +0000 UTC m=+525.525542512"
Sep 18 22:25:35.008163 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.008136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:35.188440 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.188377    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jqpnl"
Sep 18 22:25:35.267147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.267120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vscn\" (UniqueName: \"kubernetes.io/projected/74e36a39-bbbe-4748-a4c4-6bdd3d158b5b-kube-api-access-6vscn\") pod \"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b\" (UID: \"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b\") "
Sep 18 22:25:35.269336 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.269312    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e36a39-bbbe-4748-a4c4-6bdd3d158b5b-kube-api-access-6vscn" (OuterVolumeSpecName: "kube-api-access-6vscn") pod "74e36a39-bbbe-4748-a4c4-6bdd3d158b5b" (UID: "74e36a39-bbbe-4748-a4c4-6bdd3d158b5b"). InnerVolumeSpecName "kube-api-access-6vscn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:35.368585 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.368556    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vscn\" (UniqueName: \"kubernetes.io/projected/74e36a39-bbbe-4748-a4c4-6bdd3d158b5b-kube-api-access-6vscn\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:35.940003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.939965    2570 generic.go:356] "Generic (PLEG): container finished" podID="74e36a39-bbbe-4748-a4c4-6bdd3d158b5b" containerID="fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52" exitCode=0
Sep 18 22:25:35.940003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.940007    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-jqpnl"
Sep 18 22:25:35.940229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.940050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jqpnl" event={"ID":"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b","Type":"ContainerDied","Data":"fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52"}
Sep 18 22:25:35.940229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.940098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-jqpnl" event={"ID":"74e36a39-bbbe-4748-a4c4-6bdd3d158b5b","Type":"ContainerDied","Data":"5bbbe224933d86f79c03ef65b27660e39198c2a9261680167744e49ff36a4dc2"}
Sep 18 22:25:35.940229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.940126    2570 scope.go:117] "RemoveContainer" containerID="fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52"
Sep 18 22:25:35.941912 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.941800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp" event={"ID":"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2","Type":"ContainerStarted","Data":"909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e"}
Sep 18 22:25:35.949023 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.949007    2570 scope.go:117] "RemoveContainer" containerID="fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52"
Sep 18 22:25:35.949303 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:25:35.949281    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52\": container with ID starting with fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52 not found: ID does not exist" containerID="fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52"
Sep 18 22:25:35.949384 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.949310    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52"} err="failed to get container status \"fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52\": rpc error: code = NotFound desc = could not find container \"fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52\": container with ID starting with fe000d044411aae225750e6d69a86e0b656a2c01bcdc312723c04a1d05bdcc52 not found: ID does not exist"
Sep 18 22:25:35.955371 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.955348    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-jqpnl"]
Sep 18 22:25:35.958848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.958829    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-jqpnl"]
Sep 18 22:25:35.973293 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.973255    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp" podStartSLOduration=2.449676479 podStartE2EDuration="2.973241666s" totalImagesPullingTime="523.565187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:35.971951787 +0000 UTC m=+526.549896946" watchObservedRunningTime="2026-09-18 22:25:35.973241666 +0000 UTC m=+526.551186808"
Sep 18 22:25:35.998515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.998489    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rhqqf"]
Sep 18 22:25:35.998673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:35.998651    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-rhqqf" podUID="4fe9f162-d738-4f4b-9d74-40cac85ee9a4" containerName="authorino" containerID="cri-o://31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747" gracePeriod=30
Sep 18 22:25:36.261420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.261399    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rhqqf"
Sep 18 22:25:36.377793 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.377748    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/4fe9f162-d738-4f4b-9d74-40cac85ee9a4-kube-api-access-r76lx\") pod \"4fe9f162-d738-4f4b-9d74-40cac85ee9a4\" (UID: \"4fe9f162-d738-4f4b-9d74-40cac85ee9a4\") "
Sep 18 22:25:36.379953 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.379930    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fe9f162-d738-4f4b-9d74-40cac85ee9a4-kube-api-access-r76lx" (OuterVolumeSpecName: "kube-api-access-r76lx") pod "4fe9f162-d738-4f4b-9d74-40cac85ee9a4" (UID: "4fe9f162-d738-4f4b-9d74-40cac85ee9a4"). InnerVolumeSpecName "kube-api-access-r76lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:36.478710 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.478676    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r76lx\" (UniqueName: \"kubernetes.io/projected/4fe9f162-d738-4f4b-9d74-40cac85ee9a4-kube-api-access-r76lx\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:36.954880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.954842    2570 generic.go:356] "Generic (PLEG): container finished" podID="4fe9f162-d738-4f4b-9d74-40cac85ee9a4" containerID="31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747" exitCode=0
Sep 18 22:25:36.955193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.954900    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-rhqqf"
Sep 18 22:25:36.955193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.954939    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rhqqf" event={"ID":"4fe9f162-d738-4f4b-9d74-40cac85ee9a4","Type":"ContainerDied","Data":"31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747"}
Sep 18 22:25:36.955193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.954987    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-rhqqf" event={"ID":"4fe9f162-d738-4f4b-9d74-40cac85ee9a4","Type":"ContainerDied","Data":"47302900e7bb41845ee71d5a3a08bf57eff63a8ad61857e2f07f0d07e215d675"}
Sep 18 22:25:36.955193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.955010    2570 scope.go:117] "RemoveContainer" containerID="31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747"
Sep 18 22:25:36.963522 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.963504    2570 scope.go:117] "RemoveContainer" containerID="31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747"
Sep 18 22:25:36.963815 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:25:36.963770    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747\": container with ID starting with 31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747 not found: ID does not exist" containerID="31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747"
Sep 18 22:25:36.963881 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.963826    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747"} err="failed to get container status \"31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747\": rpc error: code = NotFound desc = could not find container \"31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747\": container with ID starting with 31a84ac51e744a9d8452b3e840d92b2b88f6d3fc9aba76110f7059146c15e747 not found: ID does not exist"
Sep 18 22:25:36.975273 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.975248    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rhqqf"]
Sep 18 22:25:36.979508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:36.979488    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-rhqqf"]
Sep 18 22:25:37.403326 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:37.403294    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fe9f162-d738-4f4b-9d74-40cac85ee9a4" path="/var/lib/kubelet/pods/4fe9f162-d738-4f4b-9d74-40cac85ee9a4/volumes"
Sep 18 22:25:37.403685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:37.403621    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e36a39-bbbe-4748-a4c4-6bdd3d158b5b" path="/var/lib/kubelet/pods/74e36a39-bbbe-4748-a4c4-6bdd3d158b5b/volumes"
Sep 18 22:25:39.993925 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:39.993892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:40.113190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:40.113159    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:40.930525 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:40.930477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:41.010752 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.010717    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-8qvmk"]
Sep 18 22:25:41.011282 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.011255    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fe9f162-d738-4f4b-9d74-40cac85ee9a4" containerName="authorino"
Sep 18 22:25:41.011282 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.011270    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fe9f162-d738-4f4b-9d74-40cac85ee9a4" containerName="authorino"
Sep 18 22:25:41.011406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.011291    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e36a39-bbbe-4748-a4c4-6bdd3d158b5b" containerName="authorino"
Sep 18 22:25:41.011406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.011300    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e36a39-bbbe-4748-a4c4-6bdd3d158b5b" containerName="authorino"
Sep 18 22:25:41.011406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.011395    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fe9f162-d738-4f4b-9d74-40cac85ee9a4" containerName="authorino"
Sep 18 22:25:41.011574 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.011411    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e36a39-bbbe-4748-a4c4-6bdd3d158b5b" containerName="authorino"
Sep 18 22:25:41.032487 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.032458    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.038729 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.038699    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lqtmn\""
Sep 18 22:25:41.039145 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.039120    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 22:25:41.039411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.039389    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 22:25:41.041254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.041214    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-8qvmk"]
Sep 18 22:25:41.041697 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.041480    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 22:25:41.121290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.121263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-webhook-cert\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.121493 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.121331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-metrics-certs\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.121493 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.121407    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4hr2\" (UniqueName: \"kubernetes.io/projected/6bae65d0-4c97-4eed-8bea-092003467c46-kube-api-access-f4hr2\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.142566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.142519    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:41.222486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.222394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-metrics-certs\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.222486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.222436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4hr2\" (UniqueName: \"kubernetes.io/projected/6bae65d0-4c97-4eed-8bea-092003467c46-kube-api-access-f4hr2\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.222724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.222590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-webhook-cert\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.225271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.225247    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-metrics-certs\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.225271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.225265    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-webhook-cert\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.233869 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.233843    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:41.236858 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.236837    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4hr2\" (UniqueName: \"kubernetes.io/projected/6bae65d0-4c97-4eed-8bea-092003467c46-kube-api-access-f4hr2\") pod \"maas-controller-b7fb6b9f7-8qvmk\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") " pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.346770 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.346733    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:41.622483 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.622457    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-8qvmk"]
Sep 18 22:25:41.624636 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:25:41.624611    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bae65d0_4c97_4eed_8bea_092003467c46.slice/crio-654d3c0957ffe1a353f43d4d79028ab78578d2f8d42ad30ea8efa604563406a4 WatchSource:0}: Error finding container 654d3c0957ffe1a353f43d4d79028ab78578d2f8d42ad30ea8efa604563406a4: Status 404 returned error can't find the container with id 654d3c0957ffe1a353f43d4d79028ab78578d2f8d42ad30ea8efa604563406a4
Sep 18 22:25:41.980149 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:41.980062    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk" event={"ID":"6bae65d0-4c97-4eed-8bea-092003467c46","Type":"ContainerStarted","Data":"654d3c0957ffe1a353f43d4d79028ab78578d2f8d42ad30ea8efa604563406a4"}
Sep 18 22:25:44.194757 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:44.194726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:44.291914 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:44.291834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:25:44.997722 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:44.997684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk" event={"ID":"6bae65d0-4c97-4eed-8bea-092003467c46","Type":"ContainerStarted","Data":"b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2"}
Sep 18 22:25:44.997947 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:44.997826    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:45.015616 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:45.015564    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk" podStartSLOduration=2.632404503 podStartE2EDuration="5.015544766s" totalImagesPullingTime="2.383140263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:25:45.01449091 +0000 UTC m=+535.592436068" watchObservedRunningTime="2026-09-18 22:25:45.015544766 +0000 UTC m=+535.593489914"
Sep 18 22:25:56.006626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.006590    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:56.126989 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.126940    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-8qvmk"]
Sep 18 22:25:56.127214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.127189    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk" podUID="6bae65d0-4c97-4eed-8bea-092003467c46" containerName="manager" containerID="cri-o://b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2" gracePeriod=30
Sep 18 22:25:56.370821 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.370773    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:56.459814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.459765    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-webhook-cert\") pod \"6bae65d0-4c97-4eed-8bea-092003467c46\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") "
Sep 18 22:25:56.459960 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.459842    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-metrics-certs\") pod \"6bae65d0-4c97-4eed-8bea-092003467c46\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") "
Sep 18 22:25:56.459960 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.459938    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4hr2\" (UniqueName: \"kubernetes.io/projected/6bae65d0-4c97-4eed-8bea-092003467c46-kube-api-access-f4hr2\") pod \"6bae65d0-4c97-4eed-8bea-092003467c46\" (UID: \"6bae65d0-4c97-4eed-8bea-092003467c46\") "
Sep 18 22:25:56.462208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.462175    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6bae65d0-4c97-4eed-8bea-092003467c46" (UID: "6bae65d0-4c97-4eed-8bea-092003467c46"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:25:56.462208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.462188    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6bae65d0-4c97-4eed-8bea-092003467c46" (UID: "6bae65d0-4c97-4eed-8bea-092003467c46"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:25:56.462208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.462194    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bae65d0-4c97-4eed-8bea-092003467c46-kube-api-access-f4hr2" (OuterVolumeSpecName: "kube-api-access-f4hr2") pod "6bae65d0-4c97-4eed-8bea-092003467c46" (UID: "6bae65d0-4c97-4eed-8bea-092003467c46"). InnerVolumeSpecName "kube-api-access-f4hr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:56.560690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.560619    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4hr2\" (UniqueName: \"kubernetes.io/projected/6bae65d0-4c97-4eed-8bea-092003467c46-kube-api-access-f4hr2\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:56.560690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.560643    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-webhook-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:56.560690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:56.560652    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6bae65d0-4c97-4eed-8bea-092003467c46-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:25:57.056159 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.056124    2570 generic.go:356] "Generic (PLEG): container finished" podID="6bae65d0-4c97-4eed-8bea-092003467c46" containerID="b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2" exitCode=0
Sep 18 22:25:57.056569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.056163    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk"
Sep 18 22:25:57.056569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.056212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk" event={"ID":"6bae65d0-4c97-4eed-8bea-092003467c46","Type":"ContainerDied","Data":"b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2"}
Sep 18 22:25:57.056569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.056259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-8qvmk" event={"ID":"6bae65d0-4c97-4eed-8bea-092003467c46","Type":"ContainerDied","Data":"654d3c0957ffe1a353f43d4d79028ab78578d2f8d42ad30ea8efa604563406a4"}
Sep 18 22:25:57.056569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.056285    2570 scope.go:117] "RemoveContainer" containerID="b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2"
Sep 18 22:25:57.065336 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.065316    2570 scope.go:117] "RemoveContainer" containerID="b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2"
Sep 18 22:25:57.065631 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:25:57.065588    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2\": container with ID starting with b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2 not found: ID does not exist" containerID="b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2"
Sep 18 22:25:57.065699 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.065615    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2"} err="failed to get container status \"b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2\": rpc error: code = NotFound desc = could not find container \"b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2\": container with ID starting with b353dc63d203844a2e3d958dfc5a040a950f87a41edb6ed845176512cc6e7be2 not found: ID does not exist"
Sep 18 22:25:57.077689 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.077670    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-8qvmk"]
Sep 18 22:25:57.082691 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.082670    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-8qvmk"]
Sep 18 22:25:57.402836 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:25:57.402773    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bae65d0-4c97-4eed-8bea-092003467c46" path="/var/lib/kubelet/pods/6bae65d0-4c97-4eed-8bea-092003467c46/volumes"
Sep 18 22:26:11.956852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:11.956822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:13.635173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:13.635128    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:13.746898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:13.746865    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:15.130381 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.130342    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:15.320545 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.320513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:15.368654 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.368605    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"]
Sep 18 22:26:15.369221 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.369206    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bae65d0-4c97-4eed-8bea-092003467c46" containerName="manager"
Sep 18 22:26:15.369270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.369225    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bae65d0-4c97-4eed-8bea-092003467c46" containerName="manager"
Sep 18 22:26:15.369334 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.369324    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bae65d0-4c97-4eed-8bea-092003467c46" containerName="manager"
Sep 18 22:26:15.372769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.372751    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.377594 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.377567    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 22:26:15.377864 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.377849    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7xxrx\""
Sep 18 22:26:15.378197 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.378178    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 22:26:15.389939 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.389881    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"]
Sep 18 22:26:15.421184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.421150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kplc8\" (UniqueName: \"kubernetes.io/projected/ddc7dfae-3790-4555-95c1-d2aae82a49fd-kube-api-access-kplc8\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.421184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.421187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.421408 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.421222    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc7dfae-3790-4555-95c1-d2aae82a49fd-openshift-service-ca\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.421408 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.421300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.521928 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.521893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kplc8\" (UniqueName: \"kubernetes.io/projected/ddc7dfae-3790-4555-95c1-d2aae82a49fd-kube-api-access-kplc8\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.521928 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.521928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.522174 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.521955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc7dfae-3790-4555-95c1-d2aae82a49fd-openshift-service-ca\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.522174 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.521993    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.522174 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:26:15.522072    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 18 22:26:15.522174 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:26:15.522148    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs podName:ddc7dfae-3790-4555-95c1-d2aae82a49fd nodeName:}" failed. No retries permitted until 2026-09-18 22:26:16.022126151 +0000 UTC m=+566.600071282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs") pod "maas-api-5598d8c9fb-bf8z8" (UID: "ddc7dfae-3790-4555-95c1-d2aae82a49fd") : secret "maas-api-metrics-tls" not found
Sep 18 22:26:15.522174 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:26:15.522163    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 18 22:26:15.522439 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:26:15.522223    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls podName:ddc7dfae-3790-4555-95c1-d2aae82a49fd nodeName:}" failed. No retries permitted until 2026-09-18 22:26:16.022205125 +0000 UTC m=+566.600150267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls") pod "maas-api-5598d8c9fb-bf8z8" (UID: "ddc7dfae-3790-4555-95c1-d2aae82a49fd") : secret "maas-api-serving-cert" not found
Sep 18 22:26:15.522666 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.522640    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc7dfae-3790-4555-95c1-d2aae82a49fd-openshift-service-ca\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.531489 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.531460    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kplc8\" (UniqueName: \"kubernetes.io/projected/ddc7dfae-3790-4555-95c1-d2aae82a49fd-kube-api-access-kplc8\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:15.632314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.632282    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:15.732834 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.732737    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:15.836205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.836170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:15.997321 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:15.997237    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:16.025350 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:16.025320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:16.025548 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:16.025375    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:16.028003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:16.027977    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:16.028135 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:16.028115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs\") pod \"maas-api-5598d8c9fb-bf8z8\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:16.284091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:16.284004    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:16.573011 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:16.572970    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"]
Sep 18 22:26:16.575455 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:26:16.575427    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc7dfae_3790_4555_95c1_d2aae82a49fd.slice/crio-33900dbd45bf51df64219666855c3ae96c1da06cb94f2c9ade0ff230f022fe45 WatchSource:0}: Error finding container 33900dbd45bf51df64219666855c3ae96c1da06cb94f2c9ade0ff230f022fe45: Status 404 returned error can't find the container with id 33900dbd45bf51df64219666855c3ae96c1da06cb94f2c9ade0ff230f022fe45
Sep 18 22:26:17.156091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:17.156057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8" event={"ID":"ddc7dfae-3790-4555-95c1-d2aae82a49fd","Type":"ContainerStarted","Data":"33900dbd45bf51df64219666855c3ae96c1da06cb94f2c9ade0ff230f022fe45"}
Sep 18 22:26:18.011732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:18.011695    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:19.168130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:19.168095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8" event={"ID":"ddc7dfae-3790-4555-95c1-d2aae82a49fd","Type":"ContainerStarted","Data":"11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c"}
Sep 18 22:26:19.168533 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:19.168173    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:19.193237 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:19.190236    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8" podStartSLOduration=2.330954086 podStartE2EDuration="4.190216722s" totalImagesPullingTime="1.859262636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:26:19.189152461 +0000 UTC m=+569.767097608" watchObservedRunningTime="2026-09-18 22:26:19.190216722 +0000 UTC m=+569.768161868"
Sep 18 22:26:25.178682 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:25.178652    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:26:26.186329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.186261    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:26.204945 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.204916    2570 generic.go:356] "Generic (PLEG): container finished" podID="96fef461-96b6-4e72-929a-2b64f97f9be1" containerID="73ed2834c50f30531b1d639d7c2ccd0791607f25bbf5687f9b0d6ac675339c18" exitCode=0
Sep 18 22:26:26.205073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.204993    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" event={"ID":"96fef461-96b6-4e72-929a-2b64f97f9be1","Type":"ContainerDied","Data":"73ed2834c50f30531b1d639d7c2ccd0791607f25bbf5687f9b0d6ac675339c18"}
Sep 18 22:26:26.205470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.205453    2570 scope.go:117] "RemoveContainer" containerID="73ed2834c50f30531b1d639d7c2ccd0791607f25bbf5687f9b0d6ac675339c18"
Sep 18 22:26:26.206472 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.206446    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:26:26.206582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.206550    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:26:26.206643 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.206595    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:26:26.285232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:26.285201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:26:27.213119 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:27.213084    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" event={"ID":"96fef461-96b6-4e72-929a-2b64f97f9be1","Type":"ContainerStarted","Data":"a595165950eb07d56694275716b35aa7a820349e93ada83c58ac4df2a6fa206c"}
Sep 18 22:26:28.179403 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:28.179311    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:26:28.179685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:28.179650    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9pkn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 18 22:26:28.180144 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:28.179760    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" podUID="96fef461-96b6-4e72-929a-2b64f97f9be1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 18 22:26:29.179909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:29.179764    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9pkn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 18 22:26:29.179909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:29.179875    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" podUID="96fef461-96b6-4e72-929a-2b64f97f9be1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 18 22:26:30.179837 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:30.179802    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9pkn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 18 22:26:30.180109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:30.180078    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" podUID="96fef461-96b6-4e72-929a-2b64f97f9be1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 18 22:26:31.179196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:31.179157    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9pkn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 18 22:26:31.179508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:31.179473    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" podUID="96fef461-96b6-4e72-929a-2b64f97f9be1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 18 22:26:32.179657 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:32.179611    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9pkn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 18 22:26:32.180192 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:32.179688    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8" podUID="96fef461-96b6-4e72-929a-2b64f97f9be1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 18 22:26:33.183071 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:33.183038    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:26:33.183448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:33.183325    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:26:33.184073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:33.184052    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8"
Sep 18 22:26:51.344600 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:51.344573    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:26:51.348211 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:26:51.348187    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:27:07.644687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.644599    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"]
Sep 18 22:27:07.648075 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.648048    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.651560 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.651535    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 22:27:07.651707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.651560    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 22:27:07.651707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.651637    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 18 22:27:07.651707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.651658    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s9rh9\""
Sep 18 22:27:07.659671 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.659650    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"]
Sep 18 22:27:07.684434 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.684394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.684612 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.684497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847cd8e7-3a4f-4bef-a438-05540aab4c42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.684612 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.684532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.684612 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.684568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59tz9\" (UniqueName: \"kubernetes.io/projected/847cd8e7-3a4f-4bef-a438-05540aab4c42-kube-api-access-59tz9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.684880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.684666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.684880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.684700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.685344 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.685327    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:07.785193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785156    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59tz9\" (UniqueName: \"kubernetes.io/projected/847cd8e7-3a4f-4bef-a438-05540aab4c42-kube-api-access-59tz9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785222    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847cd8e7-3a4f-4bef-a438-05540aab4c42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785633    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785725 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785696    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.785773 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.785703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.787728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.787705    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847cd8e7-3a4f-4bef-a438-05540aab4c42-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.787930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.787912    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847cd8e7-3a4f-4bef-a438-05540aab4c42-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.794020 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.793999    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59tz9\" (UniqueName: \"kubernetes.io/projected/847cd8e7-3a4f-4bef-a438-05540aab4c42-kube-api-access-59tz9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz\" (UID: \"847cd8e7-3a4f-4bef-a438-05540aab4c42\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:07.959856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:07.959750    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:08.238522 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:08.238444    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"]
Sep 18 22:27:08.241536 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:27:08.241505    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847cd8e7_3a4f_4bef_a438_05540aab4c42.slice/crio-adb915e5cce75972e290c077fdd00b3a5e2d31d94449949c38eda3f1930b6962 WatchSource:0}: Error finding container adb915e5cce75972e290c077fdd00b3a5e2d31d94449949c38eda3f1930b6962: Status 404 returned error can't find the container with id adb915e5cce75972e290c077fdd00b3a5e2d31d94449949c38eda3f1930b6962
Sep 18 22:27:08.419447 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:08.419408    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz" event={"ID":"847cd8e7-3a4f-4bef-a438-05540aab4c42","Type":"ContainerStarted","Data":"adb915e5cce75972e290c077fdd00b3a5e2d31d94449949c38eda3f1930b6962"}
Sep 18 22:27:10.430292 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:10.430251    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz" event={"ID":"847cd8e7-3a4f-4bef-a438-05540aab4c42","Type":"ContainerStarted","Data":"cfb14776788ae94290e5a37259425d67e65b9f8ccce6bce6aef5e2901e0842e9"}
Sep 18 22:27:10.451730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:10.451680    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz" podStartSLOduration=2.297446785 podStartE2EDuration="3.451663309s" totalImagesPullingTime="1.154216524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:27:10.449744703 +0000 UTC m=+621.027689847" watchObservedRunningTime="2026-09-18 22:27:10.451663309 +0000 UTC m=+621.029608454"
Sep 18 22:27:14.397835 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:14.397774    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:14.497211 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:14.497181    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:17.960236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:17.960200    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:17.960650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:17.960275    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:17.972666 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:17.972626    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:18.479402 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:18.479376    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz"
Sep 18 22:27:24.566387 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:24.566351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:28.551546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.551517    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"]
Sep 18 22:27:28.556390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.556369    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.559146 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.559126    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 18 22:27:28.568748 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.568713    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"]
Sep 18 22:27:28.580140 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.580069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:28.664273 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.664232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.664457 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.664374    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.664457 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.664404    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.664457 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.664421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm6z9\" (UniqueName: \"kubernetes.io/projected/a45efa93-454c-4938-8102-16b0b5ff5ac0-kube-api-access-xm6z9\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.664457 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.664439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a45efa93-454c-4938-8102-16b0b5ff5ac0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.664617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.664465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.764981 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.764944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.764981 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.764981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.765253 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.764999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm6z9\" (UniqueName: \"kubernetes.io/projected/a45efa93-454c-4938-8102-16b0b5ff5ac0-kube-api-access-xm6z9\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.765253 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.765019    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a45efa93-454c-4938-8102-16b0b5ff5ac0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.765253 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.765054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.765253 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.765115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.765473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.765454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.765517 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.765486    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.765552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.765517    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.767323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.767301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a45efa93-454c-4938-8102-16b0b5ff5ac0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.767730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.767698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a45efa93-454c-4938-8102-16b0b5ff5ac0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.774117 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.774100    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm6z9\" (UniqueName: \"kubernetes.io/projected/a45efa93-454c-4938-8102-16b0b5ff5ac0-kube-api-access-xm6z9\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5\" (UID: \"a45efa93-454c-4938-8102-16b0b5ff5ac0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:28.867555 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:28.867532    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:29.142709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:29.142682    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"]
Sep 18 22:27:29.144349 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:27:29.144322    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45efa93_454c_4938_8102_16b0b5ff5ac0.slice/crio-495d8fc178ed020f94389f717ad0d883ce645bd620d62bfaf2f66b3ebbe3dba2 WatchSource:0}: Error finding container 495d8fc178ed020f94389f717ad0d883ce645bd620d62bfaf2f66b3ebbe3dba2: Status 404 returned error can't find the container with id 495d8fc178ed020f94389f717ad0d883ce645bd620d62bfaf2f66b3ebbe3dba2
Sep 18 22:27:29.145731 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:29.145711    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:27:29.526154 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:29.526055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5" event={"ID":"a45efa93-454c-4938-8102-16b0b5ff5ac0","Type":"ContainerStarted","Data":"83c6c1acf8e95035330a2c0a565f2b8655b88bed2d51a6447c824889d505b70b"}
Sep 18 22:27:29.526154 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:29.526109    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5" event={"ID":"a45efa93-454c-4938-8102-16b0b5ff5ac0","Type":"ContainerStarted","Data":"495d8fc178ed020f94389f717ad0d883ce645bd620d62bfaf2f66b3ebbe3dba2"}
Sep 18 22:27:29.590037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:29.589977    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5" podStartSLOduration=1.403497819 podStartE2EDuration="1.589954123s" totalImagesPullingTime="186.456304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:27:29.588334019 +0000 UTC m=+640.166279167" watchObservedRunningTime="2026-09-18 22:27:29.589954123 +0000 UTC m=+640.167899271"
Sep 18 22:27:32.208952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:32.208912    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:38.868110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:38.868073    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:38.868577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:38.868140    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:38.881639 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:38.881606    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:39.288754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.288668    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"]
Sep 18 22:27:39.292240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.292217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.295087 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.295068    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 18 22:27:39.310095 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.310074    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"]
Sep 18 22:27:39.344002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.343969    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:39.362252 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.362218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xd49\" (UniqueName: \"kubernetes.io/projected/884acf9a-cd5d-4720-87d6-df0a61329f96-kube-api-access-2xd49\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.362400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.362276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884acf9a-cd5d-4720-87d6-df0a61329f96-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.362400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.362330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.362400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.362361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.362400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.362392    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.362617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.362515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.463770 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.463723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xd49\" (UniqueName: \"kubernetes.io/projected/884acf9a-cd5d-4720-87d6-df0a61329f96-kube-api-access-2xd49\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.463986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.463838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884acf9a-cd5d-4720-87d6-df0a61329f96-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.463986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.463870    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.463986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.463893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.463986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.463922    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.464220 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.464008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.464494 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.464455    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.464700 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.464571    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.464700 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.464640    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.467250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.467221    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/884acf9a-cd5d-4720-87d6-df0a61329f96-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.467347 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.467304    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/884acf9a-cd5d-4720-87d6-df0a61329f96-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.473979 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.473951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xd49\" (UniqueName: \"kubernetes.io/projected/884acf9a-cd5d-4720-87d6-df0a61329f96-kube-api-access-2xd49\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg\" (UID: \"884acf9a-cd5d-4720-87d6-df0a61329f96\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.587667 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.587638    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5"
Sep 18 22:27:39.603307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.603281    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:39.899402 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:39.899374    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"]
Sep 18 22:27:39.902805 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:27:39.902764    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884acf9a_cd5d_4720_87d6_df0a61329f96.slice/crio-e0d81e1569f3c955e4ed5851a42455191ce5e2cad154b4454b78b332d9ed8dbc WatchSource:0}: Error finding container e0d81e1569f3c955e4ed5851a42455191ce5e2cad154b4454b78b332d9ed8dbc: Status 404 returned error can't find the container with id e0d81e1569f3c955e4ed5851a42455191ce5e2cad154b4454b78b332d9ed8dbc
Sep 18 22:27:40.582639 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:40.582605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg" event={"ID":"884acf9a-cd5d-4720-87d6-df0a61329f96","Type":"ContainerStarted","Data":"23561c6d250681b517a7f7645e973aa06d858b9446ad07b09cb774e4fa6aff7d"}
Sep 18 22:27:40.582865 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:40.582654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg" event={"ID":"884acf9a-cd5d-4720-87d6-df0a61329f96","Type":"ContainerStarted","Data":"e0d81e1569f3c955e4ed5851a42455191ce5e2cad154b4454b78b332d9ed8dbc"}
Sep 18 22:27:40.603510 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:40.603456    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg" podStartSLOduration=1.432774449 podStartE2EDuration="1.603438831s" totalImagesPullingTime="170.664382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:27:40.601995068 +0000 UTC m=+651.179940213" watchObservedRunningTime="2026-09-18 22:27:40.603438831 +0000 UTC m=+651.181383976"
Sep 18 22:27:44.676680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:44.676640    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:47.040407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:47.040375    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:27:49.603955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:49.603917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:49.604379 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:49.603982    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:49.616889 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:49.616864    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:49.639255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:49.639228    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg"
Sep 18 22:27:51.175953 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:27:51.175912    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:28:47.346736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.346644    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-646f74d496-h24nm"]
Sep 18 22:28:47.350496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.350470    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.359236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.359208    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-646f74d496-h24nm"]
Sep 18 22:28:47.490862 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.490824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr2dg\" (UniqueName: \"kubernetes.io/projected/d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a-kube-api-access-mr2dg\") pod \"authorino-646f74d496-h24nm\" (UID: \"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a\") " pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.490862 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.490866    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a-tls-cert\") pod \"authorino-646f74d496-h24nm\" (UID: \"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a\") " pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.591857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.591819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr2dg\" (UniqueName: \"kubernetes.io/projected/d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a-kube-api-access-mr2dg\") pod \"authorino-646f74d496-h24nm\" (UID: \"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a\") " pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.591857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.591858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a-tls-cert\") pod \"authorino-646f74d496-h24nm\" (UID: \"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a\") " pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.594456 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.594432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a-tls-cert\") pod \"authorino-646f74d496-h24nm\" (UID: \"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a\") " pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.600987 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.600930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr2dg\" (UniqueName: \"kubernetes.io/projected/d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a-kube-api-access-mr2dg\") pod \"authorino-646f74d496-h24nm\" (UID: \"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a\") " pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.661244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.661204    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-646f74d496-h24nm"
Sep 18 22:28:47.938473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:47.938447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-646f74d496-h24nm"]
Sep 18 22:28:47.940524 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:28:47.940479    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1007e2b_a27f_4c9f_bdaf_79bbb2dde61a.slice/crio-814bce83a4ec376e7477cb2389dbf64bd7c4387a016416f179d83b82002ec86d WatchSource:0}: Error finding container 814bce83a4ec376e7477cb2389dbf64bd7c4387a016416f179d83b82002ec86d: Status 404 returned error can't find the container with id 814bce83a4ec376e7477cb2389dbf64bd7c4387a016416f179d83b82002ec86d
Sep 18 22:28:48.932317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:48.932228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-646f74d496-h24nm" event={"ID":"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a","Type":"ContainerStarted","Data":"fa0b3f4c511ac8d49faf85b639e7d7c4d16d8495580bf0cc572f868ce605ee84"}
Sep 18 22:28:48.932317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:48.932278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-646f74d496-h24nm" event={"ID":"d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a","Type":"ContainerStarted","Data":"814bce83a4ec376e7477cb2389dbf64bd7c4387a016416f179d83b82002ec86d"}
Sep 18 22:28:48.983280 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:48.983219    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-646f74d496-h24nm" podStartSLOduration=1.266064615 podStartE2EDuration="1.983197926s" totalImagesPullingTime="717.133311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:28:48.95352613 +0000 UTC m=+719.531471275" watchObservedRunningTime="2026-09-18 22:28:48.983197926 +0000 UTC m=+719.561143070"
Sep 18 22:28:48.985464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:48.985427    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bbb5fc67c-f8nsp"]
Sep 18 22:28:48.985675 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:48.985650    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp" podUID="cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" containerName="authorino" containerID="cri-o://909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e" gracePeriod=30
Sep 18 22:28:49.248949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.248918    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:28:49.409932 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.409896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-tls-cert\") pod \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") "
Sep 18 22:28:49.410106 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.410039    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbdvq\" (UniqueName: \"kubernetes.io/projected/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-kube-api-access-zbdvq\") pod \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\" (UID: \"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2\") "
Sep 18 22:28:49.412224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.412198    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-kube-api-access-zbdvq" (OuterVolumeSpecName: "kube-api-access-zbdvq") pod "cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" (UID: "cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2"). InnerVolumeSpecName "kube-api-access-zbdvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:49.422007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.421978    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" (UID: "cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:28:49.511809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.511701    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbdvq\" (UniqueName: \"kubernetes.io/projected/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-kube-api-access-zbdvq\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:28:49.511809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.511737    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2-tls-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:28:49.550122 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.550069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:28:49.645267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.645235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:28:49.940083 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.940041    2570 generic.go:356] "Generic (PLEG): container finished" podID="cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" containerID="909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e" exitCode=0
Sep 18 22:28:49.940567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.940184    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp"
Sep 18 22:28:49.940567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.940177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp" event={"ID":"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2","Type":"ContainerDied","Data":"909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e"}
Sep 18 22:28:49.940567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.940245    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbb5fc67c-f8nsp" event={"ID":"cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2","Type":"ContainerDied","Data":"8199a09f31a5fca066e30d379aa729792650a0875ebeb6bd35d1859cb53bb8b6"}
Sep 18 22:28:49.940567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.940279    2570 scope.go:117] "RemoveContainer" containerID="909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e"
Sep 18 22:28:49.953800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.953489    2570 scope.go:117] "RemoveContainer" containerID="909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e"
Sep 18 22:28:49.953949 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:28:49.953869    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e\": container with ID starting with 909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e not found: ID does not exist" containerID="909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e"
Sep 18 22:28:49.953949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.953915    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e"} err="failed to get container status \"909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e\": rpc error: code = NotFound desc = could not find container \"909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e\": container with ID starting with 909c7abbc516107cc29989838e15d8d9c96d3265505ff53b073b904ad7d2af4e not found: ID does not exist"
Sep 18 22:28:49.968372 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.968340    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bbb5fc67c-f8nsp"]
Sep 18 22:28:49.973330 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:49.973294    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bbb5fc67c-f8nsp"]
Sep 18 22:28:50.668108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:50.668073    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:28:50.766614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:50.766584    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:28:51.404113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:28:51.404083    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" path="/var/lib/kubelet/pods/cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2/volumes"
Sep 18 22:29:04.411139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:04.411101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:06.304092 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.304061    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:06.407261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.407226    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:06.515407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.515360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:06.636328 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.636299    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"]
Sep 18 22:29:06.636764 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.636747    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" containerName="authorino"
Sep 18 22:29:06.636918 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.636767    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" containerName="authorino"
Sep 18 22:29:06.636918 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.636912    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbdcec15-fff8-48ea-a6c8-ecbc319ab9c2" containerName="authorino"
Sep 18 22:29:06.640076 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.640056    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.643321 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.643300    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-eac715-openshift-default-dockercfg-jczfd\""
Sep 18 22:29:06.657394 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.657367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-credential-socket\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.657603 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.657583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-socket\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.657714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.657702    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-data\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.657841 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.657824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxdv\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-kube-api-access-kzxdv\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.657963 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.657949    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istiod-ca-cert\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.658103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.658089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-podinfo\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.658273 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.658257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-token\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.658404 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.658389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-certs\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.658514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.658502    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-envoy\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.659318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.659293    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"]
Sep 18 22:29:06.690909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.690882    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:06.732108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.732074    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"]
Sep 18 22:29:06.736280 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.736241    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.739127 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.739099    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-c5fdd3-openshift-default-dockercfg-dmcxd\""
Sep 18 22:29:06.753248 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.753218    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"]
Sep 18 22:29:06.759189 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759152    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-podinfo\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759204    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-socket\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759235    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-envoy\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759267    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-data\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759410 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3db8e9e-a3b4-4965-a710-4166daa84f76-istiod-ca-cert\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759410 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-token\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759410 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-credential-socket\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759410 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-token\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-certs\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759474    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-envoy\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759506    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2zk4\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-kube-api-access-k2zk4\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-credential-socket\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-socket\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-data\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxdv\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-kube-api-access-kzxdv\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istiod-ca-cert\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.759795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759706    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-certs\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.759795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.759736    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-podinfo\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.760409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.760380    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-certs\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.760725 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.760704    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-socket\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.761104 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.760933    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-credential-socket\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.761249 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.761023    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-data\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.761503 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.761482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istiod-ca-cert\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.763126 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.763106    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-envoy\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.763255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.763170    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-podinfo\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.771694 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.771667    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-token\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.773528 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.772706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxdv\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-kube-api-access-kzxdv\") pod \"e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") " pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.803168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.803119    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:06.811981 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.811944    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"]
Sep 18 22:29:06.817585 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.817555    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.822577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.822261    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-f9cf33-openshift-default-dockercfg-lnszv\""
Sep 18 22:29:06.838521 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.837372    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"]
Sep 18 22:29:06.860496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-socket\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.860673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860508    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istiod-ca-cert\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.860673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860597    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-certs\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.860673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-certs\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.860673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-podinfo\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.860948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860708    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd4rc\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-kube-api-access-qd4rc\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.860948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860746    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-envoy\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.860948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-socket\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.860948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-envoy\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.860948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860854    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-data\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.860948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3db8e9e-a3b4-4965-a710-4166daa84f76-istiod-ca-cert\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.860948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-podinfo\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.861333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-token\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.861333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.860991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-credential-socket\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.861333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-certs\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.861333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-token\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.861333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-credential-socket\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.861333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2zk4\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-kube-api-access-k2zk4\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.861333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-data\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.861948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861400    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-socket\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.861948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861667    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-credential-socket\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.861948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3db8e9e-a3b4-4965-a710-4166daa84f76-istiod-ca-cert\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.861948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.861798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-data\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.863375 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.863356    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-envoy\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.863629 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.863609    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-podinfo\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.870868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.870763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2zk4\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-kube-api-access-k2zk4\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.871289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.871268    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-token\") pod \"e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") " pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:06.896994 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.896925    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:06.951088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.951051    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:06.962734 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.962703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-podinfo\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.962892 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.962762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-token\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.962892 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.962833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-credential-socket\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.962892 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.962861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-data\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.963070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.962898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-socket\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.963070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.962927    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istiod-ca-cert\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.963070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.962972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-certs\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.963070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.963007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd4rc\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-kube-api-access-qd4rc\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.963070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.963036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-envoy\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.964228 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.963478    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-socket\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.964228 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.963906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-credential-socket\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.964228 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.963945    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-data\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.964482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.964282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-certs\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.964861 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.964835    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istiod-ca-cert\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.965674 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.965650    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-envoy\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.966156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.966136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-podinfo\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.971723 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.971698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-token\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.972412 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.972390    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd4rc\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-kube-api-access-qd4rc\") pod \"e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") " pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:06.995532 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:06.995489    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:07.051920 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.051593    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:07.096891 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.096836    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:07.132536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.132496    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:07.201481 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.199510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:07.240837 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.240807    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"]
Sep 18 22:29:07.245871 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:29:07.245838    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c147a5e_dc36_4ef6_a6ff_dd71627ce1c8.slice/crio-4618ebf32b082319f6beb12371b16efc3eab15e066617716ae2194ad12d62389 WatchSource:0}: Error finding container 4618ebf32b082319f6beb12371b16efc3eab15e066617716ae2194ad12d62389: Status 404 returned error can't find the container with id 4618ebf32b082319f6beb12371b16efc3eab15e066617716ae2194ad12d62389
Sep 18 22:29:07.247754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.247719    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.247886 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.247836    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.247886 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.247881    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.345057 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.345025    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"]
Sep 18 22:29:07.347742 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:29:07.347429    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3db8e9e_a3b4_4965_a710_4166daa84f76.slice/crio-609d5637b8b4aa291220a17d1d1ea570f16cc98bf0ef8a1d031fb083baa81818 WatchSource:0}: Error finding container 609d5637b8b4aa291220a17d1d1ea570f16cc98bf0ef8a1d031fb083baa81818: Status 404 returned error can't find the container with id 609d5637b8b4aa291220a17d1d1ea570f16cc98bf0ef8a1d031fb083baa81818
Sep 18 22:29:07.350167 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.350128    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.350262 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.350220    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.350302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.350263    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.424978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.424949    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"]
Sep 18 22:29:07.427033 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:29:07.427000    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05a7b06_5edc_40cd_8ae8_820e1cabd1ae.slice/crio-21adb77ff027515e56ecc6d6e807c4ace73b5022ef93258b98d479d1a916db0f WatchSource:0}: Error finding container 21adb77ff027515e56ecc6d6e807c4ace73b5022ef93258b98d479d1a916db0f: Status 404 returned error can't find the container with id 21adb77ff027515e56ecc6d6e807c4ace73b5022ef93258b98d479d1a916db0f
Sep 18 22:29:07.429421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.429373    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.429511 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.429463    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.429511 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.429500    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:07.690000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.689915    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:07.791396 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:07.791355    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:08.046557 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.046448    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" event={"ID":"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8","Type":"ContainerStarted","Data":"321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b"}
Sep 18 22:29:08.046557 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.046509    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" event={"ID":"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8","Type":"ContainerStarted","Data":"4618ebf32b082319f6beb12371b16efc3eab15e066617716ae2194ad12d62389"}
Sep 18 22:29:08.048198 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.048172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" event={"ID":"a3db8e9e-a3b4-4965-a710-4166daa84f76","Type":"ContainerStarted","Data":"83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea"}
Sep 18 22:29:08.048333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.048226    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" event={"ID":"a3db8e9e-a3b4-4965-a710-4166daa84f76","Type":"ContainerStarted","Data":"609d5637b8b4aa291220a17d1d1ea570f16cc98bf0ef8a1d031fb083baa81818"}
Sep 18 22:29:08.049744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.049724    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" event={"ID":"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae","Type":"ContainerStarted","Data":"557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d"}
Sep 18 22:29:08.049852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.049763    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" event={"ID":"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae","Type":"ContainerStarted","Data":"21adb77ff027515e56ecc6d6e807c4ace73b5022ef93258b98d479d1a916db0f"}
Sep 18 22:29:08.052481 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.052460    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:08.054015 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.053992    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:08.054136 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.054035    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:08.089580 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.089530    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podStartSLOduration=2.089513745 podStartE2EDuration="2.089513745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:29:08.084536934 +0000 UTC m=+738.662482079" watchObservedRunningTime="2026-09-18 22:29:08.089513745 +0000 UTC m=+738.667458889"
Sep 18 22:29:08.127858 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.127801    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podStartSLOduration=2.127766825 podStartE2EDuration="2.127766825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:29:08.126623533 +0000 UTC m=+738.704568701" watchObservedRunningTime="2026-09-18 22:29:08.127766825 +0000 UTC m=+738.705711970"
Sep 18 22:29:08.133303 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.133274    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:08.139174 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.139135    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:08.155531 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.155484    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podStartSLOduration=2.155469063 podStartE2EDuration="2.155469063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:29:08.154388032 +0000 UTC m=+738.732333178" watchObservedRunningTime="2026-09-18 22:29:08.155469063 +0000 UTC m=+738.733414205"
Sep 18 22:29:08.193479 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.193434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:08.951302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.951267    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:08.956470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:08.956447    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:09.054969 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:09.054934    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:09.055150 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:09.055000    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:09.055897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:09.055875    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:09.056116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:09.056091    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:09.056895 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:09.056879    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:10.060593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:10.060548    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:10.061301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:10.061281    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:10.147307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:10.147248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:10.262513 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:10.262477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:10.400724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:10.400691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:10.505378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:10.505345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:11.575646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:11.575609    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:11.677120 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:11.677086    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:12.020274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:12.020227    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:12.158519 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:12.158490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:12.255319 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:12.255281    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:12.625644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:12.625613    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:12.726167 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:12.726131    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:13.079028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.078936    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:13.188003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.187972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:13.292081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.292046    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:13.800175 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.800144    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"]
Sep 18 22:29:13.806037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.805513    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:13.808202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.808179    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-c5fdd3-serving-cert\""
Sep 18 22:29:13.818745 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.818130    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"]
Sep 18 22:29:13.865405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.865371    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:13.940965 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.940920    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98ff8d80-58b1-49cb-9d47-4396ebc12d97-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:13.941196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.941090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-metrics-certs\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:13.941196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.941161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:13.941338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.941214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hppq\" (UniqueName: \"kubernetes.io/projected/98ff8d80-58b1-49cb-9d47-4396ebc12d97-kube-api-access-7hppq\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:13.960960 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:13.960932    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:14.042143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.042103    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.042143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.042149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hppq\" (UniqueName: \"kubernetes.io/projected/98ff8d80-58b1-49cb-9d47-4396ebc12d97-kube-api-access-7hppq\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.042387 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.042176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98ff8d80-58b1-49cb-9d47-4396ebc12d97-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.042387 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.042261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-metrics-certs\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.042387 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:29:14.042276    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-serving-cert: secret "maas-api-e2e-worker-w0-c5fdd3-serving-cert" not found
Sep 18 22:29:14.042387 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:29:14.042348    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls podName:98ff8d80-58b1-49cb-9d47-4396ebc12d97 nodeName:}" failed. No retries permitted until 2026-09-18 22:29:14.54232826 +0000 UTC m=+745.120273392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls") pod "maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf" (UID: "98ff8d80-58b1-49cb-9d47-4396ebc12d97") : secret "maas-api-e2e-worker-w0-c5fdd3-serving-cert" not found
Sep 18 22:29:14.043007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.042985    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98ff8d80-58b1-49cb-9d47-4396ebc12d97-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.045150 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.045126    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-metrics-certs\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.051293 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.051240    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hppq\" (UniqueName: \"kubernetes.io/projected/98ff8d80-58b1-49cb-9d47-4396ebc12d97-kube-api-access-7hppq\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.404037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.403991    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:14.504916 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.504885    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:14.547370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.547313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.550232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.550202    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls\") pod \"maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.724320 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.724229    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:14.835405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.835370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:14.935799 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:14.935760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:15.012983 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.012925    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"]
Sep 18 22:29:15.015492 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:29:15.015454    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ff8d80_58b1_49cb_9d47_4396ebc12d97.slice/crio-9fe4a091106a31226279b153e7850c8c50eb75c3cae83d88ff728814dc78942a WatchSource:0}: Error finding container 9fe4a091106a31226279b153e7850c8c50eb75c3cae83d88ff728814dc78942a: Status 404 returned error can't find the container with id 9fe4a091106a31226279b153e7850c8c50eb75c3cae83d88ff728814dc78942a
Sep 18 22:29:15.090048 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.090008    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf" event={"ID":"98ff8d80-58b1-49cb-9d47-4396ebc12d97","Type":"ContainerStarted","Data":"9fe4a091106a31226279b153e7850c8c50eb75c3cae83d88ff728814dc78942a"}
Sep 18 22:29:15.264172 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.264089    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"]
Sep 18 22:29:15.269169 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.269145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.272571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.272514    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-917b58-openshift-default-dockercfg-85q6j\""
Sep 18 22:29:15.300117 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.300083    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"]
Sep 18 22:29:15.355880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.355844    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-certs\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.355890    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-envoy\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.355960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-socket\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.356002    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-podinfo\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.356041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-token\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.356058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr64d\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-kube-api-access-cr64d\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.356124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istiod-ca-cert\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.356172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-credential-socket\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.356355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.356248    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-data\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.378424 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.378396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:15.457755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.457722    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-certs\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.457929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.457792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-envoy\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.457929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.457844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-socket\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.457929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.457872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-podinfo\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.457929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.457918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-token\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.457942    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr64d\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-kube-api-access-cr64d\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istiod-ca-cert\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-credential-socket\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458122    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-certs\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-socket\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458440 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-data\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458519    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-credential-socket\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458660 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458580    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-data\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.458817 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.458802    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istiod-ca-cert\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.460458 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.460436    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-podinfo\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.460557 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.460542    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-envoy\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.468488 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.468464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-token\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.469738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.469718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr64d\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-kube-api-access-cr64d\") pod \"e2e-autores-917b58-openshift-default-5d787b6678-hl8zq\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") " pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.584680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.584616    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:15.652991 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.652960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:15.867924 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.867900    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"]
Sep 18 22:29:15.869131 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:29:15.869108    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be9eae5_f85a_4bfe_86d0_3b59d0c8e3ca.slice/crio-b3be9cc9df54d9d7b469d0746d7584484719c1b4e9109145a362b2495167f690 WatchSource:0}: Error finding container b3be9cc9df54d9d7b469d0746d7584484719c1b4e9109145a362b2495167f690: Status 404 returned error can't find the container with id b3be9cc9df54d9d7b469d0746d7584484719c1b4e9109145a362b2495167f690
Sep 18 22:29:15.871477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.871448    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:15.871540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.871508    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:15.871582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.871556    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:15.953326 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:15.953299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:16.055238 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.055206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:16.098909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.098870    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" event={"ID":"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca","Type":"ContainerStarted","Data":"2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161"}
Sep 18 22:29:16.099102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.098941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" event={"ID":"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca","Type":"ContainerStarted","Data":"b3be9cc9df54d9d7b469d0746d7584484719c1b4e9109145a362b2495167f690"}
Sep 18 22:29:16.100743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.100715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf" event={"ID":"98ff8d80-58b1-49cb-9d47-4396ebc12d97","Type":"ContainerStarted","Data":"0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679"}
Sep 18 22:29:16.100913 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.100826    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:16.128199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.128053    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podStartSLOduration=1.128031891 podStartE2EDuration="1.128031891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:29:16.12693785 +0000 UTC m=+746.704882997" watchObservedRunningTime="2026-09-18 22:29:16.128031891 +0000 UTC m=+746.705977039"
Sep 18 22:29:16.148743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.148694    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf" podStartSLOduration=2.773394223 podStartE2EDuration="3.148677331s" totalImagesPullingTime="375.283108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:29:16.146576759 +0000 UTC m=+746.724521904" watchObservedRunningTime="2026-09-18 22:29:16.148677331 +0000 UTC m=+746.726622505"
Sep 18 22:29:16.188720 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.188683    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:16.533500 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.533421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:16.585601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.585554    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:16.591644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.591615    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:16.684306 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:16.684276    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:17.037348 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:17.037299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:17.106983 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:17.106940    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:17.107897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:17.107879    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:18.124067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:18.124030    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:18.289214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:18.289174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:18.526440 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:18.526319    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:19.203931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:19.203862    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:20.184600 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.184566    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"]
Sep 18 22:29:20.192400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.192371    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.210365 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.210333    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-917b58-serving-cert\""
Sep 18 22:29:20.222022 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.221991    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"]
Sep 18 22:29:20.237287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.237260    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:20.310393 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.310356    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:20.335425 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.335384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-maas-api-tls\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.335818 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.335762    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-metrics-certs\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.335978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.335959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln5hm\" (UniqueName: \"kubernetes.io/projected/951b5f2b-947a-46a5-bc33-74b053d623c9-kube-api-access-ln5hm\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.336155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.336139    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b5f2b-947a-46a5-bc33-74b053d623c9-openshift-service-ca\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.434020 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.433991    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:20.437350 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.437279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-metrics-certs\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.437350 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.437333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln5hm\" (UniqueName: \"kubernetes.io/projected/951b5f2b-947a-46a5-bc33-74b053d623c9-kube-api-access-ln5hm\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.437523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.437381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b5f2b-947a-46a5-bc33-74b053d623c9-openshift-service-ca\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.437523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.437460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-maas-api-tls\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.438250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.438209    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b5f2b-947a-46a5-bc33-74b053d623c9-openshift-service-ca\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.439954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.439930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-metrics-certs\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.440194 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.440155    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-maas-api-tls\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.451655 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.451631    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln5hm\" (UniqueName: \"kubernetes.io/projected/951b5f2b-947a-46a5-bc33-74b053d623c9-kube-api-access-ln5hm\") pod \"maas-api-e2e-autores-917b58-985c54d6b-pzmtc\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.535250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.535214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:20.738909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.738709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:20.913808 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.907962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"]
Sep 18 22:29:20.987386 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:20.987348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:21.141161 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:21.141090    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc" event={"ID":"951b5f2b-947a-46a5-bc33-74b053d623c9","Type":"ContainerStarted","Data":"905253e0596abc806f9073d79ae3b81ab7a3f603231f2e3f9d6054b3df406323"}
Sep 18 22:29:21.334233 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:21.334200    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:22.119372 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:22.119335    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:29:22.147976 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:22.147940    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc" event={"ID":"951b5f2b-947a-46a5-bc33-74b053d623c9","Type":"ContainerStarted","Data":"a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8"}
Sep 18 22:29:22.148190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:22.148135    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:22.171265 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:22.171205    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc" podStartSLOduration=1.821745615 podStartE2EDuration="2.171185466s" totalImagesPullingTime="349.439851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:29:22.168584019 +0000 UTC m=+752.746529165" watchObservedRunningTime="2026-09-18 22:29:22.171185466 +0000 UTC m=+752.749130615"
Sep 18 22:29:22.305510 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:22.305451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:23.412896 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:23.412835    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:23.517611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:23.517578    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:24.619971 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:24.619928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:24.860595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:24.860538    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:25.310972 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:25.310912    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:25.411443 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:25.411406    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:25.795651 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:25.795607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:25.900727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:25.900661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:25.993339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:25.993282    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:26.342807 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:26.342739    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:26.445725 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:26.445695    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:27.076350 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:27.076320    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:27.181138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:27.181095    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:27.321164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:27.321130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:27.422169 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:27.422136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:27.518979 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:27.518948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:28.159089 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.159060    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:29:28.197319 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.197273    2570 generic.go:356] "Generic (PLEG): container finished" podID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerID="557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d" exitCode=0
Sep 18 22:29:28.197518 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.197465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" event={"ID":"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae","Type":"ContainerDied","Data":"557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d"}
Sep 18 22:29:28.198053 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.198023    2570 scope.go:117] "RemoveContainer" containerID="557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d"
Sep 18 22:29:28.201147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.201109    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:28.201328 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.201274    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:28.201391 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.201364    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:28.201816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.201767    2570 generic.go:356] "Generic (PLEG): container finished" podID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerID="321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b" exitCode=0
Sep 18 22:29:28.201916 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.201835    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" event={"ID":"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8","Type":"ContainerDied","Data":"321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b"}
Sep 18 22:29:28.202576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.202552    2570 scope.go:117] "RemoveContainer" containerID="321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b"
Sep 18 22:29:28.210802 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.210375    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:28.210802 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.210561    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:28.210802 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.210666    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:28.223260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.219406    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:28.911375 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:28.911345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:29.210913 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:29.210821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" event={"ID":"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae","Type":"ContainerStarted","Data":"89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c"}
Sep 18 22:29:29.212889 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:29.212861    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" event={"ID":"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8","Type":"ContainerStarted","Data":"c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c"}
Sep 18 22:29:29.855374 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:29.855313    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:29.953934 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:29.953899    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:29.955123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:29.955028    2570 patch_prober.go:28] interesting pod/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 18 22:29:29.955341 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:29.955314    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 18 22:29:29.961815 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:29.961741    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:30.066926 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.066891    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:30.134707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.134200    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:29:30.134707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.134284    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:29:30.134707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.134574    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:30.174314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.174281    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:30.312873 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.312834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:30.476655 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.476562    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:30.590463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.590410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:30.688271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.688221    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"]
Sep 18 22:29:30.693070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.693033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.700227 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.700199    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-44d735-openshift-default-dockercfg-zzbzw\""
Sep 18 22:29:30.714083 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.714048    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"]
Sep 18 22:29:30.793671 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.793612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:30.794389 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-data\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-envoy\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istiod-ca-cert\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794589    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-socket\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-podinfo\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-credential-socket\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794694    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdtdg\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-kube-api-access-tdtdg\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-token\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.794795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.794792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-certs\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-socket\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-podinfo\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896159    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-credential-socket\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896184    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdtdg\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-kube-api-access-tdtdg\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-token\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-certs\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-data\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-envoy\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.896399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istiod-ca-cert\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.897255    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istiod-ca-cert\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.897555    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-socket\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.898230    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-data\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.898457    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-certs\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.898681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-credential-socket\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.927499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.926709    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-envoy\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.928605 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.927231    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-podinfo\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.947698 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.947241    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-token\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:30.956536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.955213    2570 patch_prober.go:28] interesting pod/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 18 22:29:30.956536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.955279    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 18 22:29:30.956536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:30.956437    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdtdg\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-kube-api-access-tdtdg\") pod \"e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") " pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:31.037325 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.037176    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:31.050349 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.050018    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:31.135270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.134378    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:29:31.135270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.134436    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:29:31.135270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.135207    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:31.640112 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.640002    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"]
Sep 18 22:29:31.658134 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.658067    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:31.658285 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.658175    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:31.658285 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.658221    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:31.898888 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.898715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:31.953376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.952268    2570 patch_prober.go:28] interesting pod/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 18 22:29:31.953376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:31.952331    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 18 22:29:32.134096 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.134063    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:29:32.134405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.134352    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:29:32.242266 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.241192    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" event={"ID":"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a","Type":"ContainerStarted","Data":"eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca"}
Sep 18 22:29:32.242266 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.241258    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" event={"ID":"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a","Type":"ContainerStarted","Data":"537cb88fc8aab8a07df82eed3f3a9f65c28eb5d22afd94004c6db90b85b90e39"}
Sep 18 22:29:32.269569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.269504    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" podStartSLOduration=2.26947972 podStartE2EDuration="2.26947972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:29:32.266184334 +0000 UTC m=+762.844129479" watchObservedRunningTime="2026-09-18 22:29:32.26947972 +0000 UTC m=+762.847424866"
Sep 18 22:29:32.834959 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.834916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:32.939704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.939671    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:32.954212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.954171    2570 patch_prober.go:28] interesting pod/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 18 22:29:32.954477 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:32.954449    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 18 22:29:33.041806 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.041176    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:33.053269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.053042    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:33.066805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.063066    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:33.133538 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.133437    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:29:33.134177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.134143    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:29:33.251293 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.251225    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:33.256486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.256460    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:33.870355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.870273    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:33.952500 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.952465    2570 patch_prober.go:28] interesting pod/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 18 22:29:33.953209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:33.953170    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 18 22:29:34.134275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:34.133750    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:29:34.134275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:34.133834    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:29:34.470551 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:34.470420    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:34.571730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:34.571693    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:34.952463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:34.952423    2570 patch_prober.go:28] interesting pod/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 18 22:29:34.953076 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:34.953023    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 18 22:29:35.028151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:35.028079    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:35.134264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:35.134228    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 18 22:29:35.134582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:35.134532    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 18 22:29:35.271415 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:35.271275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:35.375286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:35.375208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:35.589217 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:35.589119    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:36.137268 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.137223    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:36.137737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.137686    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:36.138842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.138680    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:36.139146 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.139041    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:36.139146 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.139110    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:29:36.139997 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.139978    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:29:36.160114 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.160083    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:36.916551 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:36.916502    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:37.803052 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:37.803015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:38.740018 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:38.739914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:38.900318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:38.900275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:39.158269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.158240    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:39.302745 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.302715    2570 generic.go:356] "Generic (PLEG): container finished" podID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerID="2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161" exitCode=0
Sep 18 22:29:39.302919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.302813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" event={"ID":"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca","Type":"ContainerDied","Data":"2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161"}
Sep 18 22:29:39.303517 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.303498    2570 scope.go:117] "RemoveContainer" containerID="2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161"
Sep 18 22:29:39.305008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.304977    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:39.305139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.305056    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:39.305139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.305103    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:39.469337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.469244    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:39.564149 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:39.564094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:40.015874 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.011074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:40.062294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.062248    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:40.063281 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.062321    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:40.310031 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.309942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" event={"ID":"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca","Type":"ContainerStarted","Data":"044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506"}
Sep 18 22:29:40.311632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.311606    2570 generic.go:356] "Generic (PLEG): container finished" podID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerID="83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea" exitCode=0
Sep 18 22:29:40.311750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.311642    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" event={"ID":"a3db8e9e-a3b4-4965-a710-4166daa84f76","Type":"ContainerDied","Data":"83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea"}
Sep 18 22:29:40.312006 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.311994    2570 scope.go:117] "RemoveContainer" containerID="83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea"
Sep 18 22:29:40.313087 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.313057    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:40.313233 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.313123    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:40.313233 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.313151    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:40.585740 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.585701    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:40.585973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.585839    2570 patch_prober.go:28] interesting pod/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:29:40.585973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.585883    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:29:40.758755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:40.758724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:41.319858 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:41.319821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" event={"ID":"a3db8e9e-a3b4-4965-a710-4166daa84f76","Type":"ContainerStarted","Data":"a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5"}
Sep 18 22:29:41.451097 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:41.451062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:41.585083 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:41.585031    2570 patch_prober.go:28] interesting pod/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:29:41.585280 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:41.585120    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:29:41.908111 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:41.908008    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:42.008020 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.007979    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:42.052055 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.052020    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:42.052847 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.052826    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:42.052922 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.052875    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:42.106481 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.106423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:42.258535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.258447    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:42.441131 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.441095    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:42.585107 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.585062    2570 patch_prober.go:28] interesting pod/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:29:42.585318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:42.585138    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:29:43.052261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:43.052167    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:43.052261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:43.052228    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:43.147385 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:43.147347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:43.587282 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:43.587239    2570 patch_prober.go:28] interesting pod/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:29:43.587797 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:43.587313    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:29:44.053110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:44.053014    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:44.053110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:44.053097    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:44.205467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:44.205417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:44.585177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:44.585140    2570 patch_prober.go:28] interesting pod/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:29:44.585500 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:44.585467    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:29:44.929874 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:44.929758    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:45.053041 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:45.053003    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:45.053221 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:45.053061    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:45.585884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:45.585845    2570 patch_prober.go:28] interesting pod/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 18 22:29:45.586170 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:45.586142    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 18 22:29:45.623264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:45.623217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:46.052810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:46.052695    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:46.052810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:46.052772    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:46.538314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:46.538278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:46.600351 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:46.600259    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:46.601319 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:46.601290    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:46.603589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:46.603560    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:29:47.052666 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:47.052632    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 18 22:29:47.052872 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:47.052689    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 18 22:29:47.326675 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:47.326592    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:48.057035 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:48.057004    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:48.057439 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:48.057311    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:48.058091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:48.058075    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:29:48.162832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:48.162799    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:48.986286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:48.986255    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:49.946882 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:49.946852    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:50.042436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:50.042387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:51.709924 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:51.709885    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:52.457743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:52.457711    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:53.288278 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:53.288235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:54.028660 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:54.028620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:54.127991 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:54.127953    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:54.778687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:54.778635    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:55.492266 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:55.492229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:55.561405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:55.561358    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:55.630294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:55.630259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:55.731889 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:55.731858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:55.813686 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:55.813569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:55.896176 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:55.896134    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:55.966231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:55.966205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:56.383558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:56.383522    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:56.470685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:56.470645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:56.572042 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:56.572005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:56.929088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:56.929058    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:57.101283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.101248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:57.196442 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.196354    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:57.358307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.358272    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:57.437806 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.437753    2570 generic.go:356] "Generic (PLEG): container finished" podID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerID="eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca" exitCode=0
Sep 18 22:29:57.437975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.437817    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" event={"ID":"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a","Type":"ContainerDied","Data":"eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca"}
Sep 18 22:29:57.438263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.438249    2570 scope.go:117] "RemoveContainer" containerID="eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca"
Sep 18 22:29:57.439453 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.439426    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:57.439537 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.439500    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:57.439537 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.439532    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:29:57.994762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:57.994673    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:58.445795 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:58.445746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" event={"ID":"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a","Type":"ContainerStarted","Data":"40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48"}
Sep 18 22:29:58.904199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:58.904150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:59.051089 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:59.051059    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:29:59.051971 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:59.051948    2570 patch_prober.go:28] interesting pod/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:29:59.052037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:59.052010    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:29:59.639029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:59.638989    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:59.739016 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:59.738986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:29:59.840951 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:29:59.840914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:00.051164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.051080    2570 patch_prober.go:28] interesting pod/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:30:00.051164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.051148    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:30:00.194329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.194294    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"]
Sep 18 22:30:00.204374 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.204344    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"
Sep 18 22:30:00.204666 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.204635    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"]
Sep 18 22:30:00.212335 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.210411    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8dgjh\""
Sep 18 22:30:00.241832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.241315    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"
Sep 18 22:30:00.545569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.545547    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"]
Sep 18 22:30:00.547901 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:30:00.547872    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd652c4e8_1a9d_4593_b4c2_75ee5c9a4bc1.slice/crio-d61b0c7b8e550581d7237b3d1a970ed3245caa17245883fcee1cec9885b05401 WatchSource:0}: Error finding container d61b0c7b8e550581d7237b3d1a970ed3245caa17245883fcee1cec9885b05401: Status 404 returned error can't find the container with id d61b0c7b8e550581d7237b3d1a970ed3245caa17245883fcee1cec9885b05401
Sep 18 22:30:00.757148 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:00.757120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:01.051765 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:01.051681    2570 patch_prober.go:28] interesting pod/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:30:01.051765 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:01.051742    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:30:01.465701 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:01.465667    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx" event={"ID":"d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1","Type":"ContainerStarted","Data":"d61b0c7b8e550581d7237b3d1a970ed3245caa17245883fcee1cec9885b05401"}
Sep 18 22:30:01.600315 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:01.600272    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:02.050741 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:02.050708    2570 patch_prober.go:28] interesting pod/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:30:02.050929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:02.050771    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:30:02.623850 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:02.623704    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:02.721437 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:02.721406    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:03.051048 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:03.050976    2570 patch_prober.go:28] interesting pod/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 18 22:30:03.051048 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:03.051029    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 18 22:30:03.230426 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:03.230391    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:03.251849 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:03.251718    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:30:03.327842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:03.327812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:03.413151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:03.413121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:03.735358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:03.735316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:04.055052 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:04.054977    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:30:04.056092 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:04.056070    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:30:04.497997 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:04.497962    2570 generic.go:356] "Generic (PLEG): container finished" podID="d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1" containerID="b10d2a418a93b6fd9d23a3cde9e603fbe30186012d65c4f0ea216423ab9596fe" exitCode=0
Sep 18 22:30:04.498199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:04.498055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx" event={"ID":"d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1","Type":"ContainerDied","Data":"b10d2a418a93b6fd9d23a3cde9e603fbe30186012d65c4f0ea216423ab9596fe"}
Sep 18 22:30:04.726716 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:04.726687    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:05.437870 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:05.437840    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:05.653501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:05.653472    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"
Sep 18 22:30:06.324251 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:06.324216    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:06.514038 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:06.514007    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"
Sep 18 22:30:06.514416 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:06.514048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx" event={"ID":"d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1","Type":"ContainerDied","Data":"d61b0c7b8e550581d7237b3d1a970ed3245caa17245883fcee1cec9885b05401"}
Sep 18 22:30:06.514416 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:06.514093    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d61b0c7b8e550581d7237b3d1a970ed3245caa17245883fcee1cec9885b05401"
Sep 18 22:30:07.035336 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:07.035305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:27.410406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:27.410372    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:28.171278 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:28.171242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:28.845875 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:28.845835    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:29.631468 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:29.631437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:30.399851 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:30.399822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:30.536820 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:30.536772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:31.365438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:31.365404    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:32.035468 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:32.035403    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:32.718604 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:32.718568    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:33.476450 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:33.476414    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:34.373531 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:34.373477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:35.302469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:35.302441    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:40.164432 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:40.164395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:40.764915 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:40.764884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:40.865810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:40.865767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:40.946999 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:40.946965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:41.013401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:41.013368    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:41.104228 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:41.104198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:41.377578 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:41.377504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:41.580108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:41.580069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:41.884412 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:41.884377    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:42.217744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:42.217662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:42.358476 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:42.358444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:43.175037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:43.175002    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:44.049890 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:44.049853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:44.682216 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:44.682180    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:44.782553 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:44.782512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:45.094447 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:45.094421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:45.978567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:45.978536    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:46.815269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:46.815241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:46.922100 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:46.922069    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:47.122826 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:47.122772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:47.369867 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:47.369832    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:47.465755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:47.465671    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:47.903949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:47.903922    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:48.144662 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.144632    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"]
Sep 18 22:30:48.145094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.145080    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1" containerName="cleanup"
Sep 18 22:30:48.145094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.145094    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1" containerName="cleanup"
Sep 18 22:30:48.145178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.145169    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1" containerName="cleanup"
Sep 18 22:30:48.148394 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.148378    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.151796 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.151761    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-917b58\"/\"kube-root-ca.crt\""
Sep 18 22:30:48.151796 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.151762    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-917b58\"/\"default-dockercfg-hfbzs\""
Sep 18 22:30:48.151968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.151807    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-917b58\"/\"autores-model-917b58-kserve-self-signed-certs\""
Sep 18 22:30:48.151968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.151829    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-917b58\"/\"openshift-service-ca.crt\""
Sep 18 22:30:48.161290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.161259    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"]
Sep 18 22:30:48.172657 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.172626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-dshm\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.172814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.172662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-model-cache\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.172814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.172705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-home\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.172814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.172723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cn9p\" (UniqueName: \"kubernetes.io/projected/88d32bf1-2211-4805-9e93-a5c78cac413d-kube-api-access-9cn9p\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.172988 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.172859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d32bf1-2211-4805-9e93-a5c78cac413d-tls-certs\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.172988 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.172947    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-tmp-dir\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274039 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-dshm\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274039 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-model-cache\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-home\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cn9p\" (UniqueName: \"kubernetes.io/projected/88d32bf1-2211-4805-9e93-a5c78cac413d-kube-api-access-9cn9p\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d32bf1-2211-4805-9e93-a5c78cac413d-tls-certs\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274393 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274346    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-model-cache\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-tmp-dir\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274500 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274480    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-home\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.274716 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.274693    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-tmp-dir\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.276481 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.276454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-dshm\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.276920 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.276900    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d32bf1-2211-4805-9e93-a5c78cac413d-tls-certs\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.282298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.282274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cn9p\" (UniqueName: \"kubernetes.io/projected/88d32bf1-2211-4805-9e93-a5c78cac413d-kube-api-access-9cn9p\") pod \"autores-model-917b58-kserve-5dffd84dc5-8jvb4\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") " pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.331793 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.331735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:48.466863 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.466742    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:48.800671 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.800641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"]
Sep 18 22:30:48.802342 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:30:48.802318    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88d32bf1_2211_4805_9e93_a5c78cac413d.slice/crio-e40b74cc98294d6d0123629737806f57c30549f934c0606df0845409b055d9f1 WatchSource:0}: Error finding container e40b74cc98294d6d0123629737806f57c30549f934c0606df0845409b055d9f1: Status 404 returned error can't find the container with id e40b74cc98294d6d0123629737806f57c30549f934c0606df0845409b055d9f1
Sep 18 22:30:48.817379 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:48.817312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:49.694678 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:49.694641    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:49.757451 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:49.757410    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4" event={"ID":"88d32bf1-2211-4805-9e93-a5c78cac413d","Type":"ContainerStarted","Data":"489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480"}
Sep 18 22:30:49.757451 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:49.757452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4" event={"ID":"88d32bf1-2211-4805-9e93-a5c78cac413d","Type":"ContainerStarted","Data":"e40b74cc98294d6d0123629737806f57c30549f934c0606df0845409b055d9f1"}
Sep 18 22:30:49.790924 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:49.790873    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4" podStartSLOduration=1.790855089 podStartE2EDuration="1.790855089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:49.790023478 +0000 UTC m=+840.367968622" watchObservedRunningTime="2026-09-18 22:30:49.790855089 +0000 UTC m=+840.368800234"
Sep 18 22:30:50.595448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:50.595413    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:30:58.467863 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:58.467815    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:58.468331 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:58.467887    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:58.482107 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:58.482071    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:30:58.824323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:30:58.824229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:31:03.608434 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:03.608394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:11.551835 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.551801    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"]
Sep 18 22:31:11.555384 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.555360    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.557895 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.557874    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-eac715\"/\"openshift-service-ca.crt\""
Sep 18 22:31:11.558640 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.558621    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-eac715\"/\"test-model-eac715-kserve-self-signed-certs\""
Sep 18 22:31:11.558732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.558632    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-eac715\"/\"kube-root-ca.crt\""
Sep 18 22:31:11.558732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.558689    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-eac715\"/\"default-dockercfg-ktvvb\""
Sep 18 22:31:11.564742 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.564692    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"]
Sep 18 22:31:11.570427 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.570397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:11.729130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.729099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-dshm\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.729312 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.729218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a002316-ea75-4dc2-b0f0-93533ec4f226-tls-certs\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.729312 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.729260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5p8g\" (UniqueName: \"kubernetes.io/projected/1a002316-ea75-4dc2-b0f0-93533ec4f226-kube-api-access-c5p8g\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.729312 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.729289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-home\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.729433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.729359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-tmp-dir\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.729433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.729395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-model-cache\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.830707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.830629    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a002316-ea75-4dc2-b0f0-93533ec4f226-tls-certs\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.830707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.830683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5p8g\" (UniqueName: \"kubernetes.io/projected/1a002316-ea75-4dc2-b0f0-93533ec4f226-kube-api-access-c5p8g\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.830929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.830743    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-home\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.830929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.830811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-tmp-dir\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.830929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.830847    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-model-cache\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.830929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.830898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-dshm\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.831229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.831199    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-home\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.831368 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.831256    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-tmp-dir\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.831368 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.831271    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-model-cache\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.833325 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.833303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-dshm\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.833617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.833595    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a002316-ea75-4dc2-b0f0-93533ec4f226-tls-certs\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.838494 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.838471    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5p8g\" (UniqueName: \"kubernetes.io/projected/1a002316-ea75-4dc2-b0f0-93533ec4f226-kube-api-access-c5p8g\") pod \"test-model-eac715-kserve-7c7877fb65-vwvbr\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") " pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:11.866139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:11.866119    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:12.162241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:12.162215    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"]
Sep 18 22:31:12.164071 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:31:12.164048    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a002316_ea75_4dc2_b0f0_93533ec4f226.slice/crio-2612e127e3ce670a39b6d0dbf5ad4dc543fe2384b4a7086f78a234ad664f67c2 WatchSource:0}: Error finding container 2612e127e3ce670a39b6d0dbf5ad4dc543fe2384b4a7086f78a234ad664f67c2: Status 404 returned error can't find the container with id 2612e127e3ce670a39b6d0dbf5ad4dc543fe2384b4a7086f78a234ad664f67c2
Sep 18 22:31:12.713311 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:12.713267    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:12.891444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:12.891411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr" event={"ID":"1a002316-ea75-4dc2-b0f0-93533ec4f226","Type":"ContainerStarted","Data":"ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965"}
Sep 18 22:31:12.891444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:12.891457    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr" event={"ID":"1a002316-ea75-4dc2-b0f0-93533ec4f226","Type":"ContainerStarted","Data":"2612e127e3ce670a39b6d0dbf5ad4dc543fe2384b4a7086f78a234ad664f67c2"}
Sep 18 22:31:12.920741 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:12.920684    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr" podStartSLOduration=1.920662937 podStartE2EDuration="1.920662937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:31:12.918445394 +0000 UTC m=+863.496390540" watchObservedRunningTime="2026-09-18 22:31:12.920662937 +0000 UTC m=+863.498608084"
Sep 18 22:31:13.491337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:13.491307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:14.260499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:14.260444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:14.936467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:14.936426    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:16.063744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:16.063707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:16.882864 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:16.882834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:17.615632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:17.615600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:18.419008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:18.418959    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:19.160141 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:19.160104    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:20.038147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:20.038107    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:20.766694 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:20.766661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:21.719247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:21.719210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:21.867036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:21.867000    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:21.867494 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:21.867060    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:21.879687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:21.879659    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:21.955294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:21.955262    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:31:22.606852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:22.606825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:23.294615 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:23.294579    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:24.190561 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:24.190529    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:24.886739 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:24.886709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:25.780176 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:25.780147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:26.616487 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:26.616458    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:27.191752 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:27.191708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:27.264871 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:27.264844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:27.363594 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:27.363543    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:27.431436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:27.431408    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:27.787070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:27.787033    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:28.514515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:28.514481    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:28.636495 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:28.633278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:28.995653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:28.995612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:29.306199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:29.306118    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:29.513390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:29.513360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:29.706958 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:29.706926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:30.336862 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:30.336831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:31.319454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:31.319420    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:31.978731 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:31.978700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:32.076884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:32.076848    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:32.177169 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:32.177135    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:32.916708 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:32.916634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:33.935513 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:33.935476    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:34.395372 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:34.395336    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:34.621605 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:34.621576    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:35.390215 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:35.390178    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.024689 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.024653    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"]
Sep 18 22:31:36.025948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.025914    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc" podUID="951b5f2b-947a-46a5-bc33-74b053d623c9" containerName="maas-api" containerID="cri-o://a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8" gracePeriod=30
Sep 18 22:31:36.056675 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.056638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.154745 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.154678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.256162 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.256126    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.308627 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.308471    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:31:36.357755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.357725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.399135 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.399104    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-maas-api-tls\") pod \"951b5f2b-947a-46a5-bc33-74b053d623c9\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") "
Sep 18 22:31:36.399690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.399198    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln5hm\" (UniqueName: \"kubernetes.io/projected/951b5f2b-947a-46a5-bc33-74b053d623c9-kube-api-access-ln5hm\") pod \"951b5f2b-947a-46a5-bc33-74b053d623c9\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") "
Sep 18 22:31:36.399690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.399236    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b5f2b-947a-46a5-bc33-74b053d623c9-openshift-service-ca\") pod \"951b5f2b-947a-46a5-bc33-74b053d623c9\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") "
Sep 18 22:31:36.399690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.399354    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-metrics-certs\") pod \"951b5f2b-947a-46a5-bc33-74b053d623c9\" (UID: \"951b5f2b-947a-46a5-bc33-74b053d623c9\") "
Sep 18 22:31:36.399975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.399845    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/951b5f2b-947a-46a5-bc33-74b053d623c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "951b5f2b-947a-46a5-bc33-74b053d623c9" (UID: "951b5f2b-947a-46a5-bc33-74b053d623c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:31:36.402435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.402389    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "951b5f2b-947a-46a5-bc33-74b053d623c9" (UID: "951b5f2b-947a-46a5-bc33-74b053d623c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:31:36.402697 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.402660    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "951b5f2b-947a-46a5-bc33-74b053d623c9" (UID: "951b5f2b-947a-46a5-bc33-74b053d623c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:31:36.404002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.403966    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951b5f2b-947a-46a5-bc33-74b053d623c9-kube-api-access-ln5hm" (OuterVolumeSpecName: "kube-api-access-ln5hm") pod "951b5f2b-947a-46a5-bc33-74b053d623c9" (UID: "951b5f2b-947a-46a5-bc33-74b053d623c9"). InnerVolumeSpecName "kube-api-access-ln5hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:31:36.462188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.462151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.500322 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.500287    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:36.500322 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.500314    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/951b5f2b-947a-46a5-bc33-74b053d623c9-maas-api-tls\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:36.500322 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.500327    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln5hm\" (UniqueName: \"kubernetes.io/projected/951b5f2b-947a-46a5-bc33-74b053d623c9-kube-api-access-ln5hm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:36.500588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.500341    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/951b5f2b-947a-46a5-bc33-74b053d623c9-openshift-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:36.565311 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.565225    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.793065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.793033    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:36.928346 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:36.928314    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:37.032739 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.032709    2570 generic.go:356] "Generic (PLEG): container finished" podID="951b5f2b-947a-46a5-bc33-74b053d623c9" containerID="a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8" exitCode=0
Sep 18 22:31:37.032931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.032773    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"
Sep 18 22:31:37.032931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.032812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc" event={"ID":"951b5f2b-947a-46a5-bc33-74b053d623c9","Type":"ContainerDied","Data":"a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8"}
Sep 18 22:31:37.032931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.032897    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc" event={"ID":"951b5f2b-947a-46a5-bc33-74b053d623c9","Type":"ContainerDied","Data":"905253e0596abc806f9073d79ae3b81ab7a3f603231f2e3f9d6054b3df406323"}
Sep 18 22:31:37.032931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.032922    2570 scope.go:117] "RemoveContainer" containerID="a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8"
Sep 18 22:31:37.044586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.044504    2570 scope.go:117] "RemoveContainer" containerID="a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8"
Sep 18 22:31:37.044983 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:31:37.044963    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8\": container with ID starting with a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8 not found: ID does not exist" containerID="a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8"
Sep 18 22:31:37.045068 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.044991    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8"} err="failed to get container status \"a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8\": rpc error: code = NotFound desc = could not find container \"a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8\": container with ID starting with a9fd8da5a21f0dfa3025f674f04f27e849757cc212a82c15aa54167bc8cd7be8 not found: ID does not exist"
Sep 18 22:31:37.059213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.059188    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"]
Sep 18 22:31:37.062971 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.062939    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-917b58-985c54d6b-pzmtc"]
Sep 18 22:31:37.191738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.191638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:37.292029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.292000    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:37.404588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.404555    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951b5f2b-947a-46a5-bc33-74b053d623c9" path="/var/lib/kubelet/pods/951b5f2b-947a-46a5-bc33-74b053d623c9/volumes"
Sep 18 22:31:37.598875 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:37.598845    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:38.617478 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:38.617436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:39.474677 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:39.474647    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:40.416813 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:40.416758    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:41.236146 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:41.236117    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:41.707546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:41.707512    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"]
Sep 18 22:31:41.802696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:41.802666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:41.940834 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:41.940768    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:31:51.384452 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:51.384414    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:31:51.385527 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:51.385508    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:31:56.727768 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:56.727718    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4" podUID="88d32bf1-2211-4805-9e93-a5c78cac413d" containerName="main" containerID="cri-o://489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480" gracePeriod=45
Sep 18 22:31:56.997088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:56.997029    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:31:57.018624 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.018598    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-model-cache\") pod \"88d32bf1-2211-4805-9e93-a5c78cac413d\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") "
Sep 18 22:31:57.018952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.018909    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d32bf1-2211-4805-9e93-a5c78cac413d-tls-certs\") pod \"88d32bf1-2211-4805-9e93-a5c78cac413d\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") "
Sep 18 22:31:57.019098 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.019085    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-tmp-dir\") pod \"88d32bf1-2211-4805-9e93-a5c78cac413d\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") "
Sep 18 22:31:57.019221 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.019210    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-dshm\") pod \"88d32bf1-2211-4805-9e93-a5c78cac413d\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") "
Sep 18 22:31:57.019314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.019303    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cn9p\" (UniqueName: \"kubernetes.io/projected/88d32bf1-2211-4805-9e93-a5c78cac413d-kube-api-access-9cn9p\") pod \"88d32bf1-2211-4805-9e93-a5c78cac413d\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") "
Sep 18 22:31:57.019415 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.019405    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-home\") pod \"88d32bf1-2211-4805-9e93-a5c78cac413d\" (UID: \"88d32bf1-2211-4805-9e93-a5c78cac413d\") "
Sep 18 22:31:57.020073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.020038    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-model-cache" (OuterVolumeSpecName: "model-cache") pod "88d32bf1-2211-4805-9e93-a5c78cac413d" (UID: "88d32bf1-2211-4805-9e93-a5c78cac413d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:31:57.020621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.020599    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-home" (OuterVolumeSpecName: "home") pod "88d32bf1-2211-4805-9e93-a5c78cac413d" (UID: "88d32bf1-2211-4805-9e93-a5c78cac413d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:31:57.020944 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.020924    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88d32bf1-2211-4805-9e93-a5c78cac413d" (UID: "88d32bf1-2211-4805-9e93-a5c78cac413d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:31:57.023589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.023561    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-dshm" (OuterVolumeSpecName: "dshm") pod "88d32bf1-2211-4805-9e93-a5c78cac413d" (UID: "88d32bf1-2211-4805-9e93-a5c78cac413d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:31:57.024251 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.024163    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d32bf1-2211-4805-9e93-a5c78cac413d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88d32bf1-2211-4805-9e93-a5c78cac413d" (UID: "88d32bf1-2211-4805-9e93-a5c78cac413d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:31:57.024251 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.024160    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d32bf1-2211-4805-9e93-a5c78cac413d-kube-api-access-9cn9p" (OuterVolumeSpecName: "kube-api-access-9cn9p") pod "88d32bf1-2211-4805-9e93-a5c78cac413d" (UID: "88d32bf1-2211-4805-9e93-a5c78cac413d"). InnerVolumeSpecName "kube-api-access-9cn9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:31:57.121571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.121458    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88d32bf1-2211-4805-9e93-a5c78cac413d-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:57.121571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.121494    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:57.121571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.121507    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:57.121571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.121520    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cn9p\" (UniqueName: \"kubernetes.io/projected/88d32bf1-2211-4805-9e93-a5c78cac413d-kube-api-access-9cn9p\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:57.121571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.121533    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:57.121571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.121546    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88d32bf1-2211-4805-9e93-a5c78cac413d-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:31:57.146103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.146068    2570 generic.go:356] "Generic (PLEG): container finished" podID="88d32bf1-2211-4805-9e93-a5c78cac413d" containerID="489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480" exitCode=0
Sep 18 22:31:57.146244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.146119    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"
Sep 18 22:31:57.146244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.146155    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4" event={"ID":"88d32bf1-2211-4805-9e93-a5c78cac413d","Type":"ContainerDied","Data":"489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480"}
Sep 18 22:31:57.146244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.146198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4" event={"ID":"88d32bf1-2211-4805-9e93-a5c78cac413d","Type":"ContainerDied","Data":"e40b74cc98294d6d0123629737806f57c30549f934c0606df0845409b055d9f1"}
Sep 18 22:31:57.146244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.146219    2570 scope.go:117] "RemoveContainer" containerID="489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480"
Sep 18 22:31:57.155984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.155962    2570 scope.go:117] "RemoveContainer" containerID="489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480"
Sep 18 22:31:57.156226 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:31:57.156209    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480\": container with ID starting with 489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480 not found: ID does not exist" containerID="489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480"
Sep 18 22:31:57.156283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.156236    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480"} err="failed to get container status \"489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480\": rpc error: code = NotFound desc = could not find container \"489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480\": container with ID starting with 489109286f4d77226ecdbce4bd7f86f1777daa7b6124f6c03782dd3428735480 not found: ID does not exist"
Sep 18 22:31:57.167361 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.167337    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"]
Sep 18 22:31:57.169925 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.169907    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-917b58/autores-model-917b58-kserve-5dffd84dc5-8jvb4"]
Sep 18 22:31:57.404233 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:31:57.404202    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d32bf1-2211-4805-9e93-a5c78cac413d" path="/var/lib/kubelet/pods/88d32bf1-2211-4805-9e93-a5c78cac413d/volumes"
Sep 18 22:32:00.271636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:00.271602    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:03.961719 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:03.961691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:04.800696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:04.800650    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:05.500019 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:05.499966    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:06.440672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:06.440642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:07.264680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:07.264649    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:08.128136 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:08.128105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:08.830746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:08.830695    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:09.705239 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:09.705209    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:10.569215 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:10.569179    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:11.493869 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:11.493825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:12.168986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:12.168957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:15.342498 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:15.342451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:17.190574 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:17.190541    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:17.823116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:17.823084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:17.891848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:17.891819    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:17.989330 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:17.989291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:18.074318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:18.074223    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:18.167589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:18.167542    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:18.452742 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:18.452711    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:18.814559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:18.814485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:18.908046 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:18.908017    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:19.056254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:19.056210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:19.621737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:19.621706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:20.407866 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:20.407835    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:20.508352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:20.508318    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:21.034007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:21.033963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:21.260515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:21.260482    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:21.269550 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:21.269521    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"]
Sep 18 22:32:21.269806 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:21.269762    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy" containerID="cri-o://044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506" gracePeriod=30
Sep 18 22:32:21.363185 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:21.363065    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:21.775228 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:21.775098    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:22.161070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:22.161035    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:22.371958 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:22.371926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:22.485546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:22.485452    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:24.666464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:24.666433    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:24.944275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:24.944188    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:25.038353 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:25.038316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:25.526387 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:25.526347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:26.531151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.531090    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:32:26.636889 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.636856    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-socket\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.636889 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.636892    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-podinfo\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.636921    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-envoy\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.636945    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr64d\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-kube-api-access-cr64d\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.636979    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-data\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637089    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-credential-socket\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637115    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-certs\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637165    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-token\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:32:26.637329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637199    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istiod-ca-cert\") pod \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\" (UID: \"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca\") "
Sep 18 22:32:26.637555 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637409    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:32:26.637555 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637534    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:32:26.637657 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637601    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:32:26.637714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637680    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.637714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637690    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:32:26.637714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.637700    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.639822 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.639802    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:32:26.639937 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.639834    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-kube-api-access-cr64d" (OuterVolumeSpecName: "kube-api-access-cr64d") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "kube-api-access-cr64d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:32:26.640001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.639945    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:32:26.640001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.639947    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" (UID: "9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:32:26.724818 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.724767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:26.739239 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.739204    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.739239 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.739234    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.739438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.739247    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.739438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.739258    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.739438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.739270    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.739438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.739281    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:26.739438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:26.739291    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr64d\" (UniqueName: \"kubernetes.io/projected/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca-kube-api-access-cr64d\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:32:27.328131 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.326635    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"
Sep 18 22:32:27.328651 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.326533    2570 generic.go:356] "Generic (PLEG): container finished" podID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerID="044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506" exitCode=0
Sep 18 22:32:27.328773 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.328714    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" event={"ID":"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca","Type":"ContainerDied","Data":"044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506"}
Sep 18 22:32:27.328865 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.328799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq" event={"ID":"9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca","Type":"ContainerDied","Data":"b3be9cc9df54d9d7b469d0746d7584484719c1b4e9109145a362b2495167f690"}
Sep 18 22:32:27.328865 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.328830    2570 scope.go:117] "RemoveContainer" containerID="044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506"
Sep 18 22:32:27.338760 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.338741    2570 scope.go:117] "RemoveContainer" containerID="2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161"
Sep 18 22:32:27.347294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.347278    2570 scope.go:117] "RemoveContainer" containerID="044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506"
Sep 18 22:32:27.347541 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:32:27.347522    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506\": container with ID starting with 044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506 not found: ID does not exist" containerID="044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506"
Sep 18 22:32:27.347590 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.347548    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506"} err="failed to get container status \"044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506\": rpc error: code = NotFound desc = could not find container \"044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506\": container with ID starting with 044b92c34eac6e181310d894ae1a68e5b8565b856b0edc7a56af026b33658506 not found: ID does not exist"
Sep 18 22:32:27.347590 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.347564    2570 scope.go:117] "RemoveContainer" containerID="2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161"
Sep 18 22:32:27.347770 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:32:27.347757    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161\": container with ID starting with 2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161 not found: ID does not exist" containerID="2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161"
Sep 18 22:32:27.347839 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.347773    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161"} err="failed to get container status \"2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161\": rpc error: code = NotFound desc = could not find container \"2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161\": container with ID starting with 2c78d42942a40f50366ed87d77a0903608f331e979fc164cd08b567dff35f161 not found: ID does not exist"
Sep 18 22:32:27.355829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.355805    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"]
Sep 18 22:32:27.360150 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.360127    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq"]
Sep 18 22:32:27.405117 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.405092    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" path="/var/lib/kubelet/pods/9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca/volumes"
Sep 18 22:32:27.869382 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:27.869346    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:28.187206 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:28.187122    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:28.295893 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:28.295840    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:28.457284 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:28.457203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:28.666862 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:28.666805    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:29.040718 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:29.040684    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:29.168242 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:29.168153    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:29.274313 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:29.274280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:29.725601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:29.725570    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:29.825342 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:29.825309    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:31.477147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:31.477110    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:48.142456 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.142421    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"]
Sep 18 22:32:48.143128 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143107    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951b5f2b-947a-46a5-bc33-74b053d623c9" containerName="maas-api"
Sep 18 22:32:48.143195 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143134    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="951b5f2b-947a-46a5-bc33-74b053d623c9" containerName="maas-api"
Sep 18 22:32:48.143232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143194    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy"
Sep 18 22:32:48.143232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143204    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy"
Sep 18 22:32:48.143232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143215    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d32bf1-2211-4805-9e93-a5c78cac413d" containerName="main"
Sep 18 22:32:48.143232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143223    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d32bf1-2211-4805-9e93-a5c78cac413d" containerName="main"
Sep 18 22:32:48.143355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143240    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy"
Sep 18 22:32:48.143355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143249    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy"
Sep 18 22:32:48.143355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143349    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy"
Sep 18 22:32:48.143446 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143361    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9be9eae5-f85a-4bfe-86d0-3b59d0c8e3ca" containerName="istio-proxy"
Sep 18 22:32:48.143446 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143370    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="951b5f2b-947a-46a5-bc33-74b053d623c9" containerName="maas-api"
Sep 18 22:32:48.143446 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.143385    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d32bf1-2211-4805-9e93-a5c78cac413d" containerName="main"
Sep 18 22:32:48.147061 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.147042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.149504 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.149472    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"default-dockercfg-qlm4m\""
Sep 18 22:32:48.150600 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.150576    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"openshift-service-ca.crt\""
Sep 18 22:32:48.150717 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.150648    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"premium-w4-f9cf33-kserve-self-signed-certs\""
Sep 18 22:32:48.151094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.151073    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"kube-root-ca.crt\""
Sep 18 22:32:48.155471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.155447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"]
Sep 18 22:32:48.177635 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.177608    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:48.261361 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.261326    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-home\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.261637 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.261614    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-tmp-dir\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.261814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.261772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-dshm\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.261967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.261949    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt9dl\" (UniqueName: \"kubernetes.io/projected/df4ed59c-4fbb-4314-a64c-1af779b631ce-kube-api-access-rt9dl\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.262077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.262062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df4ed59c-4fbb-4314-a64c-1af779b631ce-tls-certs\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.262204 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.262189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-model-cache\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.363866 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.363829    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-home\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.363903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-tmp-dir\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.363939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-dshm\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.363981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt9dl\" (UniqueName: \"kubernetes.io/projected/df4ed59c-4fbb-4314-a64c-1af779b631ce-kube-api-access-rt9dl\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.364006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df4ed59c-4fbb-4314-a64c-1af779b631ce-tls-certs\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.364052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-model-cache\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364357 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.364313    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-home\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364357 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.364347    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-tmp-dir\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.364473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.364454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-model-cache\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.366385 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.366361    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-dshm\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.366626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.366607    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df4ed59c-4fbb-4314-a64c-1af779b631ce-tls-certs\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.372696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.372673    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt9dl\" (UniqueName: \"kubernetes.io/projected/df4ed59c-4fbb-4314-a64c-1af779b631ce-kube-api-access-rt9dl\") pod \"premium-w4-f9cf33-kserve-5b6c7648f8-htzxc\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") " pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.459760 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.459668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:48.735349 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:48.735320    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"]
Sep 18 22:32:48.739739 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:32:48.739711    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf4ed59c_4fbb_4314_a64c_1af779b631ce.slice/crio-6ce0dc9e7ea39b13742c1f770af9f9b8b0f45c776ac5f6d7d4e33763544a58cc WatchSource:0}: Error finding container 6ce0dc9e7ea39b13742c1f770af9f9b8b0f45c776ac5f6d7d4e33763544a58cc: Status 404 returned error can't find the container with id 6ce0dc9e7ea39b13742c1f770af9f9b8b0f45c776ac5f6d7d4e33763544a58cc
Sep 18 22:32:49.461809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:49.461760    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc" event={"ID":"df4ed59c-4fbb-4314-a64c-1af779b631ce","Type":"ContainerStarted","Data":"7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff"}
Sep 18 22:32:49.461809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:49.461815    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc" event={"ID":"df4ed59c-4fbb-4314-a64c-1af779b631ce","Type":"ContainerStarted","Data":"6ce0dc9e7ea39b13742c1f770af9f9b8b0f45c776ac5f6d7d4e33763544a58cc"}
Sep 18 22:32:49.487177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:49.487124    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc" podStartSLOduration=1.4871035049999999 podStartE2EDuration="1.487103505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:32:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:32:49.484738297 +0000 UTC m=+960.062683442" watchObservedRunningTime="2026-09-18 22:32:49.487103505 +0000 UTC m=+960.065048654"
Sep 18 22:32:52.200452 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:52.200419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:52.893809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:52.893754    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:53.728705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:53.728667    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:54.652524 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:54.652496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:54.918728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:54.918642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:55.021027 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.020985    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:55.145620 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.145586    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"]
Sep 18 22:32:55.150681 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.150659    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.153135 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.153115    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-44d735\"/\"kube-root-ca.crt\""
Sep 18 22:32:55.153857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.153837    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-44d735\"/\"openshift-service-ca.crt\""
Sep 18 22:32:55.153997 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.153980    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-44d735\"/\"test-model-44d735-kserve-self-signed-certs\""
Sep 18 22:32:55.154061 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.154043    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-44d735\"/\"default-dockercfg-h6slz\""
Sep 18 22:32:55.162606 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.162586    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"]
Sep 18 22:32:55.237707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.237623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-dshm\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.237707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.237663    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f89fm\" (UniqueName: \"kubernetes.io/projected/150e2d42-2ce5-4402-9bcd-e777b4384dcd-kube-api-access-f89fm\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.237707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.237687    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-model-cache\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.237953 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.237732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tls-certs\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.237953 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.237792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-home\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.237953 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.237815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tmp-dir\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.241459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.241428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:55.338873 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.338838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-home\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.338873 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.338874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tmp-dir\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.339110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.338978    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-dshm\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.339110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.339015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f89fm\" (UniqueName: \"kubernetes.io/projected/150e2d42-2ce5-4402-9bcd-e777b4384dcd-kube-api-access-f89fm\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.339110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.339052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-model-cache\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.339110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.339099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tls-certs\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.339330 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.339243    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-home\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.339330 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.339284    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tmp-dir\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.339418 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.339354    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-model-cache\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.341430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.341409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-dshm\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.341601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.341586    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tls-certs\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.346628 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.346602    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f89fm\" (UniqueName: \"kubernetes.io/projected/150e2d42-2ce5-4402-9bcd-e777b4384dcd-kube-api-access-f89fm\") pod \"test-model-44d735-kserve-857dd45cc9-jkhd4\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") " pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.424065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.424031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:55.460194 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.460165    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:32:55.745433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:55.745404    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"]
Sep 18 22:32:55.746483 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:32:55.746461    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod150e2d42_2ce5_4402_9bcd_e777b4384dcd.slice/crio-4112b1b4ae14d0a8cb7f2ef415be17b6ee71300db6dafa610b114b467f8da55e WatchSource:0}: Error finding container 4112b1b4ae14d0a8cb7f2ef415be17b6ee71300db6dafa610b114b467f8da55e: Status 404 returned error can't find the container with id 4112b1b4ae14d0a8cb7f2ef415be17b6ee71300db6dafa610b114b467f8da55e
Sep 18 22:32:56.210850 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:56.210760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:32:56.511860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:56.511737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4" event={"ID":"150e2d42-2ce5-4402-9bcd-e777b4384dcd","Type":"ContainerStarted","Data":"bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b"}
Sep 18 22:32:56.511860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:56.511809    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4" event={"ID":"150e2d42-2ce5-4402-9bcd-e777b4384dcd","Type":"ContainerStarted","Data":"4112b1b4ae14d0a8cb7f2ef415be17b6ee71300db6dafa610b114b467f8da55e"}
Sep 18 22:32:56.533233 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:56.533189    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4" podStartSLOduration=1.533176512 podStartE2EDuration="1.533176512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:32:56.53101252 +0000 UTC m=+967.108957664" watchObservedRunningTime="2026-09-18 22:32:56.533176512 +0000 UTC m=+967.111121656"
Sep 18 22:32:58.460442 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:58.460405    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:58.460442 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:58.460454    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:58.473449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:58.473415    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:32:58.535264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:32:58.535237    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:33:01.051996 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:01.051966    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:01.159367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:01.159332    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:01.252196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:01.252160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:05.460428 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:05.460333    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:33:05.460428 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:05.460393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:33:05.473425 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:05.473398    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:33:05.575174 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:05.575141    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:33:17.224702 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:17.224669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:23.171961 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:23.171926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:23.270558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:23.270521    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:23.455530 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:23.455449    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:23.629115 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:23.629081    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:33.914980 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:33.914940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:34.664039 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:34.663999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:40.943728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:40.943691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:41.013642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:41.013574    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:41.113858 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:41.113817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:41.212224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:41.212135    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:41.876243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:41.876210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:41.967370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:41.967343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:42.062737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:42.062707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:43.632883 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:43.632852    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:49.492936 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:49.492902    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:49.565582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:49.565533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:49.792333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:49.792224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:50.178102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:50.178054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:56.480635 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:56.480595    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:56.559546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:56.559515    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:56.729591 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:56.729560    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:57.013144 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.013112    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"]
Sep 18 22:33:57.017040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.017021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.019673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.019653    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-939c7fd8-openshift-default-dockercfg-wn5q8\""
Sep 18 22:33:57.030852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.030825    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"]
Sep 18 22:33:57.043894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.043864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:57.190512 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istiod-ca-cert\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.190512 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-podinfo\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.190810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190613    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-credential-socket\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.190810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-data\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.190810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190695    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-socket\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.190810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-token\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.191036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-certs\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.191036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-envoy\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.191036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.190926    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6szm\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-kube-api-access-d6szm\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.258851 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.258821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:57.292230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292144    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istiod-ca-cert\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292185    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-podinfo\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-credential-socket\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292288    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-data\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-socket\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292343    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-token\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-certs\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-envoy\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292474    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6szm\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-kube-api-access-d6szm\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292729    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-data\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-certs\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.292919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.292832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-socket\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.293116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.293080    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-credential-socket\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.293347 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.293323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istiod-ca-cert\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.295041 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.295024    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-envoy\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.295502 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.295482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-podinfo\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.313461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.313435    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-token\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.313852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.313827    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6szm\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-kube-api-access-d6szm\") pod \"e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") " pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.328714 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.328690    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:57.607894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.607862    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"]
Sep 18 22:33:57.609321 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:33:57.609294    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6d6b76_a6c1_4f01_95ee_4ee88f7962d2.slice/crio-5ccf2f8f5a2066f14e0ad2bd5acdedc764bc4c260a5c40448db728496b5949c8 WatchSource:0}: Error finding container 5ccf2f8f5a2066f14e0ad2bd5acdedc764bc4c260a5c40448db728496b5949c8: Status 404 returned error can't find the container with id 5ccf2f8f5a2066f14e0ad2bd5acdedc764bc4c260a5c40448db728496b5949c8
Sep 18 22:33:57.611594 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.611562    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:33:57.611710 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.611639    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:33:57.611710 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.611684    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:33:57.857772 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.857671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" event={"ID":"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2","Type":"ContainerStarted","Data":"09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa"}
Sep 18 22:33:57.857772 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.857727    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" event={"ID":"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2","Type":"ContainerStarted","Data":"5ccf2f8f5a2066f14e0ad2bd5acdedc764bc4c260a5c40448db728496b5949c8"}
Sep 18 22:33:57.883675 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:57.883614    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podStartSLOduration=1.8835945760000001 podStartE2EDuration="1.883594576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:33:57.88136038 +0000 UTC m=+1028.459305549" watchObservedRunningTime="2026-09-18 22:33:57.883594576 +0000 UTC m=+1028.461539728"
Sep 18 22:33:58.329209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:58.329129    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:58.334738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:58.334715    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:58.865463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:58.865418    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:58.866442 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:58.866422    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:33:59.147285 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:59.147202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:59.797464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:59.797410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:33:59.872461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:33:59.872427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:00.103216 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:00.103187    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:01.049541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:01.049509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:01.945653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:01.945620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:02.638057 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:02.638022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:03.488995 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:03.488956    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:04.300073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:04.300042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:04.397991 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:04.397959    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:04.497694 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:04.497668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:04.883312 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:04.883267    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:05.042962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:05.042934    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:20.947899 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:20.947853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:22.415376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:22.415335    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:23.067235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.067198    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"]
Sep 18 22:34:23.071154 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.071131    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.074988 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.074964    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"e2e-conflict-a-24c2dd45-kserve-self-signed-certs\""
Sep 18 22:34:23.088748 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.088714    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"]
Sep 18 22:34:23.110200 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.110172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:23.190665 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.190627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfr2v\" (UniqueName: \"kubernetes.io/projected/fec1f474-a8ca-4335-9909-7174243b3634-kube-api-access-lfr2v\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.190882 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.190690    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-model-cache\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.190882 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.190770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec1f474-a8ca-4335-9909-7174243b3634-tls-certs\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.190882 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.190829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-tmp-dir\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.191009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.190910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-dshm\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.191009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.190939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-home\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.291942 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.291911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-home\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292106 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfr2v\" (UniqueName: \"kubernetes.io/projected/fec1f474-a8ca-4335-9909-7174243b3634-kube-api-access-lfr2v\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292106 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-model-cache\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292185 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292117    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec1f474-a8ca-4335-9909-7174243b3634-tls-certs\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292185 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-tmp-dir\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-dshm\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292371 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-home\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292444    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-model-cache\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.292665 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.292630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-tmp-dir\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.294597 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.294576    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-dshm\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.294905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.294885    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec1f474-a8ca-4335-9909-7174243b3634-tls-certs\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.301857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.301832    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfr2v\" (UniqueName: \"kubernetes.io/projected/fec1f474-a8ca-4335-9909-7174243b3634-kube-api-access-lfr2v\") pod \"e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.382894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.382861    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:23.406736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.406703    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:23.666727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:23.666700    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"]
Sep 18 22:34:23.668115 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:34:23.668087    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec1f474_a8ca_4335_9909_7174243b3634.slice/crio-ab753a04f5f3aef6cf856130d6d5221c0186f2e10f8451ef55410dc810e3709a WatchSource:0}: Error finding container ab753a04f5f3aef6cf856130d6d5221c0186f2e10f8451ef55410dc810e3709a: Status 404 returned error can't find the container with id ab753a04f5f3aef6cf856130d6d5221c0186f2e10f8451ef55410dc810e3709a
Sep 18 22:34:24.028390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.028311    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerID="09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa" exitCode=0
Sep 18 22:34:24.028544 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.028386    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" event={"ID":"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2","Type":"ContainerDied","Data":"09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa"}
Sep 18 22:34:24.028918 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.028898    2570 scope.go:117] "RemoveContainer" containerID="09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa"
Sep 18 22:34:24.030188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.030159    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt" event={"ID":"fec1f474-a8ca-4335-9909-7174243b3634","Type":"ContainerStarted","Data":"1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702"}
Sep 18 22:34:24.030286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.030186    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:34:24.030286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.030258    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:34:24.030286 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.030194    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt" event={"ID":"fec1f474-a8ca-4335-9909-7174243b3634","Type":"ContainerStarted","Data":"ab753a04f5f3aef6cf856130d6d5221c0186f2e10f8451ef55410dc810e3709a"}
Sep 18 22:34:24.030403 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.030290    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:34:24.075726 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.075666    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt" podStartSLOduration=1.075645141 podStartE2EDuration="1.075645141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:34:24.072704835 +0000 UTC m=+1054.650649981" watchObservedRunningTime="2026-09-18 22:34:24.075645141 +0000 UTC m=+1054.653590288"
Sep 18 22:34:24.198357 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.198317    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:24.996555 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:24.996467    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:25.037755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:25.037719    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" event={"ID":"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2","Type":"ContainerStarted","Data":"6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96"}
Sep 18 22:34:25.329821 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:25.329712    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:34:25.331213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:25.331185    2570 patch_prober.go:28] interesting pod/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 18 22:34:25.331364 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:25.331236    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 18 22:34:25.809385 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:25.809349    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:25.908438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:25.908407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:26.329106 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:26.329074    2570 patch_prober.go:28] interesting pod/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 18 22:34:26.329486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:26.329127    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 18 22:34:26.616043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:26.616013    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:27.329772 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:27.329735    2570 patch_prober.go:28] interesting pod/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 18 22:34:27.330173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:27.329821    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 18 22:34:27.497835 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:27.497771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:28.281572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:28.281538    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:28.329636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:28.329601    2570 patch_prober.go:28] interesting pod/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 18 22:34:28.329839 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:28.329664    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 18 22:34:28.866214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:28.866179    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:34:29.115918 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:29.115842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:29.329662 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:29.329628    2570 patch_prober.go:28] interesting pod/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 18 22:34:29.329846 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:29.329683    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 18 22:34:29.814577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:29.814548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:30.004450 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:30.004405    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:30.513665 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:30.513614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:30.536571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:30.536544    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:34:30.538804 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:30.538759    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:34:30.653252 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:30.653210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:30.913677 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:30.913645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:31.039182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:31.039157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:31.898552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:31.898523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:32.628864 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:32.628826    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:33.288234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.288199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:33.383964 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.383931    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:33.384165 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.384014    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:33.389241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.389203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:33.404538 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.404518    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:33.493699 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.493658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:33.596185 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.596128    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:33.690040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.690011    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:33.961952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:33.961870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:34.062097 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:34.062066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:34.103915 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:34.103888    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:34:34.832076 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:34.832042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:35.793644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:35.793610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:36.738411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:36.738375    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:36.936446 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:36.936373    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:37.461478 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:37.461442    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:37.726889 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:37.726763    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:37.851288 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:37.851254    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:38.674101 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:38.674075    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:39.019059 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:39.018976    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:39.396338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:39.396305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:40.171652 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:40.171621    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:40.899253 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:40.899222    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:41.568710 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:41.568668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:42.260930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:42.260902    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:44.493230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:44.493199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:45.586103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:45.586068    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:45.840566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:45.840480    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:46.317244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:46.317151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:46.623390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:46.623353    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:46.834449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:46.834417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:48.078306 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:48.078266    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:48.176355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:48.176324    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:48.277049 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:48.277017    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:48.398644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:48.398608    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:49.042294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:49.042256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:49.143470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:49.143431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:49.241112 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:49.241070    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:49.303054 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:49.302963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:49.596715 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:49.596685    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:49.697396 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:49.697349    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:50.484667 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:50.484628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:51.591928 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:51.591899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:52.907589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:52.907555    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:53.891312 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:53.891284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:56.183102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.183072    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:56.285454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.285423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:56.421527 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.421486    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"]
Sep 18 22:34:56.421718 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.421686    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy" containerID="cri-o://6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96" gracePeriod=30
Sep 18 22:34:56.449082 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.449013    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:56.757582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.757510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:56.856338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.856305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:34:56.967346 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:34:56.967312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:00.539921 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:00.539885    2570 patch_prober.go:28] interesting pod/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:35:00.540281 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:00.539956    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:35:01.687192 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.687122    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:35:01.809758 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.809724    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-envoy\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.809974 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.809772    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-socket\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.809974 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.809870    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-podinfo\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.809974 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.809892    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-data\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.809974 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.809963    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6szm\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-kube-api-access-d6szm\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.810213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810027    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istiod-ca-cert\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.810213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810069    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-token\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.810213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-certs\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.810213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810108    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:01.810213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810177    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-credential-socket\") pod \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\" (UID: \"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2\") "
Sep 18 22:35:01.810488 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810211    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:01.810705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810574    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:01.810705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810633    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:01.810705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810655    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.810705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810699    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.811008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.810836    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:35:01.812193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.812165    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:35:01.812193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.812186    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:35:01.812376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.812238    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:35:01.812376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.812323    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-kube-api-access-d6szm" (OuterVolumeSpecName: "kube-api-access-d6szm") pod "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" (UID: "aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2"). InnerVolumeSpecName "kube-api-access-d6szm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:35:01.912254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.912224    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.912254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.912249    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.912254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.912261    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.912480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.912270    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.912480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.912278    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.912480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.912286    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6szm\" (UniqueName: \"kubernetes.io/projected/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-kube-api-access-d6szm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.912480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:01.912294    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:35:02.252235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.252205    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerID="6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96" exitCode=0
Sep 18 22:35:02.252505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.252253    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" event={"ID":"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2","Type":"ContainerDied","Data":"6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96"}
Sep 18 22:35:02.252505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.252256    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"
Sep 18 22:35:02.252505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.252296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt" event={"ID":"aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2","Type":"ContainerDied","Data":"5ccf2f8f5a2066f14e0ad2bd5acdedc764bc4c260a5c40448db728496b5949c8"}
Sep 18 22:35:02.252505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.252318    2570 scope.go:117] "RemoveContainer" containerID="6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96"
Sep 18 22:35:02.265166 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.265149    2570 scope.go:117] "RemoveContainer" containerID="09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa"
Sep 18 22:35:02.273635 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.273617    2570 scope.go:117] "RemoveContainer" containerID="6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96"
Sep 18 22:35:02.273924 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:35:02.273904    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96\": container with ID starting with 6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96 not found: ID does not exist" containerID="6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96"
Sep 18 22:35:02.274009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.273938    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96"} err="failed to get container status \"6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96\": rpc error: code = NotFound desc = could not find container \"6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96\": container with ID starting with 6cdf01664e9a9a6209b69211b9fb836732e8329231ebbdaa323b1767bdb10b96 not found: ID does not exist"
Sep 18 22:35:02.274009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.273963    2570 scope.go:117] "RemoveContainer" containerID="09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa"
Sep 18 22:35:02.274256 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:35:02.274238    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa\": container with ID starting with 09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa not found: ID does not exist" containerID="09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa"
Sep 18 22:35:02.274302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.274262    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa"} err="failed to get container status \"09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa\": rpc error: code = NotFound desc = could not find container \"09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa\": container with ID starting with 09d4d4512f734f24a3a5def56f3d3192bdd468036f2c62f61b087d561d3453aa not found: ID does not exist"
Sep 18 22:35:02.278184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.278162    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"]
Sep 18 22:35:02.283344 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.283322    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt"]
Sep 18 22:35:02.781547 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.781517    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:02.891289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.891260    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:02.988008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:02.987972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:03.140719 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:03.140691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:03.403308 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:03.403234    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" path="/var/lib/kubelet/pods/aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2/volumes"
Sep 18 22:35:07.072157 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:07.072122    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:10.039558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:10.039510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:10.140657 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:10.140610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:11.012506 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:11.012475    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:11.339647 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:11.339613    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:11.816465 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:11.816368    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:14.131701 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:14.131646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:14.943498 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:14.943466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:15.087832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:15.087771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:15.992623 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:15.992597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:16.915136 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:16.915101    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:17.710136 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:17.710102    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:18.678380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:18.678342    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:18.819672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:18.819644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:18.921489 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:18.921456    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:19.247401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:19.247370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:19.347274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:19.347232    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:27.247444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:27.247412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:27.348138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:27.348107    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:41.413951 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:41.413919    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:42.293756 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:42.293724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:43.324164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:43.324129    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:44.414305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:44.414262    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:44.855338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:44.855312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:45.198850 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:45.198714    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:45.299715 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:45.299664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:45.547099 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:45.547014    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:45.860002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:45.859968    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:46.199066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:46.198990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:48.355417 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:48.355388    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:49.051150 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:49.051117    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:49.153592 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:49.153556    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:49.276684 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:49.276651    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:50.626718 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:50.626686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:51.431367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:51.431338    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:52.318165 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:52.318130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:53.418798 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:53.418749    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:54.136579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:54.136546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:54.235705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:54.235668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:54.502877 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:54.502761    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:54.607321 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:54.607293    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:54.710041 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:54.710004    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:55.124616 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.124575    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"]
Sep 18 22:35:55.125112 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.125091    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy"
Sep 18 22:35:55.125112 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.125113    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy"
Sep 18 22:35:55.125277 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.125270    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy"
Sep 18 22:35:55.125330 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.125288    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy"
Sep 18 22:35:55.129694 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.129674    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.132017 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.131998    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-233c27\"/\"openshift-service-ca.crt\""
Sep 18 22:35:55.132130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.132000    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-233c27\"/\"kube-root-ca.crt\""
Sep 18 22:35:55.132130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.132031    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-233c27\"/\"noten-model-233c27-kserve-self-signed-certs\""
Sep 18 22:35:55.132130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.131999    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-233c27\"/\"default-dockercfg-bw6hz\""
Sep 18 22:35:55.136463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.136444    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"]
Sep 18 22:35:55.195663 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.195630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-model-cache\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.195848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.195672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-home\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.195848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.195711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tmp-dir\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.195986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.195855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-dshm\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.195986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.195893    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-528rb\" (UniqueName: \"kubernetes.io/projected/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-kube-api-access-528rb\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.195986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.195939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tls-certs\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.296856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.296828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-model-cache\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.296863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-home\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.296889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tmp-dir\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.296958    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-dshm\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.296982    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-528rb\" (UniqueName: \"kubernetes.io/projected/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-kube-api-access-528rb\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.297006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tls-certs\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297272 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.297238    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-model-cache\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.297330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-home\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.297404 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.297340    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tmp-dir\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.299404 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.299379    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-dshm\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.299614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.299598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tls-certs\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.307337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.307314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-528rb\" (UniqueName: \"kubernetes.io/projected/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-kube-api-access-528rb\") pod \"noten-model-233c27-kserve-75fff78b5f-p754v\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") " pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.439842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.439758    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:35:55.527005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.526938    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:35:55.720732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:55.720707    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"]
Sep 18 22:35:55.723267 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:35:55.723238    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fdb5a01_9e50_484f_9ee9_f1a3275211c7.slice/crio-d91f85b478ef50e792edcfaaba18d7d3e43a8b749efc746692bb9fed8c33e06e WatchSource:0}: Error finding container d91f85b478ef50e792edcfaaba18d7d3e43a8b749efc746692bb9fed8c33e06e: Status 404 returned error can't find the container with id d91f85b478ef50e792edcfaaba18d7d3e43a8b749efc746692bb9fed8c33e06e
Sep 18 22:35:56.578544 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:56.578504    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v" event={"ID":"9fdb5a01-9e50-484f-9ee9-f1a3275211c7","Type":"ContainerStarted","Data":"3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e"}
Sep 18 22:35:56.578981 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:56.578560    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v" event={"ID":"9fdb5a01-9e50-484f-9ee9-f1a3275211c7","Type":"ContainerStarted","Data":"d91f85b478ef50e792edcfaaba18d7d3e43a8b749efc746692bb9fed8c33e06e"}
Sep 18 22:35:56.600202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:56.600129    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v" podStartSLOduration=1.6001099079999999 podStartE2EDuration="1.600109908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:35:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:35:56.598929416 +0000 UTC m=+1147.176874573" watchObservedRunningTime="2026-09-18 22:35:56.600109908 +0000 UTC m=+1147.178055056"
Sep 18 22:35:59.471953 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:35:59.471919    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:00.313604 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:00.313568    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:01.279995 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:01.279960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:01.324458 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:01.324429    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"]
Sep 18 22:36:01.347670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:01.347631    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:02.110764 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:02.110717    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:02.851254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:02.851174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:03.614050 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:03.614018    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:04.403452 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:04.403419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:05.187646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:05.187616    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:05.439994 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:05.439912    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:36:05.439994 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:05.439955    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:36:05.453168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:05.453145    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:36:05.641642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:05.641610    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:36:05.915470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:05.915436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:07.014221 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:07.014189    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:07.768494 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:07.768462    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:08.598446 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:08.598420    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:08.895573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:08.895493    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:09.631210 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:09.631180    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:10.347557 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.347516    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"]
Sep 18 22:36:10.348059 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.348045    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy"
Sep 18 22:36:10.348059 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.348060    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6d6b76-a6c1-4f01-95ee-4ee88f7962d2" containerName="istio-proxy"
Sep 18 22:36:10.351270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.351254    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.357245 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.357219    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:10.357946 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.357924    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"e2e-conflict-b-24c2dd45-kserve-self-signed-certs\""
Sep 18 22:36:10.364100 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.364080    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"]
Sep 18 22:36:10.469769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.469733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-dshm\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.469985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.469822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-tmp-dir\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.469985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.469843    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-model-cache\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.469985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.469861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-home\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.469985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.469917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550538fa-76ee-4569-9d13-e53d82451dfd-tls-certs\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.469985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.469955    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dghhw\" (UniqueName: \"kubernetes.io/projected/550538fa-76ee-4569-9d13-e53d82451dfd-kube-api-access-dghhw\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.495287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.495248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:10.570984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.570947    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-tmp-dir\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.570984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.570982    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-model-cache\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.571235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.571003    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-home\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.571235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.571041    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550538fa-76ee-4569-9d13-e53d82451dfd-tls-certs\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.571235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.571074    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dghhw\" (UniqueName: \"kubernetes.io/projected/550538fa-76ee-4569-9d13-e53d82451dfd-kube-api-access-dghhw\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.571405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.571311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-dshm\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.571467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.571419    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-model-cache\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.571526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.571487    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-home\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.571526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.571503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-tmp-dir\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.578815 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.578724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-dshm\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.579058 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.578858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550538fa-76ee-4569-9d13-e53d82451dfd-tls-certs\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.582447 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.582402    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dghhw\" (UniqueName: \"kubernetes.io/projected/550538fa-76ee-4569-9d13-e53d82451dfd-kube-api-access-dghhw\") pod \"e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") " pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.661161 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.661059    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:10.938843 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:10.938813    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"]
Sep 18 22:36:10.940268 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:36:10.940240    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod550538fa_76ee_4569_9d13_e53d82451dfd.slice/crio-a9142b657c39f7c4bee9eeea3799ac3faadb123aa19a0bfb9ef079b4bdb82085 WatchSource:0}: Error finding container a9142b657c39f7c4bee9eeea3799ac3faadb123aa19a0bfb9ef079b4bdb82085: Status 404 returned error can't find the container with id a9142b657c39f7c4bee9eeea3799ac3faadb123aa19a0bfb9ef079b4bdb82085
Sep 18 22:36:11.009461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.009437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:11.012938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.012910    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"]
Sep 18 22:36:11.016601 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.016579    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-eac715-29829510-zqxkx"]
Sep 18 22:36:11.099752 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.099713    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:11.162377 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.162348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:11.269250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.269169    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:11.406158 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.406125    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1" path="/var/lib/kubelet/pods/d652c4e8-1a9d-4593-b4c2-75ee5c9a4bc1/volumes"
Sep 18 22:36:11.577979 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.577906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:11.666409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.666377    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd" event={"ID":"550538fa-76ee-4569-9d13-e53d82451dfd","Type":"ContainerStarted","Data":"1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4"}
Sep 18 22:36:11.666409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.666420    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd" event={"ID":"550538fa-76ee-4569-9d13-e53d82451dfd","Type":"ContainerStarted","Data":"a9142b657c39f7c4bee9eeea3799ac3faadb123aa19a0bfb9ef079b4bdb82085"}
Sep 18 22:36:11.686977 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.686921    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd" podStartSLOduration=1.686903004 podStartE2EDuration="1.686903004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:36:11.686240394 +0000 UTC m=+1162.264185540" watchObservedRunningTime="2026-09-18 22:36:11.686903004 +0000 UTC m=+1162.264848150"
Sep 18 22:36:11.687234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:11.687210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:12.524968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:12.524932    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:13.290405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:13.290375    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:14.338370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:14.338332    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:15.040319 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:15.040288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:15.148816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:15.148768    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"]
Sep 18 22:36:15.193528 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:15.193494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:16.345370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.345290    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr" podUID="1a002316-ea75-4dc2-b0f0-93533ec4f226" containerName="main" containerID="cri-o://ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965" gracePeriod=45
Sep 18 22:36:16.382328 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.382295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:16.624292 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.624270    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:36:16.636251 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.636228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:16.643298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643282    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-tmp-dir\") pod \"1a002316-ea75-4dc2-b0f0-93533ec4f226\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") "
Sep 18 22:36:16.643369 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643328    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-dshm\") pod \"1a002316-ea75-4dc2-b0f0-93533ec4f226\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") "
Sep 18 22:36:16.643412 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643380    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a002316-ea75-4dc2-b0f0-93533ec4f226-tls-certs\") pod \"1a002316-ea75-4dc2-b0f0-93533ec4f226\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") "
Sep 18 22:36:16.643412 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643401    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5p8g\" (UniqueName: \"kubernetes.io/projected/1a002316-ea75-4dc2-b0f0-93533ec4f226-kube-api-access-c5p8g\") pod \"1a002316-ea75-4dc2-b0f0-93533ec4f226\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") "
Sep 18 22:36:16.643502 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643489    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-home\") pod \"1a002316-ea75-4dc2-b0f0-93533ec4f226\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") "
Sep 18 22:36:16.643546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643511    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a002316-ea75-4dc2-b0f0-93533ec4f226" (UID: "1a002316-ea75-4dc2-b0f0-93533ec4f226"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:16.643546 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643539    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-model-cache\") pod \"1a002316-ea75-4dc2-b0f0-93533ec4f226\" (UID: \"1a002316-ea75-4dc2-b0f0-93533ec4f226\") "
Sep 18 22:36:16.643824 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643771    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-home" (OuterVolumeSpecName: "home") pod "1a002316-ea75-4dc2-b0f0-93533ec4f226" (UID: "1a002316-ea75-4dc2-b0f0-93533ec4f226"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:16.643824 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.643801    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a002316-ea75-4dc2-b0f0-93533ec4f226" (UID: "1a002316-ea75-4dc2-b0f0-93533ec4f226"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:16.644035 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.644020    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:16.644090 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.644038    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:16.644090 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.644050    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:16.645941 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.645915    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a002316-ea75-4dc2-b0f0-93533ec4f226-kube-api-access-c5p8g" (OuterVolumeSpecName: "kube-api-access-c5p8g") pod "1a002316-ea75-4dc2-b0f0-93533ec4f226" (UID: "1a002316-ea75-4dc2-b0f0-93533ec4f226"). InnerVolumeSpecName "kube-api-access-c5p8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:16.646123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.646103    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-dshm" (OuterVolumeSpecName: "dshm") pod "1a002316-ea75-4dc2-b0f0-93533ec4f226" (UID: "1a002316-ea75-4dc2-b0f0-93533ec4f226"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:16.646123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.646109    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a002316-ea75-4dc2-b0f0-93533ec4f226-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a002316-ea75-4dc2-b0f0-93533ec4f226" (UID: "1a002316-ea75-4dc2-b0f0-93533ec4f226"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:36:16.698126 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.698094    2570 generic.go:356] "Generic (PLEG): container finished" podID="1a002316-ea75-4dc2-b0f0-93533ec4f226" containerID="ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965" exitCode=0
Sep 18 22:36:16.698245 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.698138    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"
Sep 18 22:36:16.698245 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.698170    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr" event={"ID":"1a002316-ea75-4dc2-b0f0-93533ec4f226","Type":"ContainerDied","Data":"ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965"}
Sep 18 22:36:16.698245 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.698209    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr" event={"ID":"1a002316-ea75-4dc2-b0f0-93533ec4f226","Type":"ContainerDied","Data":"2612e127e3ce670a39b6d0dbf5ad4dc543fe2384b4a7086f78a234ad664f67c2"}
Sep 18 22:36:16.698245 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.698230    2570 scope.go:117] "RemoveContainer" containerID="ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965"
Sep 18 22:36:16.708078 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.708054    2570 scope.go:117] "RemoveContainer" containerID="ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965"
Sep 18 22:36:16.708335 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:16.708317    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965\": container with ID starting with ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965 not found: ID does not exist" containerID="ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965"
Sep 18 22:36:16.708380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.708344    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965"} err="failed to get container status \"ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965\": rpc error: code = NotFound desc = could not find container \"ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965\": container with ID starting with ad40ef100f9a8ede2be35f096893e34e51ad5c1996b98247cee308fbe2da7965 not found: ID does not exist"
Sep 18 22:36:16.720143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.720122    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"]
Sep 18 22:36:16.724059 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.724029    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-eac715/test-model-eac715-kserve-7c7877fb65-vwvbr"]
Sep 18 22:36:16.744852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.744833    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a002316-ea75-4dc2-b0f0-93533ec4f226-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:16.744852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.744851    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a002316-ea75-4dc2-b0f0-93533ec4f226-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:16.744966 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:16.744859    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5p8g\" (UniqueName: \"kubernetes.io/projected/1a002316-ea75-4dc2-b0f0-93533ec4f226-kube-api-access-c5p8g\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:17.319580 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:17.319547    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:17.403668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:17.403631    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a002316-ea75-4dc2-b0f0-93533ec4f226" path="/var/lib/kubelet/pods/1a002316-ea75-4dc2-b0f0-93533ec4f226/volumes"
Sep 18 22:36:18.969467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:18.969430    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:19.382544 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.382509    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"]
Sep 18 22:36:19.383231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.383212    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a002316-ea75-4dc2-b0f0-93533ec4f226" containerName="main"
Sep 18 22:36:19.383291 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.383236    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a002316-ea75-4dc2-b0f0-93533ec4f226" containerName="main"
Sep 18 22:36:19.383364 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.383353    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a002316-ea75-4dc2-b0f0-93533ec4f226" containerName="main"
Sep 18 22:36:19.388120 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.388101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.391606 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.391483    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-20e1128a-openshift-default-dockercfg-d99gp\""
Sep 18 22:36:19.406064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.406042    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"]
Sep 18 22:36:19.420027 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.420001    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:19.472444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-certs\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472460    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-credential-socket\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472545    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dae59c6-d984-4404-90a6-6acb52ff2b34-istiod-ca-cert\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472606    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-data\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472654    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qdlq\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-kube-api-access-4qdlq\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472767 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-envoy\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472865 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-podinfo\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472865 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-token\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.472978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.472900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-socket\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.508534 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.508481    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:19.573464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-certs\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.573464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573469    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-credential-socket\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.573724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dae59c6-d984-4404-90a6-6acb52ff2b34-istiod-ca-cert\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.573724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-data\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.573724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qdlq\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-kube-api-access-4qdlq\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.573724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-envoy\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.573724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-podinfo\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.573724 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573709    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-token\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.574065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573743    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-socket\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.574065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573921    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-certs\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.574065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.573985    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-data\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.574065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.574029    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-credential-socket\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.574208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.574136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-socket\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.574284 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.574263    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dae59c6-d984-4404-90a6-6acb52ff2b34-istiod-ca-cert\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.576121 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.576097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-envoy\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.576474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.576454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-podinfo\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.583375 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.583347    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qdlq\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-kube-api-access-4qdlq\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.584075 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.584057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-token\") pod \"e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") " pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.699700 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.699620    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:19.982626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.982597    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"]
Sep 18 22:36:19.985029 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:36:19.984998    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dae59c6_d984_4404_90a6_6acb52ff2b34.slice/crio-d7d8efba4a98db305b44ba3f38f94450488d7c20cd9ffd86bcc0c47fef2de37e WatchSource:0}: Error finding container d7d8efba4a98db305b44ba3f38f94450488d7c20cd9ffd86bcc0c47fef2de37e: Status 404 returned error can't find the container with id d7d8efba4a98db305b44ba3f38f94450488d7c20cd9ffd86bcc0c47fef2de37e
Sep 18 22:36:19.987948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.987913    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:19.988061 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.987995    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:19.988061 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:19.988025    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:20.661950 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:20.661917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:20.662093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:20.661972    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:20.674600 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:20.674574    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:20.728343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:20.728310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" event={"ID":"1dae59c6-d984-4404-90a6-6acb52ff2b34","Type":"ContainerStarted","Data":"1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b"}
Sep 18 22:36:20.728539 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:20.728363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" event={"ID":"1dae59c6-d984-4404-90a6-6acb52ff2b34","Type":"ContainerStarted","Data":"d7d8efba4a98db305b44ba3f38f94450488d7c20cd9ffd86bcc0c47fef2de37e"}
Sep 18 22:36:20.740406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:20.740380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:36:20.750204 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:20.750156    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" podStartSLOduration=1.750141101 podStartE2EDuration="1.750141101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:36:20.749015695 +0000 UTC m=+1171.326960839" watchObservedRunningTime="2026-09-18 22:36:20.750141101 +0000 UTC m=+1171.328086245"
Sep 18 22:36:21.700486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:21.700446    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:21.706002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:21.705978    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:21.734766 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:21.734721    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:21.735672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:21.735649    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:36:22.569548 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:22.569513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:22.735756 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:22.735719    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:22.840199 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:22.840174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:23.796279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:23.796246    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:24.480614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:24.480586    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:24.693713 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:24.693681    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"]
Sep 18 22:36:24.694009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:24.693981    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy" containerID="cri-o://c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c" gracePeriod=30
Sep 18 22:36:24.727321 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:24.727295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:24.823586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:24.823512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:25.812284 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:25.812256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:26.557023 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:26.556995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:27.420259 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:27.420218    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:27.500315 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:27.500287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:27.573306 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:27.573261    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:27.935234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:27.935205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:28.033846 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:28.033807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:28.390143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:28.390089    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:29.340612 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:29.340577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:29.963369 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:29.963312    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:36:30.087755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.087721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzxdv\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-kube-api-access-kzxdv\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.087955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.087811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-certs\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.087955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.087834    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istiod-ca-cert\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.087955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.087849    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-envoy\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.087955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.087886    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-data\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.087955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.087906    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-socket\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.087955 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.087955    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-credential-socket\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.088289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088028    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-podinfo\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.088289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088060    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-token\") pod \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\" (UID: \"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8\") "
Sep 18 22:36:30.088289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088163    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.088289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088201    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.088289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088260    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:36:30.088603 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088325    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.088603 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088547    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.088845 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088732    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.088845 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088754    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.088845 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088768    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.088845 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.088800    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.090234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.090201    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.090341 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.090319    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-kube-api-access-kzxdv" (OuterVolumeSpecName: "kube-api-access-kzxdv") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "kube-api-access-kzxdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:30.090409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.090388    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:36:30.090409 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.090399    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" (UID: "8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:30.168577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.168528    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4" podUID="150e2d42-2ce5-4402-9bcd-e777b4384dcd" containerName="main" containerID="cri-o://bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b" gracePeriod=45
Sep 18 22:36:30.189470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.189447    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzxdv\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-kube-api-access-kzxdv\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.189470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.189471    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.189598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.189481    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.189598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.189489    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.189598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.189497    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.311643 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.311605    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:30.412135 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.412111    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:36:30.493070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493045    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f89fm\" (UniqueName: \"kubernetes.io/projected/150e2d42-2ce5-4402-9bcd-e777b4384dcd-kube-api-access-f89fm\") pod \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") "
Sep 18 22:36:30.493240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493105    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tls-certs\") pod \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") "
Sep 18 22:36:30.493240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493203    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-dshm\") pod \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") "
Sep 18 22:36:30.493240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493228    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-home\") pod \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") "
Sep 18 22:36:30.493426 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493363    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-model-cache\") pod \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") "
Sep 18 22:36:30.493426 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493392    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tmp-dir\") pod \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\" (UID: \"150e2d42-2ce5-4402-9bcd-e777b4384dcd\") "
Sep 18 22:36:30.493598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493566    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-home" (OuterVolumeSpecName: "home") pod "150e2d42-2ce5-4402-9bcd-e777b4384dcd" (UID: "150e2d42-2ce5-4402-9bcd-e777b4384dcd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.493738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493578    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-model-cache" (OuterVolumeSpecName: "model-cache") pod "150e2d42-2ce5-4402-9bcd-e777b4384dcd" (UID: "150e2d42-2ce5-4402-9bcd-e777b4384dcd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.494028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.493909    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "150e2d42-2ce5-4402-9bcd-e777b4384dcd" (UID: "150e2d42-2ce5-4402-9bcd-e777b4384dcd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.494137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.494118    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.494180 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.494145    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.494180 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.494159    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.495508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.495485    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-dshm" (OuterVolumeSpecName: "dshm") pod "150e2d42-2ce5-4402-9bcd-e777b4384dcd" (UID: "150e2d42-2ce5-4402-9bcd-e777b4384dcd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:30.495577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.495521    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "150e2d42-2ce5-4402-9bcd-e777b4384dcd" (UID: "150e2d42-2ce5-4402-9bcd-e777b4384dcd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:36:30.495577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.495566    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150e2d42-2ce5-4402-9bcd-e777b4384dcd-kube-api-access-f89fm" (OuterVolumeSpecName: "kube-api-access-f89fm") pod "150e2d42-2ce5-4402-9bcd-e777b4384dcd" (UID: "150e2d42-2ce5-4402-9bcd-e777b4384dcd"). InnerVolumeSpecName "kube-api-access-f89fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:30.595577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.595550    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150e2d42-2ce5-4402-9bcd-e777b4384dcd-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.595577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.595578    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/150e2d42-2ce5-4402-9bcd-e777b4384dcd-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.595772 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.595588    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f89fm\" (UniqueName: \"kubernetes.io/projected/150e2d42-2ce5-4402-9bcd-e777b4384dcd-kube-api-access-f89fm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:30.787826 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.787771    2570 generic.go:356] "Generic (PLEG): container finished" podID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerID="c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c" exitCode=0
Sep 18 22:36:30.787826 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.787812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" event={"ID":"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8","Type":"ContainerDied","Data":"c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c"}
Sep 18 22:36:30.788067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.787844    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"
Sep 18 22:36:30.788067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.787874    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc" event={"ID":"8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8","Type":"ContainerDied","Data":"4618ebf32b082319f6beb12371b16efc3eab15e066617716ae2194ad12d62389"}
Sep 18 22:36:30.788067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.787908    2570 scope.go:117] "RemoveContainer" containerID="c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c"
Sep 18 22:36:30.789501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.789474    2570 generic.go:356] "Generic (PLEG): container finished" podID="150e2d42-2ce5-4402-9bcd-e777b4384dcd" containerID="bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b" exitCode=0
Sep 18 22:36:30.789617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.789553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4" event={"ID":"150e2d42-2ce5-4402-9bcd-e777b4384dcd","Type":"ContainerDied","Data":"bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b"}
Sep 18 22:36:30.789617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.789596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4" event={"ID":"150e2d42-2ce5-4402-9bcd-e777b4384dcd","Type":"ContainerDied","Data":"4112b1b4ae14d0a8cb7f2ef415be17b6ee71300db6dafa610b114b467f8da55e"}
Sep 18 22:36:30.789705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.789690    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"
Sep 18 22:36:30.804816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.804298    2570 scope.go:117] "RemoveContainer" containerID="321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b"
Sep 18 22:36:30.815901 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.815724    2570 scope.go:117] "RemoveContainer" containerID="c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c"
Sep 18 22:36:30.816084 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:30.816063    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c\": container with ID starting with c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c not found: ID does not exist" containerID="c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c"
Sep 18 22:36:30.816126 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.816093    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c"} err="failed to get container status \"c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c\": rpc error: code = NotFound desc = could not find container \"c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c\": container with ID starting with c5e5524a8fd4ec63f6a81eeedba29c197fec12de34e65bb0b503dfe506f20c9c not found: ID does not exist"
Sep 18 22:36:30.816126 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.816109    2570 scope.go:117] "RemoveContainer" containerID="321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b"
Sep 18 22:36:30.816399 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:30.816383    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b\": container with ID starting with 321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b not found: ID does not exist" containerID="321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b"
Sep 18 22:36:30.816465 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.816401    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b"} err="failed to get container status \"321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b\": rpc error: code = NotFound desc = could not find container \"321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b\": container with ID starting with 321a3fcb77cdd0caf8a88a785065dcb63d2813130bb78d93437e9681d03c633b not found: ID does not exist"
Sep 18 22:36:30.816465 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.816415    2570 scope.go:117] "RemoveContainer" containerID="bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b"
Sep 18 22:36:30.823442 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:30.823414    2570 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c147a5e_dc36_4ef6_a6ff_dd71627ce1c8.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod150e2d42_2ce5_4402_9bcd_e777b4384dcd.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod150e2d42_2ce5_4402_9bcd_e777b4384dcd.slice/crio-4112b1b4ae14d0a8cb7f2ef415be17b6ee71300db6dafa610b114b467f8da55e\": RecentStats: unable to find data in memory cache]"
Sep 18 22:36:30.823442 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:30.823426    2570 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod150e2d42_2ce5_4402_9bcd_e777b4384dcd.slice/crio-4112b1b4ae14d0a8cb7f2ef415be17b6ee71300db6dafa610b114b467f8da55e\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c147a5e_dc36_4ef6_a6ff_dd71627ce1c8.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod150e2d42_2ce5_4402_9bcd_e777b4384dcd.slice\": RecentStats: unable to find data in memory cache]"
Sep 18 22:36:30.823704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.823683    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"]
Sep 18 22:36:30.826151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.826126    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-44d735/test-model-44d735-kserve-857dd45cc9-jkhd4"]
Sep 18 22:36:30.827243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.827228    2570 scope.go:117] "RemoveContainer" containerID="bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b"
Sep 18 22:36:30.827547 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:30.827530    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b\": container with ID starting with bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b not found: ID does not exist" containerID="bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b"
Sep 18 22:36:30.827614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.827554    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b"} err="failed to get container status \"bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b\": rpc error: code = NotFound desc = could not find container \"bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b\": container with ID starting with bab0835ef4d16e5a04ff68d4b647a07fe3f419e3fab15b79050a08d8b0b16c9b not found: ID does not exist"
Sep 18 22:36:30.839216 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.839196    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"]
Sep 18 22:36:30.843673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:30.843654    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc"]
Sep 18 22:36:31.106226 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:31.106198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:31.184479 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:31.184448    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:31.330290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:31.330256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:31.407540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:31.407461    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150e2d42-2ce5-4402-9bcd-e777b4384dcd" path="/var/lib/kubelet/pods/150e2d42-2ce5-4402-9bcd-e777b4384dcd/volumes"
Sep 18 22:36:31.408005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:31.407984    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" path="/var/lib/kubelet/pods/8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8/volumes"
Sep 18 22:36:31.435223 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:31.435197    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:32.033841 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:32.033805    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:35.181757 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:35.181725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:35.850036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:35.849995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:35.947592 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:35.947561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:36.053803 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:36.053753    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:36.148418 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:36.148337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:36.388347 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:36.388307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:36.430401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:36.430320    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"]
Sep 18 22:36:36.492541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:36.492513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:36.595177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:36.595147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:37.219295 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:37.219264    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:38.233888 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:38.233853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:38.998863 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:38.998833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:39.799429 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:39.799396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:40.719060 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:40.719022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:41.604694 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:41.604655    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:42.464423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:42.464395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:42.566234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:42.566206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:42.800231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:42.800152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:42.901179 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:42.901143    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:43.035143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.035111    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"]
Sep 18 22:36:43.035305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.035290    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy" containerID="cri-o://40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48" gracePeriod=30
Sep 18 22:36:43.061905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.061812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:43.317273 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.317187    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:43.639180 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.639151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:43.905926 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.905834    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"]
Sep 18 22:36:43.906921 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.906893    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150e2d42-2ce5-4402-9bcd-e777b4384dcd" containerName="main"
Sep 18 22:36:43.906921 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.906922    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="150e2d42-2ce5-4402-9bcd-e777b4384dcd" containerName="main"
Sep 18 22:36:43.907103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.906989    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy"
Sep 18 22:36:43.907103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.906998    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy"
Sep 18 22:36:43.907103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.907028    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy"
Sep 18 22:36:43.907103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.907036    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy"
Sep 18 22:36:43.907307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.907240    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy"
Sep 18 22:36:43.907307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.907254    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="150e2d42-2ce5-4402-9bcd-e777b4384dcd" containerName="main"
Sep 18 22:36:43.911580 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.911553    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:43.915050 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.914849    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-d6c0ac-openshift-default-dockercfg-6rdc7\""
Sep 18 22:36:43.917900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.917878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"]
Sep 18 22:36:43.936130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:43.936109    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:44.044081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044042    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864c90bb-ec66-4327-b61e-9483ee26de88-istio-podinfo\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-data\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-socket\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-envoy\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-certs\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864c90bb-ec66-4327-b61e-9483ee26de88-istiod-ca-cert\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-credential-socket\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044472 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f84s\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-kube-api-access-6f84s\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.044472 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.044358    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-istio-token\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.095502 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.095466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:44.144982 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.144946    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f84s\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-kube-api-access-6f84s\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.144996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-istio-token\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864c90bb-ec66-4327-b61e-9483ee26de88-istio-podinfo\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145257 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-data\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145257 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-socket\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145257 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145239    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-envoy\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145257 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-certs\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145492 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864c90bb-ec66-4327-b61e-9483ee26de88-istiod-ca-cert\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145492 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145321    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-credential-socket\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145625 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145598    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-data\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145692 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145632    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-socket\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145692 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145662    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-credential-socket\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.145919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.145899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-certs\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.146238 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.146221    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864c90bb-ec66-4327-b61e-9483ee26de88-istiod-ca-cert\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.147562 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.147539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-envoy\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.148653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.148631    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864c90bb-ec66-4327-b61e-9483ee26de88-istio-podinfo\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.156557 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.156469    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-istio-token\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.158911 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.158877    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f84s\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-kube-api-access-6f84s\") pod \"e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") " pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.224933 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.224896    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:44.509289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.509264    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"]
Sep 18 22:36:44.510597 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:36:44.510572    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864c90bb_ec66_4327_b61e_9483ee26de88.slice/crio-2963ea6a340ae6907c2a4f1bb61809d836ca4f877520973cf3336fdcf6a35dfe WatchSource:0}: Error finding container 2963ea6a340ae6907c2a4f1bb61809d836ca4f877520973cf3336fdcf6a35dfe: Status 404 returned error can't find the container with id 2963ea6a340ae6907c2a4f1bb61809d836ca4f877520973cf3336fdcf6a35dfe
Sep 18 22:36:44.513249 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.513215    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:44.513355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.513295    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:44.513355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.513345    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:44.876216 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.876182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" event={"ID":"864c90bb-ec66-4327-b61e-9483ee26de88","Type":"ContainerStarted","Data":"7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470"}
Sep 18 22:36:44.876376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.876240    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" event={"ID":"864c90bb-ec66-4327-b61e-9483ee26de88","Type":"ContainerStarted","Data":"2963ea6a340ae6907c2a4f1bb61809d836ca4f877520973cf3336fdcf6a35dfe"}
Sep 18 22:36:44.897718 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:44.897667    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" podStartSLOduration=1.8976515489999999 podStartE2EDuration="1.897651549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:36:44.896615959 +0000 UTC m=+1195.474561103" watchObservedRunningTime="2026-09-18 22:36:44.897651549 +0000 UTC m=+1195.475596694"
Sep 18 22:36:45.225743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:45.225661    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:45.231010 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:45.230986    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:45.884062 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:45.884030    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:45.885089 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:45.885070    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:36:46.085662 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:46.085626    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:46.780039 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:46.780005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:46.870068 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:46.870034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:47.096292 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:47.096260    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:48.299012 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.298938    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:36:48.492593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.492559    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-socket\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.492762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.492610    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-token\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.492762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.492679    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-podinfo\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.492762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.492714    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-envoy\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.492963 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.492892    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-certs\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.492963 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.492900    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:48.492963 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.492934    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istiod-ca-cert\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.493124 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493082    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-data\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.493124 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493110    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdtdg\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-kube-api-access-tdtdg\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.493234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493182    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-credential-socket\") pod \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\" (UID: \"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a\") "
Sep 18 22:36:48.493234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493109    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:48.493331 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493287    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:48.493388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493323    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:36:48.493541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493517    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:48.493954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493884    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.493954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493912    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.493954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493927    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.493954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493940    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.493954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.493955    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.495188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.495161    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:48.495304 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.495198    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:36:48.495304 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.495223    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:48.495515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.495498    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-kube-api-access-tdtdg" (OuterVolumeSpecName: "kube-api-access-tdtdg") pod "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" (UID: "c0f0193c-13f8-4e86-abb7-b4a3415e4b8a"). InnerVolumeSpecName "kube-api-access-tdtdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:48.526212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.526181    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:48.595095 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.595061    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.595095 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.595087    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.595095 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.595096    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.595095 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.595105    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdtdg\" (UniqueName: \"kubernetes.io/projected/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a-kube-api-access-tdtdg\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:48.904393 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.904307    2570 generic.go:356] "Generic (PLEG): container finished" podID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerID="40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48" exitCode=0
Sep 18 22:36:48.904393 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.904373    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"
Sep 18 22:36:48.904578 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.904378    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" event={"ID":"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a","Type":"ContainerDied","Data":"40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48"}
Sep 18 22:36:48.904578 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.904485    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm" event={"ID":"c0f0193c-13f8-4e86-abb7-b4a3415e4b8a","Type":"ContainerDied","Data":"537cb88fc8aab8a07df82eed3f3a9f65c28eb5d22afd94004c6db90b85b90e39"}
Sep 18 22:36:48.904578 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.904507    2570 scope.go:117] "RemoveContainer" containerID="40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48"
Sep 18 22:36:48.914743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.914725    2570 scope.go:117] "RemoveContainer" containerID="eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca"
Sep 18 22:36:48.923588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.923571    2570 scope.go:117] "RemoveContainer" containerID="40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48"
Sep 18 22:36:48.923873 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:48.923852    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48\": container with ID starting with 40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48 not found: ID does not exist" containerID="40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48"
Sep 18 22:36:48.923928 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.923882    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48"} err="failed to get container status \"40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48\": rpc error: code = NotFound desc = could not find container \"40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48\": container with ID starting with 40c79e9ac228d61c3ff9c3d3725f4ca1c2fc499300d28f3a9a8eba25c2c2fd48 not found: ID does not exist"
Sep 18 22:36:48.923928 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.923900    2570 scope.go:117] "RemoveContainer" containerID="eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca"
Sep 18 22:36:48.924169 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:48.924148    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca\": container with ID starting with eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca not found: ID does not exist" containerID="eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca"
Sep 18 22:36:48.924219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.924175    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca"} err="failed to get container status \"eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca\": rpc error: code = NotFound desc = could not find container \"eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca\": container with ID starting with eebff19d7115c1e40f5a1dee0fcc0362074f29a0d9aaa869f68241159f6816ca not found: ID does not exist"
Sep 18 22:36:48.929070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.929048    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"]
Sep 18 22:36:48.935576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:48.935556    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm"]
Sep 18 22:36:49.404177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:49.404144    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" path="/var/lib/kubelet/pods/c0f0193c-13f8-4e86-abb7-b4a3415e4b8a/volumes"
Sep 18 22:36:49.514259 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:49.514224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:50.245528 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:50.245499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:51.306938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.306897    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:51.432388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.432358    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:36:51.433733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.433710    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:36:51.455731 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.455696    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v" podUID="9fdb5a01-9e50-484f-9ee9-f1a3275211c7" containerName="main" containerID="cri-o://3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e" gracePeriod=45
Sep 18 22:36:51.516471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.516435    2570 scope.go:117] "RemoveContainer" containerID="b10d2a418a93b6fd9d23a3cde9e603fbe30186012d65c4f0ea216423ab9596fe"
Sep 18 22:36:51.778035 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.778007    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:36:51.829334 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829246    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-home\") pod \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") "
Sep 18 22:36:51.829334 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829313    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-model-cache\") pod \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") "
Sep 18 22:36:51.829579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829357    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tls-certs\") pod \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") "
Sep 18 22:36:51.829579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829428    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tmp-dir\") pod \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") "
Sep 18 22:36:51.829579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829457    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-dshm\") pod \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") "
Sep 18 22:36:51.829579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829489    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-528rb\" (UniqueName: \"kubernetes.io/projected/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-kube-api-access-528rb\") pod \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\" (UID: \"9fdb5a01-9e50-484f-9ee9-f1a3275211c7\") "
Sep 18 22:36:51.829824 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829644    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "9fdb5a01-9e50-484f-9ee9-f1a3275211c7" (UID: "9fdb5a01-9e50-484f-9ee9-f1a3275211c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:51.829824 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829661    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9fdb5a01-9e50-484f-9ee9-f1a3275211c7" (UID: "9fdb5a01-9e50-484f-9ee9-f1a3275211c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:51.829938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829839    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:51.829938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.829852    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:51.830115 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.830092    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-home" (OuterVolumeSpecName: "home") pod "9fdb5a01-9e50-484f-9ee9-f1a3275211c7" (UID: "9fdb5a01-9e50-484f-9ee9-f1a3275211c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:51.832569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.831988    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-dshm" (OuterVolumeSpecName: "dshm") pod "9fdb5a01-9e50-484f-9ee9-f1a3275211c7" (UID: "9fdb5a01-9e50-484f-9ee9-f1a3275211c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:36:51.832569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.832324    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9fdb5a01-9e50-484f-9ee9-f1a3275211c7" (UID: "9fdb5a01-9e50-484f-9ee9-f1a3275211c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:36:51.833270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.833246    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-kube-api-access-528rb" (OuterVolumeSpecName: "kube-api-access-528rb") pod "9fdb5a01-9e50-484f-9ee9-f1a3275211c7" (UID: "9fdb5a01-9e50-484f-9ee9-f1a3275211c7"). InnerVolumeSpecName "kube-api-access-528rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:51.924380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.924339    2570 generic.go:356] "Generic (PLEG): container finished" podID="9fdb5a01-9e50-484f-9ee9-f1a3275211c7" containerID="3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e" exitCode=0
Sep 18 22:36:51.924380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.924378    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"
Sep 18 22:36:51.924605 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.924465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v" event={"ID":"9fdb5a01-9e50-484f-9ee9-f1a3275211c7","Type":"ContainerDied","Data":"3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e"}
Sep 18 22:36:51.924605 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.924514    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v" event={"ID":"9fdb5a01-9e50-484f-9ee9-f1a3275211c7","Type":"ContainerDied","Data":"d91f85b478ef50e792edcfaaba18d7d3e43a8b749efc746692bb9fed8c33e06e"}
Sep 18 22:36:51.924605 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.924540    2570 scope.go:117] "RemoveContainer" containerID="3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e"
Sep 18 22:36:51.930631 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.930609    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:51.930738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.930634    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:51.930738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.930649    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:51.930738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.930663    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-528rb\" (UniqueName: \"kubernetes.io/projected/9fdb5a01-9e50-484f-9ee9-f1a3275211c7-kube-api-access-528rb\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:36:51.934515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.934498    2570 scope.go:117] "RemoveContainer" containerID="3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e"
Sep 18 22:36:51.934809 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:51.934762    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e\": container with ID starting with 3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e not found: ID does not exist" containerID="3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e"
Sep 18 22:36:51.934894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.934815    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e"} err="failed to get container status \"3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e\": rpc error: code = NotFound desc = could not find container \"3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e\": container with ID starting with 3b80aad55889af5647f65b865a236195412405cb1a477cc96d4e083971109b7e not found: ID does not exist"
Sep 18 22:36:51.949296 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.949240    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"]
Sep 18 22:36:51.953205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:51.953179    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-233c27/noten-model-233c27-kserve-75fff78b5f-p754v"]
Sep 18 22:36:51.953796 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:51.953759    2570 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fdb5a01_9e50_484f_9ee9_f1a3275211c7.slice\": RecentStats: unable to find data in memory cache]"
Sep 18 22:36:52.017287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017249    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"]
Sep 18 22:36:52.017846 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017807    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy"
Sep 18 22:36:52.017846 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017825    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy"
Sep 18 22:36:52.018040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017855    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fdb5a01-9e50-484f-9ee9-f1a3275211c7" containerName="main"
Sep 18 22:36:52.018040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017860    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fdb5a01-9e50-484f-9ee9-f1a3275211c7" containerName="main"
Sep 18 22:36:52.018040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017940    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c147a5e-dc36-4ef6-a6ff-dd71627ce1c8" containerName="istio-proxy"
Sep 18 22:36:52.018040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017959    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy"
Sep 18 22:36:52.018040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017972    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy"
Sep 18 22:36:52.018040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.017979    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fdb5a01-9e50-484f-9ee9-f1a3275211c7" containerName="main"
Sep 18 22:36:52.022275 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.022257    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.027593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.027574    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-d6c0ac-serving-cert\""
Sep 18 22:36:52.031349 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.031325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp62c\" (UniqueName: \"kubernetes.io/projected/d1600330-f0c1-447f-837c-455b0225945e-kube-api-access-sp62c\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.031452 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.031363    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.031516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.031498    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1600330-f0c1-447f-837c-455b0225945e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.031559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.031531    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.038138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.038097    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"]
Sep 18 22:36:52.100734 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.100698    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:52.133182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.133146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp62c\" (UniqueName: \"kubernetes.io/projected/d1600330-f0c1-447f-837c-455b0225945e-kube-api-access-sp62c\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.133182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.133186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.133422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.133270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1600330-f0c1-447f-837c-455b0225945e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.133422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.133292    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.133422 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:52.133389    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-serving-cert: secret "maas-api-e2e-shared-a-w3-d6c0ac-serving-cert" not found
Sep 18 22:36:52.133591 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:52.133475    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls podName:d1600330-f0c1-447f-837c-455b0225945e nodeName:}" failed. No retries permitted until 2026-09-18 22:36:52.633453883 +0000 UTC m=+1203.211399011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls") pod "maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" (UID: "d1600330-f0c1-447f-837c-455b0225945e") : secret "maas-api-e2e-shared-a-w3-d6c0ac-serving-cert" not found
Sep 18 22:36:52.133932 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.133902    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1600330-f0c1-447f-837c-455b0225945e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.135895 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.135877    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.143381 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.143355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp62c\" (UniqueName: \"kubernetes.io/projected/d1600330-f0c1-447f-837c-455b0225945e-kube-api-access-sp62c\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.190982 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.190946    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:52.600805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.600440    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:52.639818 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.639769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:52.639982 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:52.639948    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-serving-cert: secret "maas-api-e2e-shared-a-w3-d6c0ac-serving-cert" not found
Sep 18 22:36:52.640032 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:36:52.640027    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls podName:d1600330-f0c1-447f-837c-455b0225945e nodeName:}" failed. No retries permitted until 2026-09-18 22:36:53.640006609 +0000 UTC m=+1204.217951750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls") pod "maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" (UID: "d1600330-f0c1-447f-837c-455b0225945e") : secret "maas-api-e2e-shared-a-w3-d6c0ac-serving-cert" not found
Sep 18 22:36:52.727088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.727053    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:52.892288 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:52.892179    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:53.105077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:53.105044    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:53.409002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:53.408966    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fdb5a01-9e50-484f-9ee9-f1a3275211c7" path="/var/lib/kubelet/pods/9fdb5a01-9e50-484f-9ee9-f1a3275211c7/volumes"
Sep 18 22:36:53.650181 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:53.650145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:53.652812 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:53.652770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:53.833598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:53.833572    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:54.095864 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:54.092892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:54.136515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:54.136488    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"]
Sep 18 22:36:54.138390 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:36:54.138363    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1600330_f0c1_447f_837c_455b0225945e.slice/crio-9a5ed9791d94ba4f00577f3356ef8f4296cbebe76f13e5722cbd51f70ae2d1d6 WatchSource:0}: Error finding container 9a5ed9791d94ba4f00577f3356ef8f4296cbebe76f13e5722cbd51f70ae2d1d6: Status 404 returned error can't find the container with id 9a5ed9791d94ba4f00577f3356ef8f4296cbebe76f13e5722cbd51f70ae2d1d6
Sep 18 22:36:54.139904 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:54.139884    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:36:54.951294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:54.951260    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" event={"ID":"d1600330-f0c1-447f-837c-455b0225945e","Type":"ContainerStarted","Data":"db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9"}
Sep 18 22:36:54.951750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:54.951320    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" event={"ID":"d1600330-f0c1-447f-837c-455b0225945e","Type":"ContainerStarted","Data":"9a5ed9791d94ba4f00577f3356ef8f4296cbebe76f13e5722cbd51f70ae2d1d6"}
Sep 18 22:36:54.951750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:54.951384    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:36:54.976672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:54.976620    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" podStartSLOduration=3.564274551 podStartE2EDuration="3.97660595s" totalImagesPullingTime="412.331399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:36:54.974138208 +0000 UTC m=+1205.552083391" watchObservedRunningTime="2026-09-18 22:36:54.97660595 +0000 UTC m=+1205.554551124"
Sep 18 22:36:55.365142 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.365107    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"]
Sep 18 22:36:55.365598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.365585    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy"
Sep 18 22:36:55.365653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.365600    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f0193c-13f8-4e86-abb7-b4a3415e4b8a" containerName="istio-proxy"
Sep 18 22:36:55.374384 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.374357    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.377278 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.377178    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-c5fdd3\"/\"distinct-2-w0-c5fdd3-kserve-self-signed-certs\""
Sep 18 22:36:55.377445 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.377353    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-c5fdd3\"/\"openshift-service-ca.crt\""
Sep 18 22:36:55.377901 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.377877    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-c5fdd3\"/\"default-dockercfg-x8nc2\""
Sep 18 22:36:55.378010 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.377907    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-c5fdd3\"/\"kube-root-ca.crt\""
Sep 18 22:36:55.385333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.379726    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"]
Sep 18 22:36:55.475122 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.475091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf75l\" (UniqueName: \"kubernetes.io/projected/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-kube-api-access-gf75l\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.475314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.475184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-model-cache\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.475314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.475220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tmp-dir\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.475314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.475246    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-home\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.475314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.475305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-dshm\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.475458 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.475370    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tls-certs\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.556483 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.556435    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:55.576789 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.576750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tls-certs\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.576924 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.576829    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf75l\" (UniqueName: \"kubernetes.io/projected/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-kube-api-access-gf75l\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.576968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.576924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-model-cache\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.576968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.576962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tmp-dir\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.577074 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.576992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-home\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.577074 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.577021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-dshm\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.577354 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.577333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-model-cache\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.577439 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.577352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tmp-dir\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.577439 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.577413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-home\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.596804 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.586337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tls-certs\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.604473 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.603041    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-dshm\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.606923 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.605726    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf75l\" (UniqueName: \"kubernetes.io/projected/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-kube-api-access-gf75l\") pod \"distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") " pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.694691 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.694596    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:36:55.977768 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:55.977712    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"]
Sep 18 22:36:55.980398 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:36:55.980368    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6abb33b3_ad46_44ee_a8f5_c9e7da06a280.slice/crio-79ce86c22b3a0b01e2ad169ce341060dad331651052f1ec5aac56996c993bfc7 WatchSource:0}: Error finding container 79ce86c22b3a0b01e2ad169ce341060dad331651052f1ec5aac56996c993bfc7: Status 404 returned error can't find the container with id 79ce86c22b3a0b01e2ad169ce341060dad331651052f1ec5aac56996c993bfc7
Sep 18 22:36:56.967118 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:56.967082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r" event={"ID":"6abb33b3-ad46-44ee-a8f5-c9e7da06a280","Type":"ContainerStarted","Data":"a603d601dc6b7f10327dea680812ee622cad8344013ac110601a2b355e1e64c5"}
Sep 18 22:36:56.967118 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:56.967122    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r" event={"ID":"6abb33b3-ad46-44ee-a8f5-c9e7da06a280","Type":"ContainerStarted","Data":"79ce86c22b3a0b01e2ad169ce341060dad331651052f1ec5aac56996c993bfc7"}
Sep 18 22:36:57.007578 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:57.007520    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r" podStartSLOduration=2.007502547 podStartE2EDuration="2.007502547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:36:57.00708034 +0000 UTC m=+1207.585025487" watchObservedRunningTime="2026-09-18 22:36:57.007502547 +0000 UTC m=+1207.585447692"
Sep 18 22:36:58.980492 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:58.980460    2570 generic.go:356] "Generic (PLEG): container finished" podID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerID="1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b" exitCode=0
Sep 18 22:36:58.980855 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:58.980542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" event={"ID":"1dae59c6-d984-4404-90a6-6acb52ff2b34","Type":"ContainerDied","Data":"1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b"}
Sep 18 22:36:58.981208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:58.981190    2570 scope.go:117] "RemoveContainer" containerID="1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b"
Sep 18 22:36:58.982541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:58.982516    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:58.982629 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:58.982585    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:58.982629 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:58.982614    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:36:59.254836 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:59.254724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:36:59.992702 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:36:59.992656    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" event={"ID":"1dae59c6-d984-4404-90a6-6acb52ff2b34","Type":"ContainerStarted","Data":"c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11"}
Sep 18 22:37:00.701025 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:00.700984    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:37:00.701236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:00.701150    2570 patch_prober.go:28] interesting pod/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 18 22:37:00.701236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:00.701199    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 18 22:37:00.963539 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:00.963453    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:37:01.700305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:01.700261    2570 patch_prober.go:28] interesting pod/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 18 22:37:01.700825 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:01.700333    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 18 22:37:02.700283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:02.700233    2570 patch_prober.go:28] interesting pod/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 18 22:37:02.700501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:02.700309    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 18 22:37:03.701185 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:03.701140    2570 patch_prober.go:28] interesting pod/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 18 22:37:03.701810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:03.701214    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 18 22:37:04.700206 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:04.700170    2570 patch_prober.go:28] interesting pod/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 18 22:37:04.700504 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:04.700475    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 18 22:37:05.695346 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:05.695295    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:37:05.695758 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:05.695385    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:37:05.704043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:05.704021    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:37:05.704481 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:05.704464    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:37:05.705234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:05.705213    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:37:05.708254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:05.708235    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:37:06.041589 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:06.041514    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:37:13.797561 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:13.797523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:15.993845 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:15.993810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:16.780591 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:16.780538    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:16.880689 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:16.880658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:17.256949 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:17.256905    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:17.579247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:17.579146    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:17.676942 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:17.676911    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:17.777734 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:17.777701    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:18.518939 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:18.518894    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:19.409036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:19.409005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:20.123857 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.123817    2570 generic.go:356] "Generic (PLEG): container finished" podID="864c90bb-ec66-4327-b61e-9483ee26de88" containerID="7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470" exitCode=0
Sep 18 22:37:20.124287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.123883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" event={"ID":"864c90bb-ec66-4327-b61e-9483ee26de88","Type":"ContainerDied","Data":"7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470"}
Sep 18 22:37:20.124377 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.124347    2570 scope.go:117] "RemoveContainer" containerID="7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470"
Sep 18 22:37:20.125622 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.125593    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:37:20.125683 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.125666    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:37:20.125720 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.125705    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:37:20.133049 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.133025    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:20.660514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.660488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:20.755352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:20.755321    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:21.131797 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:21.131744    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" event={"ID":"864c90bb-ec66-4327-b61e-9483ee26de88","Type":"ContainerStarted","Data":"b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a"}
Sep 18 22:37:21.225160 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:21.225120    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:37:21.225373 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:21.225351    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 18 22:37:21.225432 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:21.225411    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 18 22:37:21.390824 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:21.390659    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:22.193713 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:22.193678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:22.226001 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:22.225970    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 18 22:37:22.226177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:22.226042    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 18 22:37:22.288033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:22.287994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:22.708044 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:22.708013    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:22.805024 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:22.804992    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:23.226147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:23.226111    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 18 22:37:23.226621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:23.226185    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 18 22:37:23.233879 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:23.233853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:24.047054 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:24.047024    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:24.225663 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:24.225627    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 18 22:37:24.225876 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:24.225687    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 18 22:37:24.879412 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:24.879378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:25.226321 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:25.226236    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 18 22:37:25.226321 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:25.226291    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 18 22:37:25.795838 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:25.795804    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:26.276872 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:26.276839    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:37:26.277363 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:26.277232    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:37:26.279967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:26.279936    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:37:26.704808 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:26.704731    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:27.603227 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:27.603186    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:49.914773 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:49.914662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:51.047863 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:51.047828    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:51.611052 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:51.611015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:52.593836 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:52.593806    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:53.485222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:53.485192    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:54.501615 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:54.501582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:55.210582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:55.210549    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:37:56.417824 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:37:56.417752    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:38:08.240877 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:08.240843    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:38:14.499003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:14.498972    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"]
Sep 18 22:38:14.521941 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:14.521908    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:38:24.008668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:24.008633    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:38:24.108383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:24.108348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:38:29.519188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.519142    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd" podUID="550538fa-76ee-4569-9d13-e53d82451dfd" containerName="main" containerID="cri-o://1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4" gracePeriod=45
Sep 18 22:38:29.551380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.551349    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"]
Sep 18 22:38:29.555043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.555024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.557548 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.557527    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"kube-root-ca.crt\""
Sep 18 22:38:29.557672 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.557627    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"default-dockercfg-lph27\""
Sep 18 22:38:29.558450 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.558433    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"auth-test-model-d6c0ac-kserve-self-signed-certs\""
Sep 18 22:38:29.558535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.558484    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"openshift-service-ca.crt\""
Sep 18 22:38:29.564324 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.564300    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"]
Sep 18 22:38:29.580301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.580276    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:38:29.592205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.592179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-model-cache\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.592319 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.592218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9kj9\" (UniqueName: \"kubernetes.io/projected/fe14ff72-36d6-4a95-8693-6599dd8f1f38-kube-api-access-j9kj9\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.592841 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.592814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-dshm\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.592938 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.592918    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-home\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.592993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.592981    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tmp-dir\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.593047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.593012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tls-certs\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.694568 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.694531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9kj9\" (UniqueName: \"kubernetes.io/projected/fe14ff72-36d6-4a95-8693-6599dd8f1f38-kube-api-access-j9kj9\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.694736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.694587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-dshm\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.694736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.694651    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-home\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.694736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.694691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tmp-dir\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.694736 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.694713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tls-certs\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.695041 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.694879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-model-cache\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.695174 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.695145    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-home\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.695282 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.695259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tmp-dir\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.695361 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.695298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-model-cache\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.697763 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.697742    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-dshm\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.698027 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.698002    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tls-certs\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.702933 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.702910    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9kj9\" (UniqueName: \"kubernetes.io/projected/fe14ff72-36d6-4a95-8693-6599dd8f1f38-kube-api-access-j9kj9\") pod \"auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.781516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.781461    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:38:29.892359 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.892329    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:29.897435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897415    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dghhw\" (UniqueName: \"kubernetes.io/projected/550538fa-76ee-4569-9d13-e53d82451dfd-kube-api-access-dghhw\") pod \"550538fa-76ee-4569-9d13-e53d82451dfd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") "
Sep 18 22:38:29.897532 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897520    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550538fa-76ee-4569-9d13-e53d82451dfd-tls-certs\") pod \"550538fa-76ee-4569-9d13-e53d82451dfd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") "
Sep 18 22:38:29.897578 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897551    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-tmp-dir\") pod \"550538fa-76ee-4569-9d13-e53d82451dfd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") "
Sep 18 22:38:29.897632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897595    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-dshm\") pod \"550538fa-76ee-4569-9d13-e53d82451dfd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") "
Sep 18 22:38:29.897632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897624    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-model-cache\") pod \"550538fa-76ee-4569-9d13-e53d82451dfd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") "
Sep 18 22:38:29.897747 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897672    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-home\") pod \"550538fa-76ee-4569-9d13-e53d82451dfd\" (UID: \"550538fa-76ee-4569-9d13-e53d82451dfd\") "
Sep 18 22:38:29.897988 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897855    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "550538fa-76ee-4569-9d13-e53d82451dfd" (UID: "550538fa-76ee-4569-9d13-e53d82451dfd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:29.897988 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.897951    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-model-cache" (OuterVolumeSpecName: "model-cache") pod "550538fa-76ee-4569-9d13-e53d82451dfd" (UID: "550538fa-76ee-4569-9d13-e53d82451dfd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:29.898352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.898089    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-home" (OuterVolumeSpecName: "home") pod "550538fa-76ee-4569-9d13-e53d82451dfd" (UID: "550538fa-76ee-4569-9d13-e53d82451dfd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:29.898352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.898189    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:29.898352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.898203    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:29.898352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.898214    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:29.899975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.899956    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550538fa-76ee-4569-9d13-e53d82451dfd-kube-api-access-dghhw" (OuterVolumeSpecName: "kube-api-access-dghhw") pod "550538fa-76ee-4569-9d13-e53d82451dfd" (UID: "550538fa-76ee-4569-9d13-e53d82451dfd"). InnerVolumeSpecName "kube-api-access-dghhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:38:29.900269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.900236    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550538fa-76ee-4569-9d13-e53d82451dfd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "550538fa-76ee-4569-9d13-e53d82451dfd" (UID: "550538fa-76ee-4569-9d13-e53d82451dfd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:38:29.900269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.900236    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-dshm" (OuterVolumeSpecName: "dshm") pod "550538fa-76ee-4569-9d13-e53d82451dfd" (UID: "550538fa-76ee-4569-9d13-e53d82451dfd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:29.999365 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.999332    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/550538fa-76ee-4569-9d13-e53d82451dfd-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:29.999365 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.999362    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/550538fa-76ee-4569-9d13-e53d82451dfd-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:29.999365 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:29.999371    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dghhw\" (UniqueName: \"kubernetes.io/projected/550538fa-76ee-4569-9d13-e53d82451dfd-kube-api-access-dghhw\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:30.168643 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.168612    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"]
Sep 18 22:38:30.170495 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:38:30.170466    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe14ff72_36d6_4a95_8693_6599dd8f1f38.slice/crio-4526f7fe80a5a82cea52ddb5a56175cd850d0964f5dab3b5e18984cca7ee40b5 WatchSource:0}: Error finding container 4526f7fe80a5a82cea52ddb5a56175cd850d0964f5dab3b5e18984cca7ee40b5: Status 404 returned error can't find the container with id 4526f7fe80a5a82cea52ddb5a56175cd850d0964f5dab3b5e18984cca7ee40b5
Sep 18 22:38:30.529504 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.529414    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp" event={"ID":"fe14ff72-36d6-4a95-8693-6599dd8f1f38","Type":"ContainerStarted","Data":"f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e"}
Sep 18 22:38:30.529504 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.529467    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp" event={"ID":"fe14ff72-36d6-4a95-8693-6599dd8f1f38","Type":"ContainerStarted","Data":"4526f7fe80a5a82cea52ddb5a56175cd850d0964f5dab3b5e18984cca7ee40b5"}
Sep 18 22:38:30.530904 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.530875    2570 generic.go:356] "Generic (PLEG): container finished" podID="550538fa-76ee-4569-9d13-e53d82451dfd" containerID="1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4" exitCode=0
Sep 18 22:38:30.531029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.530925    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"
Sep 18 22:38:30.531029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.530958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd" event={"ID":"550538fa-76ee-4569-9d13-e53d82451dfd","Type":"ContainerDied","Data":"1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4"}
Sep 18 22:38:30.531029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.531007    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd" event={"ID":"550538fa-76ee-4569-9d13-e53d82451dfd","Type":"ContainerDied","Data":"a9142b657c39f7c4bee9eeea3799ac3faadb123aa19a0bfb9ef079b4bdb82085"}
Sep 18 22:38:30.531029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.531025    2570 scope.go:117] "RemoveContainer" containerID="1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4"
Sep 18 22:38:30.545214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.545199    2570 scope.go:117] "RemoveContainer" containerID="1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4"
Sep 18 22:38:30.545486 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:38:30.545464    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4\": container with ID starting with 1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4 not found: ID does not exist" containerID="1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4"
Sep 18 22:38:30.545576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.545493    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4"} err="failed to get container status \"1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4\": rpc error: code = NotFound desc = could not find container \"1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4\": container with ID starting with 1e65dceade634e0a6645d0ac3fc9446e64207c9d128b005e1381dd5295805ab4 not found: ID does not exist"
Sep 18 22:38:30.550326 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.550285    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp" podStartSLOduration=1.550270668 podStartE2EDuration="1.550270668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:38:30.548510993 +0000 UTC m=+1301.126456138" watchObservedRunningTime="2026-09-18 22:38:30.550270668 +0000 UTC m=+1301.128215815"
Sep 18 22:38:30.563220 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.563195    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"]
Sep 18 22:38:30.567396 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:30.567368    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-b-24c2dd45-kserve-7597b7f599-2gmcd"]
Sep 18 22:38:31.404927 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:31.404897    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550538fa-76ee-4569-9d13-e53d82451dfd" path="/var/lib/kubelet/pods/550538fa-76ee-4569-9d13-e53d82451dfd/volumes"
Sep 18 22:38:31.931130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:31.931098    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"]
Sep 18 22:38:31.946741 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:31.946712    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:38:39.893502 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:39.893467    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:39.893905 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:39.893516    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:39.906373 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:39.906349    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:40.608728 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:40.608695    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:38:46.951740 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:46.951680    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt" podUID="fec1f474-a8ca-4335-9909-7174243b3634" containerName="main" containerID="cri-o://1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702" gracePeriod=45
Sep 18 22:38:47.213800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.213714    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:38:47.384977 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.384938    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfr2v\" (UniqueName: \"kubernetes.io/projected/fec1f474-a8ca-4335-9909-7174243b3634-kube-api-access-lfr2v\") pod \"fec1f474-a8ca-4335-9909-7174243b3634\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") "
Sep 18 22:38:47.385151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385068    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-tmp-dir\") pod \"fec1f474-a8ca-4335-9909-7174243b3634\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") "
Sep 18 22:38:47.385151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385121    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-dshm\") pod \"fec1f474-a8ca-4335-9909-7174243b3634\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") "
Sep 18 22:38:47.385252 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385180    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-home\") pod \"fec1f474-a8ca-4335-9909-7174243b3634\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") "
Sep 18 22:38:47.385252 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385209    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-model-cache\") pod \"fec1f474-a8ca-4335-9909-7174243b3634\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") "
Sep 18 22:38:47.385252 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385243    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec1f474-a8ca-4335-9909-7174243b3634-tls-certs\") pod \"fec1f474-a8ca-4335-9909-7174243b3634\" (UID: \"fec1f474-a8ca-4335-9909-7174243b3634\") "
Sep 18 22:38:47.385417 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385345    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fec1f474-a8ca-4335-9909-7174243b3634" (UID: "fec1f474-a8ca-4335-9909-7174243b3634"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:47.385482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385445    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-model-cache" (OuterVolumeSpecName: "model-cache") pod "fec1f474-a8ca-4335-9909-7174243b3634" (UID: "fec1f474-a8ca-4335-9909-7174243b3634"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:47.385482 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385463    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-home" (OuterVolumeSpecName: "home") pod "fec1f474-a8ca-4335-9909-7174243b3634" (UID: "fec1f474-a8ca-4335-9909-7174243b3634"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:47.385973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385953    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:47.385973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385970    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:47.385973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.385979    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:47.387395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.387373    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-dshm" (OuterVolumeSpecName: "dshm") pod "fec1f474-a8ca-4335-9909-7174243b3634" (UID: "fec1f474-a8ca-4335-9909-7174243b3634"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:38:47.387395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.387381    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec1f474-a8ca-4335-9909-7174243b3634-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fec1f474-a8ca-4335-9909-7174243b3634" (UID: "fec1f474-a8ca-4335-9909-7174243b3634"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:38:47.387534 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.387439    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec1f474-a8ca-4335-9909-7174243b3634-kube-api-access-lfr2v" (OuterVolumeSpecName: "kube-api-access-lfr2v") pod "fec1f474-a8ca-4335-9909-7174243b3634" (UID: "fec1f474-a8ca-4335-9909-7174243b3634"). InnerVolumeSpecName "kube-api-access-lfr2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:38:47.486766 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.486685    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfr2v\" (UniqueName: \"kubernetes.io/projected/fec1f474-a8ca-4335-9909-7174243b3634-kube-api-access-lfr2v\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:47.486766 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.486714    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec1f474-a8ca-4335-9909-7174243b3634-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:47.486766 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.486726    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec1f474-a8ca-4335-9909-7174243b3634-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:38:47.639873 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.639833    2570 generic.go:356] "Generic (PLEG): container finished" podID="fec1f474-a8ca-4335-9909-7174243b3634" containerID="1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702" exitCode=0
Sep 18 22:38:47.639873 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.639876    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"
Sep 18 22:38:47.640070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.639915    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt" event={"ID":"fec1f474-a8ca-4335-9909-7174243b3634","Type":"ContainerDied","Data":"1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702"}
Sep 18 22:38:47.640070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.639962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt" event={"ID":"fec1f474-a8ca-4335-9909-7174243b3634","Type":"ContainerDied","Data":"ab753a04f5f3aef6cf856130d6d5221c0186f2e10f8451ef55410dc810e3709a"}
Sep 18 22:38:47.640070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.639984    2570 scope.go:117] "RemoveContainer" containerID="1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702"
Sep 18 22:38:47.650345 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.650325    2570 scope.go:117] "RemoveContainer" containerID="1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702"
Sep 18 22:38:47.650660 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:38:47.650644    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702\": container with ID starting with 1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702 not found: ID does not exist" containerID="1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702"
Sep 18 22:38:47.650720 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.650677    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702"} err="failed to get container status \"1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702\": rpc error: code = NotFound desc = could not find container \"1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702\": container with ID starting with 1c639788295377621cb39867c6d4b8d208e97c268f62ee980c86d1576b406702 not found: ID does not exist"
Sep 18 22:38:47.657278 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.657246    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"]
Sep 18 22:38:47.662083 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:47.662060    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/e2e-conflict-a-24c2dd45-kserve-6c7bc56897-9v8kt"]
Sep 18 22:38:49.404299 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:49.404259    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec1f474-a8ca-4335-9909-7174243b3634" path="/var/lib/kubelet/pods/fec1f474-a8ca-4335-9909-7174243b3634/volumes"
Sep 18 22:38:59.808967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:38:59.808934    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:00.938711 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:00.938673    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:01.829274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:01.829240    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:02.895162 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:02.895072    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:03.748486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:03.748451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:04.611671 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:04.611637    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:05.507943 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:05.507908    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:06.392647 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:06.392614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:07.118529 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:07.118494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:08.030505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:08.030473    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:11.448118 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.448080    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"]
Sep 18 22:39:11.448639 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.448622    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550538fa-76ee-4569-9d13-e53d82451dfd" containerName="main"
Sep 18 22:39:11.448685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.448641    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="550538fa-76ee-4569-9d13-e53d82451dfd" containerName="main"
Sep 18 22:39:11.448685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.448666    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec1f474-a8ca-4335-9909-7174243b3634" containerName="main"
Sep 18 22:39:11.448685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.448671    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec1f474-a8ca-4335-9909-7174243b3634" containerName="main"
Sep 18 22:39:11.448798 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.448743    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec1f474-a8ca-4335-9909-7174243b3634" containerName="main"
Sep 18 22:39:11.448798 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.448754    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="550538fa-76ee-4569-9d13-e53d82451dfd" containerName="main"
Sep 18 22:39:11.452072 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.452047    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.455301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.455273    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"distinct-w4-f9cf33-kserve-self-signed-certs\""
Sep 18 22:39:11.461487 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.461455    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"]
Sep 18 22:39:11.475746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.475722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:11.540287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.540257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-dshm\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.540436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.540293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjmxl\" (UniqueName: \"kubernetes.io/projected/7eb68617-c0e7-44c4-9267-f85c0e6094b4-kube-api-access-gjmxl\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.540436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.540366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tls-certs\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.540436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.540408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-home\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.540558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.540513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tmp-dir\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.540558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.540548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-model-cache\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.641664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.641625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tmp-dir\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.641898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.641678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-model-cache\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.641898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.641750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-dshm\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.641898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.641817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjmxl\" (UniqueName: \"kubernetes.io/projected/7eb68617-c0e7-44c4-9267-f85c0e6094b4-kube-api-access-gjmxl\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.641898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.641876    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tls-certs\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.642140 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.641921    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-home\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.642140 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.642126    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tmp-dir\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.642246 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.642188    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-model-cache\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.642246 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.642241    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-home\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.644327 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.644311    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-dshm\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.644460 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.644441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tls-certs\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.655319 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.655298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjmxl\" (UniqueName: \"kubernetes.io/projected/7eb68617-c0e7-44c4-9267-f85c0e6094b4-kube-api-access-gjmxl\") pod \"distinct-w4-f9cf33-kserve-5688b96597-tm8l2\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:11.763297 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:11.763217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:12.054710 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:12.054686    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"]
Sep 18 22:39:12.056383 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:39:12.056355    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7eb68617_c0e7_44c4_9267_f85c0e6094b4.slice/crio-100b9b8427c5589036c76308a38696896da9a0a5f9d60434081cf916ede4027d WatchSource:0}: Error finding container 100b9b8427c5589036c76308a38696896da9a0a5f9d60434081cf916ede4027d: Status 404 returned error can't find the container with id 100b9b8427c5589036c76308a38696896da9a0a5f9d60434081cf916ede4027d
Sep 18 22:39:12.780028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:12.779985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2" event={"ID":"7eb68617-c0e7-44c4-9267-f85c0e6094b4","Type":"ContainerStarted","Data":"58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d"}
Sep 18 22:39:12.780416 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:12.780049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2" event={"ID":"7eb68617-c0e7-44c4-9267-f85c0e6094b4","Type":"ContainerStarted","Data":"100b9b8427c5589036c76308a38696896da9a0a5f9d60434081cf916ede4027d"}
Sep 18 22:39:12.799048 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:12.798997    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2" podStartSLOduration=1.798980091 podStartE2EDuration="1.798980091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:39:12.796588072 +0000 UTC m=+1343.374533220" watchObservedRunningTime="2026-09-18 22:39:12.798980091 +0000 UTC m=+1343.376925235"
Sep 18 22:39:16.325547 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:16.325504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:16.518392 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:16.518343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:16.682147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:16.682120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:16.800298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:16.800266    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:16.890115 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:16.890088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:17.231130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:17.231100    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:18.148876 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:18.148817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:18.844746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:18.844714    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:19.698818 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:19.698757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:20.003170 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:20.003077    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:20.853451 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:20.853410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:21.628385 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:21.628348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:21.764366 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:21.764325    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:21.764551 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:21.764383    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:21.776667 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:21.776646    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:21.841377 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:21.841348    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:39:22.618790 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:22.618751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:25.057225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:25.057191    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:42.110763 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:42.110730    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:42.460680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:42.460587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:43.321970 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:43.321927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:45.720125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:45.720085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:39:45.784449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:39:45.784419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:00.624686 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.624648    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"]
Sep 18 22:40:00.637139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.637111    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.640062 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.640038    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f9cf33\"/\"distinct-2-w4-f9cf33-kserve-self-signed-certs\""
Sep 18 22:40:00.641882 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.641843    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"]
Sep 18 22:40:00.663752 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.663726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:00.670070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.670041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-home\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.670157 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.670077    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-dshm\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.670157 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.670098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frzkh\" (UniqueName: \"kubernetes.io/projected/10989eef-81ef-4632-b7ad-713352a2d3e3-kube-api-access-frzkh\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.670298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.670277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-model-cache\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.670358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.670318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10989eef-81ef-4632-b7ad-713352a2d3e3-tls-certs\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.670415 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.670361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-tmp-dir\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.771559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.771524    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-dshm\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.771559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.771565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzkh\" (UniqueName: \"kubernetes.io/projected/10989eef-81ef-4632-b7ad-713352a2d3e3-kube-api-access-frzkh\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.771879 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.771657    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-model-cache\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.771879 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.771685    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10989eef-81ef-4632-b7ad-713352a2d3e3-tls-certs\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.771879 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.771707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-tmp-dir\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.771879 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.771769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-home\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.772137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.772114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-model-cache\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.772177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.772160    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-home\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.772221 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.772184    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-tmp-dir\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.774037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.774017    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-dshm\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.774302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.774285    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10989eef-81ef-4632-b7ad-713352a2d3e3-tls-certs\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.781031 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.781006    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frzkh\" (UniqueName: \"kubernetes.io/projected/10989eef-81ef-4632-b7ad-713352a2d3e3-kube-api-access-frzkh\") pod \"distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") " pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:00.949816 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:00.949707    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:01.228149 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:01.228124    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"]
Sep 18 22:40:01.230053 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:40:01.230024    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10989eef_81ef_4632_b7ad_713352a2d3e3.slice/crio-e824aded6a7aceb30f12b0aa4611a5cf78a281fdb5383088522462394c01e881 WatchSource:0}: Error finding container e824aded6a7aceb30f12b0aa4611a5cf78a281fdb5383088522462394c01e881: Status 404 returned error can't find the container with id e824aded6a7aceb30f12b0aa4611a5cf78a281fdb5383088522462394c01e881
Sep 18 22:40:01.966121 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:01.966094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:02.085814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:02.085761    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5" event={"ID":"10989eef-81ef-4632-b7ad-713352a2d3e3","Type":"ContainerStarted","Data":"2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5"}
Sep 18 22:40:02.085814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:02.085821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5" event={"ID":"10989eef-81ef-4632-b7ad-713352a2d3e3","Type":"ContainerStarted","Data":"e824aded6a7aceb30f12b0aa4611a5cf78a281fdb5383088522462394c01e881"}
Sep 18 22:40:02.144851 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:02.144794    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5" podStartSLOduration=2.144766706 podStartE2EDuration="2.144766706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:40:02.14234865 +0000 UTC m=+1392.720293794" watchObservedRunningTime="2026-09-18 22:40:02.144766706 +0000 UTC m=+1392.722711848"
Sep 18 22:40:02.530298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:02.530247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:08.605108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:08.605074    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:10.950936 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:10.950894    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:10.951330 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:10.950953    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:10.963587 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:10.963557    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:11.148807 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:11.148748    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:40:13.683502 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:13.683470    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:13.761403 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:13.761370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:19.319952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:19.319914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:23.516759 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:23.516722    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:23.616070 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:23.616034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:23.767445 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:23.767364    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"]
Sep 18 22:40:23.767660 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:23.767635    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy" containerID="cri-o://c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11" gracePeriod=30
Sep 18 22:40:23.791128 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:23.791096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:25.029903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:25.029864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:25.121505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:25.121453    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:25.222100 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:25.222070    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:25.826098 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:25.826052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:25.994484 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:25.994452    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:27.357974 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:27.357933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:29.023844 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.023818    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:40:29.172864 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.172828    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-envoy\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.172873    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dae59c6-d984-4404-90a6-6acb52ff2b34-istiod-ca-cert\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.172910    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-credential-socket\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.172945    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-token\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.172979    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-certs\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-socket\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173042    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-data\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173077    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qdlq\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-kube-api-access-4qdlq\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173203    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-podinfo\") pod \"1dae59c6-d984-4404-90a6-6acb52ff2b34\" (UID: \"1dae59c6-d984-4404-90a6-6acb52ff2b34\") "
Sep 18 22:40:29.173367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173269    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:29.173367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173292    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:29.173367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173316    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:29.173367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173354    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-data" (OuterVolumeSpecName: "istio-data") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:29.173692 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173474    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dae59c6-d984-4404-90a6-6acb52ff2b34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:40:29.173737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173694    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dae59c6-d984-4404-90a6-6acb52ff2b34-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.173737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173713    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.173737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173728    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.173900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173741    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.173900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.173753    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.175572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.175552    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:40:29.175572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.175553    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-kube-api-access-4qdlq" (OuterVolumeSpecName: "kube-api-access-4qdlq") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "kube-api-access-4qdlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:40:29.175897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.175879    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:40:29.175957 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.175878    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-token" (OuterVolumeSpecName: "istio-token") pod "1dae59c6-d984-4404-90a6-6acb52ff2b34" (UID: "1dae59c6-d984-4404-90a6-6acb52ff2b34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:40:29.237845 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.237818    2570 generic.go:356] "Generic (PLEG): container finished" podID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerID="c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11" exitCode=0
Sep 18 22:40:29.238000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.237856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" event={"ID":"1dae59c6-d984-4404-90a6-6acb52ff2b34","Type":"ContainerDied","Data":"c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11"}
Sep 18 22:40:29.238000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.237913    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt" event={"ID":"1dae59c6-d984-4404-90a6-6acb52ff2b34","Type":"ContainerDied","Data":"d7d8efba4a98db305b44ba3f38f94450488d7c20cd9ffd86bcc0c47fef2de37e"}
Sep 18 22:40:29.238000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.237924    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"
Sep 18 22:40:29.238000 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.237944    2570 scope.go:117] "RemoveContainer" containerID="c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11"
Sep 18 22:40:29.251722 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.251702    2570 scope.go:117] "RemoveContainer" containerID="1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b"
Sep 18 22:40:29.260685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.260669    2570 scope.go:117] "RemoveContainer" containerID="c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11"
Sep 18 22:40:29.260974 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:40:29.260944    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11\": container with ID starting with c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11 not found: ID does not exist" containerID="c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11"
Sep 18 22:40:29.261033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.260982    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11"} err="failed to get container status \"c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11\": rpc error: code = NotFound desc = could not find container \"c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11\": container with ID starting with c77c0548256bfc7cefde429752ab53a51a3dfc08f9e64eb3fd3a0f901cc17e11 not found: ID does not exist"
Sep 18 22:40:29.261033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.260999    2570 scope.go:117] "RemoveContainer" containerID="1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b"
Sep 18 22:40:29.261270 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:40:29.261251    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b\": container with ID starting with 1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b not found: ID does not exist" containerID="1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b"
Sep 18 22:40:29.261314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.261277    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b"} err="failed to get container status \"1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b\": rpc error: code = NotFound desc = could not find container \"1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b\": container with ID starting with 1782c13a48f266d3facfd165f32966dabf471a3883e37b116e28a7dd2899472b not found: ID does not exist"
Sep 18 22:40:29.269532 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.269508    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"]
Sep 18 22:40:29.275232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.275210    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qdlq\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-kube-api-access-4qdlq\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.275323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.275236    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.275323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.275250    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.275323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.275261    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dae59c6-d984-4404-90a6-6acb52ff2b34-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:40:29.289181 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.289157    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt"]
Sep 18 22:40:29.404880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:29.404847    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" path="/var/lib/kubelet/pods/1dae59c6-d984-4404-90a6-6acb52ff2b34/volumes"
Sep 18 22:40:33.483047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:33.482944    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:33.552397 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:33.552358    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:34.160967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:34.160927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:35.491023 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:35.490991    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:40.423460 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:40.423421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:40.524972 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:40.524943    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:40.623591 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:40.623552    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:40.847732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:40.847691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:51.102055 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:51.102021    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:51.341993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:51.341958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:40:57.399516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:40:57.399480    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:12.225329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:12.225286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:18.294384 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:18.294342    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:18.842997 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:18.842957    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:18.933281 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:18.933249    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:19.202637 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.202559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:19.512403 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.512317    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"]
Sep 18 22:41:19.513079 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.513058    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy"
Sep 18 22:41:19.513079 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.513082    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy"
Sep 18 22:41:19.513264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.513233    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy"
Sep 18 22:41:19.516665 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.516645    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.519447 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.519416    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-37cf0f-openshift-default-dockercfg-ds7md\""
Sep 18 22:41:19.535841 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.535809    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"]
Sep 18 22:41:19.546255 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.546235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:19.627474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.627434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-credential-socket\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.627815 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.627769    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncnhl\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-kube-api-access-ncnhl\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.627971 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.627952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-envoy\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.628117 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.628102    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-socket\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.628244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.628231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-token\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.628354 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.628341    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-data\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.628480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.628467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-certs\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.628636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.628622    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istiod-ca-cert\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.628764 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.628749    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-podinfo\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-certs\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istiod-ca-cert\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-podinfo\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-credential-socket\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730527    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncnhl\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-kube-api-access-ncnhl\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730662 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-envoy\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730662 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730631    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-certs\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730662 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730633    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-socket\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-token\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-data\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.730978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.730907    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-socket\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.731093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.731070    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-credential-socket\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.731188 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.731115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istiod-ca-cert\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.731303 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.731282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-data\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.732926 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.732895    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-envoy\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.733026 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.732961    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-podinfo\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.739652 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.739628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-token\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.740330 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.740313    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncnhl\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-kube-api-access-ncnhl\") pod \"e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") " pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.829802 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.829680    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:19.830957 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:19.830926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:20.118031 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.118003    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"]
Sep 18 22:41:20.120015 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:41:20.119985    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03ac31a_4b9f_4e95_8f63_2a349e4f48eb.slice/crio-aa07daa50a12ffaf4d3b034071a30cfcbd151a296a09e4f7ed3c031ccff6a15d WatchSource:0}: Error finding container aa07daa50a12ffaf4d3b034071a30cfcbd151a296a09e4f7ed3c031ccff6a15d: Status 404 returned error can't find the container with id aa07daa50a12ffaf4d3b034071a30cfcbd151a296a09e4f7ed3c031ccff6a15d
Sep 18 22:41:20.122507 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.122474    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:41:20.122608 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.122542    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:41:20.122608 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.122575    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:41:20.526282 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.526204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" event={"ID":"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb","Type":"ContainerStarted","Data":"587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c"}
Sep 18 22:41:20.526282 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.526256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" event={"ID":"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb","Type":"ContainerStarted","Data":"aa07daa50a12ffaf4d3b034071a30cfcbd151a296a09e4f7ed3c031ccff6a15d"}
Sep 18 22:41:20.563518 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.560749    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podStartSLOduration=1.5607279790000002 podStartE2EDuration="1.560727979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:41:20.554593235 +0000 UTC m=+1471.132538381" watchObservedRunningTime="2026-09-18 22:41:20.560727979 +0000 UTC m=+1471.138673125"
Sep 18 22:41:20.830490 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:20.830412    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:21.836448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:21.836413    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:21.896173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:21.896139    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:22.477829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:22.477766    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:22.537853 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:22.537823    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:22.538858 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:22.538834    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:41:22.588323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:22.588285    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:22.752011 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:22.751923    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:23.636732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:23.636700    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:24.498621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:24.498590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:25.284302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:25.284273    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:26.155050 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:26.154970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:26.921207 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:26.921170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:27.673028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.672997    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"]
Sep 18 22:41:27.674045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.674022    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy"
Sep 18 22:41:27.674319 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.674304    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy"
Sep 18 22:41:27.674573 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.674554    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dae59c6-d984-4404-90a6-6acb52ff2b34" containerName="istio-proxy"
Sep 18 22:41:27.678751 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.678733    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.681297 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.681267    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-37cf0f-serving-cert\""
Sep 18 22:41:27.688492 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.688472    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"]
Sep 18 22:41:27.710377 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.710351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:27.772250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.772218    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:27.819892 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.819858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809b92c-fa56-4ce8-be53-5046383ee4af-openshift-service-ca\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.820088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.819898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-metrics-certs\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.820088 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.820022    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6cpb\" (UniqueName: \"kubernetes.io/projected/1809b92c-fa56-4ce8-be53-5046383ee4af-kube-api-access-r6cpb\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.820182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.820127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-maas-api-tls\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.893138 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.893105    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:27.921310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.921272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809b92c-fa56-4ce8-be53-5046383ee4af-openshift-service-ca\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.921310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.921305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-metrics-certs\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.921881 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.921338    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6cpb\" (UniqueName: \"kubernetes.io/projected/1809b92c-fa56-4ce8-be53-5046383ee4af-kube-api-access-r6cpb\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.921881 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.921391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-maas-api-tls\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.921994 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.921955    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809b92c-fa56-4ce8-be53-5046383ee4af-openshift-service-ca\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.923900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.923845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-metrics-certs\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.924005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.923925    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-maas-api-tls\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.929478 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.929460    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6cpb\" (UniqueName: \"kubernetes.io/projected/1809b92c-fa56-4ce8-be53-5046383ee4af-kube-api-access-r6cpb\") pod \"maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:27.994969 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:27.994934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:28.180880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:28.180767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:28.285276 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:28.285246    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"]
Sep 18 22:41:28.287024 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:41:28.286992    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1809b92c_fa56_4ce8_be53_5046383ee4af.slice/crio-4bd0c7b256945827d4200eacf5e4e2a0843c0f51538f1b80fc030691c5cf6dc0 WatchSource:0}: Error finding container 4bd0c7b256945827d4200eacf5e4e2a0843c0f51538f1b80fc030691c5cf6dc0: Status 404 returned error can't find the container with id 4bd0c7b256945827d4200eacf5e4e2a0843c0f51538f1b80fc030691c5cf6dc0
Sep 18 22:41:28.301809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:28.301757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:28.580614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:28.580530    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s" event={"ID":"1809b92c-fa56-4ce8-be53-5046383ee4af","Type":"ContainerStarted","Data":"4bd0c7b256945827d4200eacf5e4e2a0843c0f51538f1b80fc030691c5cf6dc0"}
Sep 18 22:41:29.589516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:29.589478    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s" event={"ID":"1809b92c-fa56-4ce8-be53-5046383ee4af","Type":"ContainerStarted","Data":"84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6"}
Sep 18 22:41:29.589921 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:29.589668    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:29.623348 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:29.623146    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s" podStartSLOduration=2.260473691 podStartE2EDuration="2.623122431s" totalImagesPullingTime="362.64874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:41:29.622619921 +0000 UTC m=+1480.200565080" watchObservedRunningTime="2026-09-18 22:41:29.623122431 +0000 UTC m=+1480.201067577"
Sep 18 22:41:35.601926 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:35.601896    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:41:44.204518 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:44.204485    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:49.327994 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:49.327958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:51.113411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:51.113378    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:51.472355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:51.472271    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:41:51.474024 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:51.474002    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:41:51.916051 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:51.916020    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:52.509562 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:52.509532    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:52.910325 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:52.910296    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:53.079973 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.079941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:53.376792 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.376757    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"]
Sep 18 22:41:53.384121 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.384098    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.386933 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.386912    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d90856-openshift-default-dockercfg-ghsb7\""
Sep 18 22:41:53.395555 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.395529    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"]
Sep 18 22:41:53.407707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.407669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:53.487344 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.487303    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-envoy\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.487664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.487641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-credential-socket\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.487895 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.487879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-podinfo\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.488048 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.488035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-socket\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.488184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.488172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-token\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.488308 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.488296    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-data\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.488470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.488458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slgb9\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-kube-api-access-slgb9\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.488621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.488609    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-certs\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.488797 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.488760    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a023b19d-807f-4cd8-aa20-d8d81abee365-istiod-ca-cert\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.589937 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.589906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-certs\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.589966    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a023b19d-807f-4cd8-aa20-d8d81abee365-istiod-ca-cert\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.589989    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-envoy\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590013    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-credential-socket\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-podinfo\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-socket\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590104    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-token\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-data\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590219    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slgb9\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-kube-api-access-slgb9\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590382    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-certs\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590399    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-credential-socket\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590479    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-socket\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.590762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.590626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-data\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.591207 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.591187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a023b19d-807f-4cd8-aa20-d8d81abee365-istiod-ca-cert\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.592627 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.592606    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-envoy\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.592832 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.592813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-podinfo\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.598201 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.598180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slgb9\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-kube-api-access-slgb9\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.598606 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.598589    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-token\") pod \"e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") " pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.678438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.678352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:53.695998 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.695973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:53.783964 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.783880    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:53.978622 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.978597    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"]
Sep 18 22:41:53.980459 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:41:53.980433    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda023b19d_807f_4cd8_aa20_d8d81abee365.slice/crio-54fb123b058cc668e8e74079bdacf1c9cdc11c915f399e27d38d09c5f62da7c8 WatchSource:0}: Error finding container 54fb123b058cc668e8e74079bdacf1c9cdc11c915f399e27d38d09c5f62da7c8: Status 404 returned error can't find the container with id 54fb123b058cc668e8e74079bdacf1c9cdc11c915f399e27d38d09c5f62da7c8
Sep 18 22:41:53.983430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.983383    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:41:53.983538 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.983452    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:41:53.983538 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:53.983481    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:41:54.333956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:54.333919    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:54.729235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:54.729147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" event={"ID":"a023b19d-807f-4cd8-aa20-d8d81abee365","Type":"ContainerStarted","Data":"4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e"}
Sep 18 22:41:54.729235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:54.729207    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" event={"ID":"a023b19d-807f-4cd8-aa20-d8d81abee365","Type":"ContainerStarted","Data":"54fb123b058cc668e8e74079bdacf1c9cdc11c915f399e27d38d09c5f62da7c8"}
Sep 18 22:41:54.762415 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:54.762368    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" podStartSLOduration=1.762349717 podStartE2EDuration="1.762349717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:41:54.760762248 +0000 UTC m=+1505.338707393" watchObservedRunningTime="2026-09-18 22:41:54.762349717 +0000 UTC m=+1505.340294862"
Sep 18 22:41:55.184191 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:55.184164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:55.696254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:55.696224    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:55.701821 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:55.701798    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:55.734309 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:55.734285    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:55.735158 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:55.735141    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:41:56.224636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:56.224603    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:56.696184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:56.696155    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:56.791808 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:56.791759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:57.141114 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:57.141084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:58.057595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:58.057562    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:58.137385 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:58.137345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:58.416829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:58.416801    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:58.669204 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:58.669119    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:58.800750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:58.800718    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:41:59.427283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:41:59.427247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:00.414429 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:00.414397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:01.130559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:01.130526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:01.968413 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:01.968380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:02.655261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:02.655227    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:03.498913 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:03.498883    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:04.330426 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:04.330395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:13.293533 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:13.293493    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:13.395396 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:13.395352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:14.208310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:14.208278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:14.987878 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:14.987846    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:15.695431 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:15.695334    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:15.862383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:15.862345    2570 generic.go:356] "Generic (PLEG): container finished" podID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerID="587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c" exitCode=0
Sep 18 22:42:15.862560 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:15.862421    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" event={"ID":"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb","Type":"ContainerDied","Data":"587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c"}
Sep 18 22:42:15.863059 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:15.863041    2570 scope.go:117] "RemoveContainer" containerID="587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c"
Sep 18 22:42:15.866425 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:15.865113    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:42:15.866425 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:15.865281    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:42:15.866425 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:15.865375    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:42:16.462081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:16.462043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:16.870532 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:16.870502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" event={"ID":"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb","Type":"ContainerStarted","Data":"08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53"}
Sep 18 22:42:17.142337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:17.142256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:17.785517 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:17.785480    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"]
Sep 18 22:42:17.830730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:17.830696    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:42:17.830945 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:17.830910    2570 patch_prober.go:28] interesting pod/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:42:17.831008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:17.830969    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:42:17.888890 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:17.888859    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:18.021376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:18.021334    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:18.830707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:18.830675    2570 patch_prober.go:28] interesting pod/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:42:18.831193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:18.830732    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:42:18.959645 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:18.959616    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:19.830952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:19.830913    2570 patch_prober.go:28] interesting pod/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:42:19.831353 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:19.830980    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:42:19.896588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:19.896557    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:20.623434 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:20.623353    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:20.830650 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:20.830611    2570 patch_prober.go:28] interesting pod/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:42:20.830842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:20.830691    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:42:21.370946 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:21.370910    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:21.592407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:21.592371    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:21.831231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:21.831138    2570 patch_prober.go:28] interesting pod/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:42:21.831403 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:21.831233    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:42:22.317685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:22.317613    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:22.538709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:22.538672    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:42:22.830673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:22.830631    2570 patch_prober.go:28] interesting pod/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 18 22:42:22.831009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:22.830973    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 18 22:42:23.309072 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:23.309038    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:23.892428 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:23.892385    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:42:23.901305 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:23.901274    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:42:24.106455 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:24.106423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:24.924640 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:24.924612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:25.829135 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:25.829104    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:26.695374 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:26.695303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:27.530732 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:27.530696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:28.518467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:28.518438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:29.292527 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:29.292437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:30.087046 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:30.087007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:31.056561 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:31.056526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:31.998927 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:31.998892    2570 generic.go:356] "Generic (PLEG): container finished" podID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerID="4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e" exitCode=0
Sep 18 22:42:31.999332 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:31.998964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" event={"ID":"a023b19d-807f-4cd8-aa20-d8d81abee365","Type":"ContainerDied","Data":"4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e"}
Sep 18 22:42:31.999415 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:31.999401    2570 scope.go:117] "RemoveContainer" containerID="4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e"
Sep 18 22:42:32.000617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:32.000587    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:42:32.000709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:32.000655    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:42:32.000709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:32.000687    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:42:32.806489 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:32.806446    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r" podUID="6abb33b3-ad46-44ee-a8f5-c9e7da06a280" containerName="main" containerID="cri-o://a603d601dc6b7f10327dea680812ee622cad8344013ac110601a2b355e1e64c5" gracePeriod=45
Sep 18 22:42:33.030192 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.029813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" event={"ID":"a023b19d-807f-4cd8-aa20-d8d81abee365","Type":"ContainerStarted","Data":"68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef"}
Sep 18 22:42:33.032183 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.032156    2570 generic.go:356] "Generic (PLEG): container finished" podID="6abb33b3-ad46-44ee-a8f5-c9e7da06a280" containerID="a603d601dc6b7f10327dea680812ee622cad8344013ac110601a2b355e1e64c5" exitCode=0
Sep 18 22:42:33.032329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.032255    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r" event={"ID":"6abb33b3-ad46-44ee-a8f5-c9e7da06a280","Type":"ContainerDied","Data":"a603d601dc6b7f10327dea680812ee622cad8344013ac110601a2b355e1e64c5"}
Sep 18 22:42:33.077113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.077090    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:42:33.191465 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.191424    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-home\") pod \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") "
Sep 18 22:42:33.192044 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.191941    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-home" (OuterVolumeSpecName: "home") pod "6abb33b3-ad46-44ee-a8f5-c9e7da06a280" (UID: "6abb33b3-ad46-44ee-a8f5-c9e7da06a280"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:33.192250 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.192234    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf75l\" (UniqueName: \"kubernetes.io/projected/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-kube-api-access-gf75l\") pod \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") "
Sep 18 22:42:33.192738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.192721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tls-certs\") pod \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") "
Sep 18 22:42:33.193291 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.193275    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-model-cache\") pod \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") "
Sep 18 22:42:33.194969 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.194943    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tmp-dir\") pod \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") "
Sep 18 22:42:33.199043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.194879    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-model-cache" (OuterVolumeSpecName: "model-cache") pod "6abb33b3-ad46-44ee-a8f5-c9e7da06a280" (UID: "6abb33b3-ad46-44ee-a8f5-c9e7da06a280"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:33.199193 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.198864    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6abb33b3-ad46-44ee-a8f5-c9e7da06a280" (UID: "6abb33b3-ad46-44ee-a8f5-c9e7da06a280"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:33.199501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.199486    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-dshm\") pod \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\" (UID: \"6abb33b3-ad46-44ee-a8f5-c9e7da06a280\") "
Sep 18 22:42:33.200459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.200440    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:33.215768 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.213446    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-kube-api-access-gf75l" (OuterVolumeSpecName: "kube-api-access-gf75l") pod "6abb33b3-ad46-44ee-a8f5-c9e7da06a280" (UID: "6abb33b3-ad46-44ee-a8f5-c9e7da06a280"). InnerVolumeSpecName "kube-api-access-gf75l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:42:33.215993 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.215728    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:33.216105 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.216093    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:33.216721 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.216689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6abb33b3-ad46-44ee-a8f5-c9e7da06a280" (UID: "6abb33b3-ad46-44ee-a8f5-c9e7da06a280"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:42:33.218299 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.218266    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-dshm" (OuterVolumeSpecName: "dshm") pod "6abb33b3-ad46-44ee-a8f5-c9e7da06a280" (UID: "6abb33b3-ad46-44ee-a8f5-c9e7da06a280"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:33.248967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.248836    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"]
Sep 18 22:42:33.249142 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.249057    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf" podUID="98ff8d80-58b1-49cb-9d47-4396ebc12d97" containerName="maas-api" containerID="cri-o://0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679" gracePeriod=30
Sep 18 22:42:33.290848 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.287248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:33.318339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.318237    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf75l\" (UniqueName: \"kubernetes.io/projected/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-kube-api-access-gf75l\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:33.318339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.318297    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:33.318339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.318314    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6abb33b3-ad46-44ee-a8f5-c9e7da06a280-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:33.378738 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.378707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:33.491807 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.482396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:33.589064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.588709    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:33.702634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.702190    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:42:33.702634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.702312    2570 patch_prober.go:28] interesting pod/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:42:33.702634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.702371    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:42:33.757827 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.757580    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:42:33.856593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.856512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:33.928747 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.928714    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-metrics-certs\") pod \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") "
Sep 18 22:42:33.928940 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.928766    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls\") pod \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") "
Sep 18 22:42:33.928940 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.928815    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hppq\" (UniqueName: \"kubernetes.io/projected/98ff8d80-58b1-49cb-9d47-4396ebc12d97-kube-api-access-7hppq\") pod \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") "
Sep 18 22:42:33.928940 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.928865    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98ff8d80-58b1-49cb-9d47-4396ebc12d97-openshift-service-ca\") pod \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\" (UID: \"98ff8d80-58b1-49cb-9d47-4396ebc12d97\") "
Sep 18 22:42:33.929264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.929238    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98ff8d80-58b1-49cb-9d47-4396ebc12d97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "98ff8d80-58b1-49cb-9d47-4396ebc12d97" (UID: "98ff8d80-58b1-49cb-9d47-4396ebc12d97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:42:33.931230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.931197    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "98ff8d80-58b1-49cb-9d47-4396ebc12d97" (UID: "98ff8d80-58b1-49cb-9d47-4396ebc12d97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:42:33.931349 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.931209    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ff8d80-58b1-49cb-9d47-4396ebc12d97-kube-api-access-7hppq" (OuterVolumeSpecName: "kube-api-access-7hppq") pod "98ff8d80-58b1-49cb-9d47-4396ebc12d97" (UID: "98ff8d80-58b1-49cb-9d47-4396ebc12d97"). InnerVolumeSpecName "kube-api-access-7hppq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:42:33.931414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.931302    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "98ff8d80-58b1-49cb-9d47-4396ebc12d97" (UID: "98ff8d80-58b1-49cb-9d47-4396ebc12d97"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:42:33.978800 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:33.978743    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:34.030219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.030177    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:34.030219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.030218    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98ff8d80-58b1-49cb-9d47-4396ebc12d97-maas-api-tls\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:34.030219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.030227    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hppq\" (UniqueName: \"kubernetes.io/projected/98ff8d80-58b1-49cb-9d47-4396ebc12d97-kube-api-access-7hppq\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:34.030219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.030236    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98ff8d80-58b1-49cb-9d47-4396ebc12d97-openshift-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:34.040019 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.039994    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"
Sep 18 22:42:34.040257 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.040015    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r" event={"ID":"6abb33b3-ad46-44ee-a8f5-c9e7da06a280","Type":"ContainerDied","Data":"79ce86c22b3a0b01e2ad169ce341060dad331651052f1ec5aac56996c993bfc7"}
Sep 18 22:42:34.040406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.040287    2570 scope.go:117] "RemoveContainer" containerID="a603d601dc6b7f10327dea680812ee622cad8344013ac110601a2b355e1e64c5"
Sep 18 22:42:34.043153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.043112    2570 generic.go:356] "Generic (PLEG): container finished" podID="98ff8d80-58b1-49cb-9d47-4396ebc12d97" containerID="0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679" exitCode=0
Sep 18 22:42:34.047002 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.044011    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"
Sep 18 22:42:34.052930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.048510    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf" event={"ID":"98ff8d80-58b1-49cb-9d47-4396ebc12d97","Type":"ContainerDied","Data":"0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679"}
Sep 18 22:42:34.052930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.048569    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf" event={"ID":"98ff8d80-58b1-49cb-9d47-4396ebc12d97","Type":"ContainerDied","Data":"9fe4a091106a31226279b153e7850c8c50eb75c3cae83d88ff728814dc78942a"}
Sep 18 22:42:34.056632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.056360    2570 scope.go:117] "RemoveContainer" containerID="0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679"
Sep 18 22:42:34.066350 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.066301    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"]
Sep 18 22:42:34.066490 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.066344    2570 scope.go:117] "RemoveContainer" containerID="0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679"
Sep 18 22:42:34.066893 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:42:34.066873    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679\": container with ID starting with 0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679 not found: ID does not exist" containerID="0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679"
Sep 18 22:42:34.066990 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.066901    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679"} err="failed to get container status \"0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679\": rpc error: code = NotFound desc = could not find container \"0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679\": container with ID starting with 0f85ce7b421a52d2ccef666384202887a006343f325d7adb7fcba85929a6b679 not found: ID does not exist"
Sep 18 22:42:34.068910 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.068890    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-c5fdd3/distinct-2-w0-c5fdd3-kserve-6b4c7f7999-x5r5r"]
Sep 18 22:42:34.090806 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.089553    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"]
Sep 18 22:42:34.097069 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.097037    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-c5fdd3-5f84b8445b-4zvnf"]
Sep 18 22:42:34.696896 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.696853    2570 patch_prober.go:28] interesting pod/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:42:34.697107 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.696921    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:42:34.707874 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:34.707838    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:35.408051 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:35.408016    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6abb33b3-ad46-44ee-a8f5-c9e7da06a280" path="/var/lib/kubelet/pods/6abb33b3-ad46-44ee-a8f5-c9e7da06a280/volumes"
Sep 18 22:42:35.408541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:35.408446    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98ff8d80-58b1-49cb-9d47-4396ebc12d97" path="/var/lib/kubelet/pods/98ff8d80-58b1-49cb-9d47-4396ebc12d97/volumes"
Sep 18 22:42:35.696693 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:35.696595    2570 patch_prober.go:28] interesting pod/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:42:35.696987 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:35.696953    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:42:35.830506 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:35.830471    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:36.560345 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:36.560311    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:36.696919 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:36.696874    2570 patch_prober.go:28] interesting pod/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:42:36.697126 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:36.696950    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:42:37.260308 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:37.260265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:37.696960 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:37.696919    2570 patch_prober.go:28] interesting pod/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 18 22:42:37.697474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:37.696982    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 18 22:42:38.107695 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:38.107618    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:38.701523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:38.701489    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:42:38.701930 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:38.701743    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:42:38.702389 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:38.702367    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:42:38.807290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:38.807248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:40.055329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:40.055291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:40.212256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:40.212212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:40.310746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:40.310664    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"]
Sep 18 22:42:40.310978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:40.310948    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy" containerID="cri-o://a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5" gracePeriod=30
Sep 18 22:42:40.341376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:40.341338    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:43.662331 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:43.662298    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"]
Sep 18 22:42:43.697273 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:43.697238    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:43.797516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:43.797488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:43.898680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:43.898641    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:43.997229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:43.997095    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:44.107093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.107051    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s" podUID="1809b92c-fa56-4ce8-be53-5046383ee4af" containerName="maas-api" containerID="cri-o://84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6" gracePeriod=30
Sep 18 22:42:44.258494 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.258422    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:44.358620 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.358597    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:42:44.443590 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.443549    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-metrics-certs\") pod \"1809b92c-fa56-4ce8-be53-5046383ee4af\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") "
Sep 18 22:42:44.443791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.443699    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6cpb\" (UniqueName: \"kubernetes.io/projected/1809b92c-fa56-4ce8-be53-5046383ee4af-kube-api-access-r6cpb\") pod \"1809b92c-fa56-4ce8-be53-5046383ee4af\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") "
Sep 18 22:42:44.443791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.443742    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-maas-api-tls\") pod \"1809b92c-fa56-4ce8-be53-5046383ee4af\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") "
Sep 18 22:42:44.443791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.443766    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809b92c-fa56-4ce8-be53-5046383ee4af-openshift-service-ca\") pod \"1809b92c-fa56-4ce8-be53-5046383ee4af\" (UID: \"1809b92c-fa56-4ce8-be53-5046383ee4af\") "
Sep 18 22:42:44.444230 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.444201    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1809b92c-fa56-4ce8-be53-5046383ee4af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1809b92c-fa56-4ce8-be53-5046383ee4af" (UID: "1809b92c-fa56-4ce8-be53-5046383ee4af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:42:44.446123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.446096    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1809b92c-fa56-4ce8-be53-5046383ee4af" (UID: "1809b92c-fa56-4ce8-be53-5046383ee4af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:42:44.446256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.446235    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1809b92c-fa56-4ce8-be53-5046383ee4af" (UID: "1809b92c-fa56-4ce8-be53-5046383ee4af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:42:44.446301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.446256    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1809b92c-fa56-4ce8-be53-5046383ee4af-kube-api-access-r6cpb" (OuterVolumeSpecName: "kube-api-access-r6cpb") pod "1809b92c-fa56-4ce8-be53-5046383ee4af" (UID: "1809b92c-fa56-4ce8-be53-5046383ee4af"). InnerVolumeSpecName "kube-api-access-r6cpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:42:44.545337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.545248    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-maas-api-tls\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:44.545337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.545278    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809b92c-fa56-4ce8-be53-5046383ee4af-openshift-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:44.545337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.545294    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1809b92c-fa56-4ce8-be53-5046383ee4af-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:44.545337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.545308    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6cpb\" (UniqueName: \"kubernetes.io/projected/1809b92c-fa56-4ce8-be53-5046383ee4af-kube-api-access-r6cpb\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:44.995897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:44.995863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:45.114347 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.114305    2570 generic.go:356] "Generic (PLEG): container finished" podID="1809b92c-fa56-4ce8-be53-5046383ee4af" containerID="84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6" exitCode=0
Sep 18 22:42:45.114520 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.114355    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"
Sep 18 22:42:45.114520 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.114396    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s" event={"ID":"1809b92c-fa56-4ce8-be53-5046383ee4af","Type":"ContainerDied","Data":"84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6"}
Sep 18 22:42:45.114520 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.114454    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s" event={"ID":"1809b92c-fa56-4ce8-be53-5046383ee4af","Type":"ContainerDied","Data":"4bd0c7b256945827d4200eacf5e4e2a0843c0f51538f1b80fc030691c5cf6dc0"}
Sep 18 22:42:45.114520 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.114483    2570 scope.go:117] "RemoveContainer" containerID="84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6"
Sep 18 22:42:45.133240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.133221    2570 scope.go:117] "RemoveContainer" containerID="84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6"
Sep 18 22:42:45.133551 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:42:45.133529    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6\": container with ID starting with 84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6 not found: ID does not exist" containerID="84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6"
Sep 18 22:42:45.133615 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.133560    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6"} err="failed to get container status \"84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6\": rpc error: code = NotFound desc = could not find container \"84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6\": container with ID starting with 84e859cf81519206944e09f6de5a97d555bc4be87f9981beeda60b55742682d6 not found: ID does not exist"
Sep 18 22:42:45.142758 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.142735    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"]
Sep 18 22:42:45.151852 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.151819    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-37cf0f-6666bfd798-6zl6s"]
Sep 18 22:42:45.404311 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.404280    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1809b92c-fa56-4ce8-be53-5046383ee4af" path="/var/lib/kubelet/pods/1809b92c-fa56-4ce8-be53-5046383ee4af/volumes"
Sep 18 22:42:45.578108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.578041    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:42:45.656247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656215    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-envoy\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656441 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656269    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-socket\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656441 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656351    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-podinfo\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656441 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656377    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-token\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656441 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656403    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-credential-socket\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656441 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656438    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2zk4\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-kube-api-access-k2zk4\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656471    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-data\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656581    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3db8e9e-a3b4-4965-a710-4166daa84f76-istiod-ca-cert\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656612    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-certs\") pod \"a3db8e9e-a3b4-4965-a710-4166daa84f76\" (UID: \"a3db8e9e-a3b4-4965-a710-4166daa84f76\") "
Sep 18 22:42:45.656733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656613    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:45.657014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656801    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:45.657014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656878    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:45.657014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.656996    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:45.657204 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.657146    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.657204 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.657163    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.657204 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.657176    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.657204 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.657189    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.657598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.657477    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3db8e9e-a3b4-4965-a710-4166daa84f76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:42:45.658796 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.658751    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:45.659075 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.659047    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:42:45.659186 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.659096    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-kube-api-access-k2zk4" (OuterVolumeSpecName: "kube-api-access-k2zk4") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "kube-api-access-k2zk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:42:45.659186 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.659106    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3db8e9e-a3b4-4965-a710-4166daa84f76" (UID: "a3db8e9e-a3b4-4965-a710-4166daa84f76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:42:45.758383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.758344    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3db8e9e-a3b4-4965-a710-4166daa84f76-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.758383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.758382    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.758383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.758394    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.758719 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.758403    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.758719 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.758412    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2zk4\" (UniqueName: \"kubernetes.io/projected/a3db8e9e-a3b4-4965-a710-4166daa84f76-kube-api-access-k2zk4\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:45.804989 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:45.804939    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:46.123049 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.123014    2570 generic.go:356] "Generic (PLEG): container finished" podID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerID="a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5" exitCode=0
Sep 18 22:42:46.123505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.123067    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"
Sep 18 22:42:46.123505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.123109    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" event={"ID":"a3db8e9e-a3b4-4965-a710-4166daa84f76","Type":"ContainerDied","Data":"a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5"}
Sep 18 22:42:46.123505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.123172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs" event={"ID":"a3db8e9e-a3b4-4965-a710-4166daa84f76","Type":"ContainerDied","Data":"609d5637b8b4aa291220a17d1d1ea570f16cc98bf0ef8a1d031fb083baa81818"}
Sep 18 22:42:46.123505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.123205    2570 scope.go:117] "RemoveContainer" containerID="a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5"
Sep 18 22:42:46.134516 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.134497    2570 scope.go:117] "RemoveContainer" containerID="83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea"
Sep 18 22:42:46.144436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.144416    2570 scope.go:117] "RemoveContainer" containerID="a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5"
Sep 18 22:42:46.144735 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:42:46.144711    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5\": container with ID starting with a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5 not found: ID does not exist" containerID="a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5"
Sep 18 22:42:46.144822 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.144748    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5"} err="failed to get container status \"a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5\": rpc error: code = NotFound desc = could not find container \"a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5\": container with ID starting with a1562ffab6c706dcc90f164b315c80eedf96d56ad7cd9a1c25ed86d466ed4be5 not found: ID does not exist"
Sep 18 22:42:46.144822 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.144772    2570 scope.go:117] "RemoveContainer" containerID="83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea"
Sep 18 22:42:46.145070 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:42:46.145048    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea\": container with ID starting with 83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea not found: ID does not exist" containerID="83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea"
Sep 18 22:42:46.145152 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.145080    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea"} err="failed to get container status \"83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea\": rpc error: code = NotFound desc = could not find container \"83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea\": container with ID starting with 83778096e64802c8539a26cc787de510587e978d6894b9f37656ac9b5124f9ea not found: ID does not exist"
Sep 18 22:42:46.149840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.149819    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"]
Sep 18 22:42:46.153875 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.153853    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs"]
Sep 18 22:42:46.678623 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:46.678589    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:47.404247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:47.404215    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" path="/var/lib/kubelet/pods/a3db8e9e-a3b4-4965-a710-4166daa84f76/volumes"
Sep 18 22:42:47.582113 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:47.582082    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:48.288125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:48.288090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:49.089822 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:49.089793    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:49.990287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:49.990259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:51.003871 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:51.003830    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:51.246375 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:51.246342    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"]
Sep 18 22:42:51.246626 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:51.246604    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" containerID="cri-o://08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53" gracePeriod=30
Sep 18 22:42:52.342339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:52.342302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:52.994269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:52.994239    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:53.660047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:53.660013    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:53.897405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:53.897366    2570 patch_prober.go:28] interesting pod/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:42:53.897582 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:53.897445    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:42:54.488867 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:54.488827    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:55.201405 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:55.201371    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:55.891509 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:55.891460    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:56.315196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.315162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:56.510636 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.510567    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:56.511205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.511189    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:42:56.577907 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.577879    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncnhl\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-kube-api-access-ncnhl\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.577947    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-data\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.577979    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istiod-ca-cert\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578007    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-certs\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578048    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-podinfo\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578299 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578214    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-token\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578352 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578310    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:56.578407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578356    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-socket\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578385    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-credential-socket\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578426    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-envoy\") pod \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\" (UID: \"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb\") "
Sep 18 22:42:56.578514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578476    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:42:56.578638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578597    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:56.578701 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578629    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:56.578910 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578867    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:56.579246 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.578913    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.579451 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.579435    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.579603 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.579588    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.579712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.579701    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.581150 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.581124    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-kube-api-access-ncnhl" (OuterVolumeSpecName: "kube-api-access-ncnhl") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "kube-api-access-ncnhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:42:56.581333 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.581308    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:42:56.582235 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.582204    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:42:56.582431 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.582403    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" (UID: "a03ac31a-4b9f-4e95-8f63-2a349e4f48eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:42:56.642129 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.642104    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:56.681242 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.681208    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.681242 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.681232    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.681242 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.681242    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.681242 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.681249    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.681567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.681258    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncnhl\" (UniqueName: \"kubernetes.io/projected/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb-kube-api-access-ncnhl\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:42:56.793258 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:56.793151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:42:57.188467 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.188433    2570 generic.go:356] "Generic (PLEG): container finished" podID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerID="08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53" exitCode=0
Sep 18 22:42:57.188676 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.188480    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"
Sep 18 22:42:57.188676 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.188521    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" event={"ID":"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb","Type":"ContainerDied","Data":"08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53"}
Sep 18 22:42:57.188676 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.188577    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56" event={"ID":"a03ac31a-4b9f-4e95-8f63-2a349e4f48eb","Type":"ContainerDied","Data":"aa07daa50a12ffaf4d3b034071a30cfcbd151a296a09e4f7ed3c031ccff6a15d"}
Sep 18 22:42:57.188676 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.188602    2570 scope.go:117] "RemoveContainer" containerID="08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53"
Sep 18 22:42:57.198571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.198557    2570 scope.go:117] "RemoveContainer" containerID="587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c"
Sep 18 22:42:57.206674 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.206656    2570 scope.go:117] "RemoveContainer" containerID="08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53"
Sep 18 22:42:57.206993 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:42:57.206974    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53\": container with ID starting with 08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53 not found: ID does not exist" containerID="08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53"
Sep 18 22:42:57.207047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.207001    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53"} err="failed to get container status \"08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53\": rpc error: code = NotFound desc = could not find container \"08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53\": container with ID starting with 08639a668411e2baaa1603d223fe861fa77a23af15a1db8be3e351d0131e4b53 not found: ID does not exist"
Sep 18 22:42:57.207047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.207016    2570 scope.go:117] "RemoveContainer" containerID="587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c"
Sep 18 22:42:57.207251 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:42:57.207232    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c\": container with ID starting with 587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c not found: ID does not exist" containerID="587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c"
Sep 18 22:42:57.207301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.207256    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c"} err="failed to get container status \"587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c\": rpc error: code = NotFound desc = could not find container \"587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c\": container with ID starting with 587664615caa829b13848817b1055364a0b6680ec2b2f9b29f6a8c99052a758c not found: ID does not exist"
Sep 18 22:42:57.211419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.211397    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"]
Sep 18 22:42:57.216036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.216015    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56"]
Sep 18 22:42:57.403771 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.403728    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" path="/var/lib/kubelet/pods/a03ac31a-4b9f-4e95-8f63-2a349e4f48eb/volumes"
Sep 18 22:42:57.575809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:42:57.575707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:02.501314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:02.501285    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:07.149673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:07.149638    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:07.261900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:07.261861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:07.362301 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:07.362266    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:07.439211 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:07.439119    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:07.760551 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:07.760469    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:07.900031 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:07.899997    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:08.869094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:08.869063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:09.847034 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:09.846996    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:10.645451 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:10.645412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:11.443331 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:11.443283    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:12.190295 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:12.190261    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:13.654507 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:13.654474    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:13.755418 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:13.755388    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:13.909709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:13.909633    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"]
Sep 18 22:43:13.909962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:13.909933    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy" containerID="cri-o://68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef" gracePeriod=30
Sep 18 22:43:13.928432 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:13.928397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:14.414742 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:14.414696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:15.441812 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:15.441763    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:16.212567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:16.212528    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:17.004723 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:17.004693    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:17.688689 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:17.688661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:18.572793 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:18.572755    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:19.170010 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.169989    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:43:19.226985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.226901    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-podinfo\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.226985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.226975    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a023b19d-807f-4cd8-aa20-d8d81abee365-istiod-ca-cert\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227023    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-certs\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227050    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-credential-socket\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227079    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-token\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227119    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slgb9\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-kube-api-access-slgb9\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227179    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-data\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227218    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-socket\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227245    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-envoy\") pod \"a023b19d-807f-4cd8-aa20-d8d81abee365\" (UID: \"a023b19d-807f-4cd8-aa20-d8d81abee365\") "
Sep 18 22:43:19.227463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227377    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:19.227463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227387    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:19.227679 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227489    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a023b19d-807f-4cd8-aa20-d8d81abee365-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:43:19.227679 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227600    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-data" (OuterVolumeSpecName: "istio-data") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:19.227942 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.227898    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:19.228091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.228008    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a023b19d-807f-4cd8-aa20-d8d81abee365-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.228091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.228031    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.228091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.228045    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.228091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.228060    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.228091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.228073    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.229576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.229550    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-token" (OuterVolumeSpecName: "istio-token") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:43:19.229685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.229609    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:43:19.229685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.229638    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:19.229771 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.229741    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-kube-api-access-slgb9" (OuterVolumeSpecName: "kube-api-access-slgb9") pod "a023b19d-807f-4cd8-aa20-d8d81abee365" (UID: "a023b19d-807f-4cd8-aa20-d8d81abee365"). InnerVolumeSpecName "kube-api-access-slgb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:43:19.240571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.240548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:19.317021 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.316992    2570 generic.go:356] "Generic (PLEG): container finished" podID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerID="68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef" exitCode=0
Sep 18 22:43:19.317222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.317038    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"
Sep 18 22:43:19.317222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.317065    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" event={"ID":"a023b19d-807f-4cd8-aa20-d8d81abee365","Type":"ContainerDied","Data":"68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef"}
Sep 18 22:43:19.317222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.317129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz" event={"ID":"a023b19d-807f-4cd8-aa20-d8d81abee365","Type":"ContainerDied","Data":"54fb123b058cc668e8e74079bdacf1c9cdc11c915f399e27d38d09c5f62da7c8"}
Sep 18 22:43:19.317222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.317163    2570 scope.go:117] "RemoveContainer" containerID="68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef"
Sep 18 22:43:19.328143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.328121    2570 scope.go:117] "RemoveContainer" containerID="4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e"
Sep 18 22:43:19.328788 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.328753    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.328888 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.328810    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.328888 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.328826    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.328888 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.328839    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slgb9\" (UniqueName: \"kubernetes.io/projected/a023b19d-807f-4cd8-aa20-d8d81abee365-kube-api-access-slgb9\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:19.336514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.336494    2570 scope.go:117] "RemoveContainer" containerID="68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef"
Sep 18 22:43:19.336856 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:43:19.336813    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef\": container with ID starting with 68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef not found: ID does not exist" containerID="68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef"
Sep 18 22:43:19.336856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.336841    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef"} err="failed to get container status \"68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef\": rpc error: code = NotFound desc = could not find container \"68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef\": container with ID starting with 68a849afb9c3b4a7c7eac1c987aee164d8d2ba1ae3ddda56ac8c5f1f2bff1aef not found: ID does not exist"
Sep 18 22:43:19.337007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.336858    2570 scope.go:117] "RemoveContainer" containerID="4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e"
Sep 18 22:43:19.337808 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:43:19.337240    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e\": container with ID starting with 4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e not found: ID does not exist" containerID="4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e"
Sep 18 22:43:19.337808 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.337274    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e"} err="failed to get container status \"4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e\": rpc error: code = NotFound desc = could not find container \"4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e\": container with ID starting with 4c5b5a13892a5fc1836e63281330e0e4efda57c47817ac740831cf6e0fdc623e not found: ID does not exist"
Sep 18 22:43:19.340013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.339991    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"]
Sep 18 22:43:19.348548 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.346232    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz"]
Sep 18 22:43:19.404569 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:19.404536    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" path="/var/lib/kubelet/pods/a023b19d-807f-4cd8-aa20-d8d81abee365/volumes"
Sep 18 22:43:24.730114 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:24.730062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:24.806888 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:24.806855    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:24.879328 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:24.879287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:24.948289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:24.948258    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:25.275285 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:25.275253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:25.375302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:25.375265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:26.117043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:26.117004    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:27.032641 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:27.032605    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:27.920376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:27.920345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:28.601754 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:28.601726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:31.408902 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:31.408868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:31.489880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:31.489835    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:31.673214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:31.673140    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:32.902465 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:32.902384    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:33.570790 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:33.570747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:34.252260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:34.252228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:34.353681 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:34.353628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:34.459353 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:34.459320    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:35.083609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:35.083567    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:35.980182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:35.980147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:38.576558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:38.576524    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:38.872685 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:38.872652    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:39.901240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:39.901206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:40.702565 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:40.702528    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:41.411726 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:41.411692    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:42.089066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:42.089031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:42.816066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:42.816036    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:43.423500 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.423461    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:43.522709 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.522661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:43.628317 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.628283    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:43.634133 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.634108    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"]
Sep 18 22:43:43.638385 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.638361    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"]
Sep 18 22:43:43.651349 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.651322    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"]
Sep 18 22:43:43.714977 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.714895    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:43.786110 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.786078    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:43.996005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:43.995892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:44.206154 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:44.206121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:44.904311 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:44.904275    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:45.952842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:45.952812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:46.724673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:46.724639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:50.267584 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:50.267546    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:50.337116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:50.337085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:50.549498 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:50.549415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:54.418958 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:54.418921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:54.489929 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:54.489899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:54.556233 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:54.556198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:54.661196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:54.661162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:54.759515 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:54.759425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:55.062903 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:55.062808    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:55.321564 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:55.321460    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:56.240241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:56.240205    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:57.071577 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:57.071536    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:43:58.656813 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:58.656735    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5" podUID="10989eef-81ef-4632-b7ad-713352a2d3e3" containerName="main" containerID="cri-o://2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5" gracePeriod=45
Sep 18 22:43:58.659082 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:58.659053    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2" podUID="7eb68617-c0e7-44c4-9267-f85c0e6094b4" containerName="main" containerID="cri-o://58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d" gracePeriod=45
Sep 18 22:43:58.671264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:58.671232    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc" podUID="df4ed59c-4fbb-4314-a64c-1af779b631ce" containerName="main" containerID="cri-o://7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff" gracePeriod=45
Sep 18 22:43:58.967150 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:58.967120    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:43:58.971316 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:58.971223    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:43:58.975925 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:58.975904    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:43:59.038013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.037980    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df4ed59c-4fbb-4314-a64c-1af779b631ce-tls-certs\") pod \"df4ed59c-4fbb-4314-a64c-1af779b631ce\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") "
Sep 18 22:43:59.038013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038020    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tls-certs\") pod \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") "
Sep 18 22:43:59.038269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038039    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-model-cache\") pod \"df4ed59c-4fbb-4314-a64c-1af779b631ce\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") "
Sep 18 22:43:59.038269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038061    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-dshm\") pod \"10989eef-81ef-4632-b7ad-713352a2d3e3\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") "
Sep 18 22:43:59.038269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038087    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-home\") pod \"df4ed59c-4fbb-4314-a64c-1af779b631ce\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") "
Sep 18 22:43:59.038269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038112    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-model-cache\") pod \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") "
Sep 18 22:43:59.038269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038167    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-model-cache\") pod \"10989eef-81ef-4632-b7ad-713352a2d3e3\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") "
Sep 18 22:43:59.038269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038189    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10989eef-81ef-4632-b7ad-713352a2d3e3-tls-certs\") pod \"10989eef-81ef-4632-b7ad-713352a2d3e3\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") "
Sep 18 22:43:59.038269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038234    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-home\") pod \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038276    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-dshm\") pod \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038319    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tmp-dir\") pod \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038335    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-model-cache" (OuterVolumeSpecName: "model-cache") pod "df4ed59c-4fbb-4314-a64c-1af779b631ce" (UID: "df4ed59c-4fbb-4314-a64c-1af779b631ce"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038346    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-dshm\") pod \"df4ed59c-4fbb-4314-a64c-1af779b631ce\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038367    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-tmp-dir\") pod \"10989eef-81ef-4632-b7ad-713352a2d3e3\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038414    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-home\") pod \"10989eef-81ef-4632-b7ad-713352a2d3e3\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038455    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-tmp-dir\") pod \"df4ed59c-4fbb-4314-a64c-1af779b631ce\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038496    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjmxl\" (UniqueName: \"kubernetes.io/projected/7eb68617-c0e7-44c4-9267-f85c0e6094b4-kube-api-access-gjmxl\") pod \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\" (UID: \"7eb68617-c0e7-44c4-9267-f85c0e6094b4\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038541    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt9dl\" (UniqueName: \"kubernetes.io/projected/df4ed59c-4fbb-4314-a64c-1af779b631ce-kube-api-access-rt9dl\") pod \"df4ed59c-4fbb-4314-a64c-1af779b631ce\" (UID: \"df4ed59c-4fbb-4314-a64c-1af779b631ce\") "
Sep 18 22:43:59.038653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038574    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frzkh\" (UniqueName: \"kubernetes.io/projected/10989eef-81ef-4632-b7ad-713352a2d3e3-kube-api-access-frzkh\") pod \"10989eef-81ef-4632-b7ad-713352a2d3e3\" (UID: \"10989eef-81ef-4632-b7ad-713352a2d3e3\") "
Sep 18 22:43:59.039212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.038656    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7eb68617-c0e7-44c4-9267-f85c0e6094b4" (UID: "7eb68617-c0e7-44c4-9267-f85c0e6094b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.039212 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.039051    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-home" (OuterVolumeSpecName: "home") pod "7eb68617-c0e7-44c4-9267-f85c0e6094b4" (UID: "7eb68617-c0e7-44c4-9267-f85c0e6094b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.039316 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.039298    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.039379 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.039318    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.039379 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.039332    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.040634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.040070    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-home" (OuterVolumeSpecName: "home") pod "10989eef-81ef-4632-b7ad-713352a2d3e3" (UID: "10989eef-81ef-4632-b7ad-713352a2d3e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.040634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.040371    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "10989eef-81ef-4632-b7ad-713352a2d3e3" (UID: "10989eef-81ef-4632-b7ad-713352a2d3e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.040634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.040583    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-home" (OuterVolumeSpecName: "home") pod "df4ed59c-4fbb-4314-a64c-1af779b631ce" (UID: "df4ed59c-4fbb-4314-a64c-1af779b631ce"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.041014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.040670    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "10989eef-81ef-4632-b7ad-713352a2d3e3" (UID: "10989eef-81ef-4632-b7ad-713352a2d3e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.041014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.040741    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "7eb68617-c0e7-44c4-9267-f85c0e6094b4" (UID: "7eb68617-c0e7-44c4-9267-f85c0e6094b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.041014 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.040803    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df4ed59c-4fbb-4314-a64c-1af779b631ce" (UID: "df4ed59c-4fbb-4314-a64c-1af779b631ce"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.041274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.041245    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7eb68617-c0e7-44c4-9267-f85c0e6094b4" (UID: "7eb68617-c0e7-44c4-9267-f85c0e6094b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:43:59.041683 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.041405    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df4ed59c-4fbb-4314-a64c-1af779b631ce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df4ed59c-4fbb-4314-a64c-1af779b631ce" (UID: "df4ed59c-4fbb-4314-a64c-1af779b631ce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:43:59.041683 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.041647    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10989eef-81ef-4632-b7ad-713352a2d3e3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "10989eef-81ef-4632-b7ad-713352a2d3e3" (UID: "10989eef-81ef-4632-b7ad-713352a2d3e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:43:59.041683 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.041646    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10989eef-81ef-4632-b7ad-713352a2d3e3-kube-api-access-frzkh" (OuterVolumeSpecName: "kube-api-access-frzkh") pod "10989eef-81ef-4632-b7ad-713352a2d3e3" (UID: "10989eef-81ef-4632-b7ad-713352a2d3e3"). InnerVolumeSpecName "kube-api-access-frzkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:43:59.042687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.042639    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-dshm" (OuterVolumeSpecName: "dshm") pod "7eb68617-c0e7-44c4-9267-f85c0e6094b4" (UID: "7eb68617-c0e7-44c4-9267-f85c0e6094b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.043153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.043126    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eb68617-c0e7-44c4-9267-f85c0e6094b4-kube-api-access-gjmxl" (OuterVolumeSpecName: "kube-api-access-gjmxl") pod "7eb68617-c0e7-44c4-9267-f85c0e6094b4" (UID: "7eb68617-c0e7-44c4-9267-f85c0e6094b4"). InnerVolumeSpecName "kube-api-access-gjmxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:43:59.043544 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.043521    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-dshm" (OuterVolumeSpecName: "dshm") pod "df4ed59c-4fbb-4314-a64c-1af779b631ce" (UID: "df4ed59c-4fbb-4314-a64c-1af779b631ce"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.043805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.043757    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df4ed59c-4fbb-4314-a64c-1af779b631ce-kube-api-access-rt9dl" (OuterVolumeSpecName: "kube-api-access-rt9dl") pod "df4ed59c-4fbb-4314-a64c-1af779b631ce" (UID: "df4ed59c-4fbb-4314-a64c-1af779b631ce"). InnerVolumeSpecName "kube-api-access-rt9dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:43:59.043916 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.043849    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-dshm" (OuterVolumeSpecName: "dshm") pod "10989eef-81ef-4632-b7ad-713352a2d3e3" (UID: "10989eef-81ef-4632-b7ad-713352a2d3e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:43:59.140886 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140855    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df4ed59c-4fbb-4314-a64c-1af779b631ce-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.140886 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140884    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb68617-c0e7-44c4-9267-f85c0e6094b4-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.140886 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140892    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140900    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140908    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140916    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140923    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10989eef-81ef-4632-b7ad-713352a2d3e3-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140930    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb68617-c0e7-44c4-9267-f85c0e6094b4-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140936    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140943    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140949    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10989eef-81ef-4632-b7ad-713352a2d3e3-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140958    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df4ed59c-4fbb-4314-a64c-1af779b631ce-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140967    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjmxl\" (UniqueName: \"kubernetes.io/projected/7eb68617-c0e7-44c4-9267-f85c0e6094b4-kube-api-access-gjmxl\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140974    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt9dl\" (UniqueName: \"kubernetes.io/projected/df4ed59c-4fbb-4314-a64c-1af779b631ce-kube-api-access-rt9dl\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.141116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.140984    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frzkh\" (UniqueName: \"kubernetes.io/projected/10989eef-81ef-4632-b7ad-713352a2d3e3-kube-api-access-frzkh\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:43:59.547055 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.547019    2570 generic.go:356] "Generic (PLEG): container finished" podID="10989eef-81ef-4632-b7ad-713352a2d3e3" containerID="2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5" exitCode=0
Sep 18 22:43:59.547260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.547069    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"
Sep 18 22:43:59.547260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.547098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5" event={"ID":"10989eef-81ef-4632-b7ad-713352a2d3e3","Type":"ContainerDied","Data":"2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5"}
Sep 18 22:43:59.547260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.547145    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5" event={"ID":"10989eef-81ef-4632-b7ad-713352a2d3e3","Type":"ContainerDied","Data":"e824aded6a7aceb30f12b0aa4611a5cf78a281fdb5383088522462394c01e881"}
Sep 18 22:43:59.547260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.547166    2570 scope.go:117] "RemoveContainer" containerID="2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5"
Sep 18 22:43:59.548663 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.548640    2570 generic.go:356] "Generic (PLEG): container finished" podID="7eb68617-c0e7-44c4-9267-f85c0e6094b4" containerID="58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d" exitCode=0
Sep 18 22:43:59.548809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.548762    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"
Sep 18 22:43:59.548880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.548805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2" event={"ID":"7eb68617-c0e7-44c4-9267-f85c0e6094b4","Type":"ContainerDied","Data":"58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d"}
Sep 18 22:43:59.548880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.548845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2" event={"ID":"7eb68617-c0e7-44c4-9267-f85c0e6094b4","Type":"ContainerDied","Data":"100b9b8427c5589036c76308a38696896da9a0a5f9d60434081cf916ede4027d"}
Sep 18 22:43:59.550756 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.550732    2570 generic.go:356] "Generic (PLEG): container finished" podID="df4ed59c-4fbb-4314-a64c-1af779b631ce" containerID="7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff" exitCode=0
Sep 18 22:43:59.550880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.550799    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"
Sep 18 22:43:59.550880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.550810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc" event={"ID":"df4ed59c-4fbb-4314-a64c-1af779b631ce","Type":"ContainerDied","Data":"7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff"}
Sep 18 22:43:59.550880 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.550836    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc" event={"ID":"df4ed59c-4fbb-4314-a64c-1af779b631ce","Type":"ContainerDied","Data":"6ce0dc9e7ea39b13742c1f770af9f9b8b0f45c776ac5f6d7d4e33763544a58cc"}
Sep 18 22:43:59.557902 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.557887    2570 scope.go:117] "RemoveContainer" containerID="2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5"
Sep 18 22:43:59.558162 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:43:59.558143    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5\": container with ID starting with 2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5 not found: ID does not exist" containerID="2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5"
Sep 18 22:43:59.558224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.558169    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5"} err="failed to get container status \"2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5\": rpc error: code = NotFound desc = could not find container \"2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5\": container with ID starting with 2a3f29bcb2b3837bee340299b8da50a6028206389c9082cf4f2ecde6445abcb5 not found: ID does not exist"
Sep 18 22:43:59.558224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.558184    2570 scope.go:117] "RemoveContainer" containerID="58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d"
Sep 18 22:43:59.566773 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.566758    2570 scope.go:117] "RemoveContainer" containerID="58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d"
Sep 18 22:43:59.567063 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:43:59.567045    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d\": container with ID starting with 58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d not found: ID does not exist" containerID="58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d"
Sep 18 22:43:59.567139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.567068    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d"} err="failed to get container status \"58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d\": rpc error: code = NotFound desc = could not find container \"58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d\": container with ID starting with 58c9ae6081c0ea48682a7d745de3d642ae265e94e067a142c39f9f72b675a66d not found: ID does not exist"
Sep 18 22:43:59.567139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.567083    2570 scope.go:117] "RemoveContainer" containerID="7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff"
Sep 18 22:43:59.573367 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.573347    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"]
Sep 18 22:43:59.575500 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.575483    2570 scope.go:117] "RemoveContainer" containerID="7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff"
Sep 18 22:43:59.575873 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:43:59.575849    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff\": container with ID starting with 7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff not found: ID does not exist" containerID="7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff"
Sep 18 22:43:59.575956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.575879    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff"} err="failed to get container status \"7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff\": rpc error: code = NotFound desc = could not find container \"7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff\": container with ID starting with 7588dad9b442df1677027ac10480d6f71cd423e1e49de5452f6756ee7c7c5cff not found: ID does not exist"
Sep 18 22:43:59.578279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.578261    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/premium-w4-f9cf33-kserve-5b6c7648f8-htzxc"]
Sep 18 22:43:59.594449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.594422    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"]
Sep 18 22:43:59.596871 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.596846    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-w4-f9cf33-kserve-5688b96597-tm8l2"]
Sep 18 22:43:59.607505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.607483    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"]
Sep 18 22:43:59.613486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:43:59.613464    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f9cf33/distinct-2-w4-f9cf33-kserve-6cbff8b4f8-llrq5"]
Sep 18 22:44:00.881438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:00.881402    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:00.949703 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:00.949669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:01.143986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:01.143905    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"]
Sep 18 22:44:01.144145 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:01.144103    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" containerID="cri-o://89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c" gracePeriod=30
Sep 18 22:44:01.156210 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:01.156184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:01.404191 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:01.404112    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10989eef-81ef-4632-b7ad-713352a2d3e3" path="/var/lib/kubelet/pods/10989eef-81ef-4632-b7ad-713352a2d3e3/volumes"
Sep 18 22:44:01.404531 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:01.404517    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eb68617-c0e7-44c4-9267-f85c0e6094b4" path="/var/lib/kubelet/pods/7eb68617-c0e7-44c4-9267-f85c0e6094b4/volumes"
Sep 18 22:44:01.404904 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:01.404892    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df4ed59c-4fbb-4314-a64c-1af779b631ce" path="/var/lib/kubelet/pods/df4ed59c-4fbb-4314-a64c-1af779b631ce/volumes"
Sep 18 22:44:06.141251 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.141203    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:44:06.141630 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.141280    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:44:06.401538 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.401472    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:44:06.519750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.519708    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-envoy\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.519945 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.519838    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-data\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.519945 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.519860    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-podinfo\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.519945 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.519896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-token\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.519945 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.519930    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-certs\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.520153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.519953    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-credential-socket\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.520153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.519986    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istiod-ca-cert\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.520153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520023    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd4rc\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-kube-api-access-qd4rc\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.520153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520085    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-socket\") pod \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\" (UID: \"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae\") "
Sep 18 22:44:06.520153 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520117    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:06.520427 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520323    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:06.520490 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520389    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:44:06.520551 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520535    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:06.520604 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520559    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:06.520687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520669    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.520761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520695    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.520761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520710    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.520761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520725    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.520761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.520738    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.522209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.522180    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:06.522382 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.522360    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:44:06.522448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.522432    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-kube-api-access-qd4rc" (OuterVolumeSpecName: "kube-api-access-qd4rc") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "kube-api-access-qd4rc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:44:06.522629 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.522608    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" (UID: "e05a7b06-5edc-40cd-8ae8-820e1cabd1ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:44:06.595454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.595421    2570 generic.go:356] "Generic (PLEG): container finished" podID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerID="89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c" exitCode=0
Sep 18 22:44:06.595619 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.595466    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"
Sep 18 22:44:06.595619 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.595507    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" event={"ID":"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae","Type":"ContainerDied","Data":"89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c"}
Sep 18 22:44:06.595619 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.595568    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk" event={"ID":"e05a7b06-5edc-40cd-8ae8-820e1cabd1ae","Type":"ContainerDied","Data":"21adb77ff027515e56ecc6d6e807c4ace73b5022ef93258b98d479d1a916db0f"}
Sep 18 22:44:06.595619 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.595592    2570 scope.go:117] "RemoveContainer" containerID="89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c"
Sep 18 22:44:06.605974 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.605959    2570 scope.go:117] "RemoveContainer" containerID="557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d"
Sep 18 22:44:06.614366 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.614344    2570 scope.go:117] "RemoveContainer" containerID="89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c"
Sep 18 22:44:06.614658 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:44:06.614639    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c\": container with ID starting with 89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c not found: ID does not exist" containerID="89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c"
Sep 18 22:44:06.614705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.614669    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c"} err="failed to get container status \"89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c\": rpc error: code = NotFound desc = could not find container \"89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c\": container with ID starting with 89505c75d5ef198f2e1e3a626c57b282114ec921a6c5d8073c2363b58ee33a2c not found: ID does not exist"
Sep 18 22:44:06.614705 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.614685    2570 scope.go:117] "RemoveContainer" containerID="557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d"
Sep 18 22:44:06.614981 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:44:06.614964    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d\": container with ID starting with 557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d not found: ID does not exist" containerID="557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d"
Sep 18 22:44:06.615045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.614987    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d"} err="failed to get container status \"557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d\": rpc error: code = NotFound desc = could not find container \"557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d\": container with ID starting with 557883f28e718b2ce66286524e9a51d908ed7457f1c7894554eb84e863d40f9d not found: ID does not exist"
Sep 18 22:44:06.619067 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.619045    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"]
Sep 18 22:44:06.622046 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.622027    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.622046 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.622047    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.622182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.622055    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.622182 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.622063    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd4rc\" (UniqueName: \"kubernetes.io/projected/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae-kube-api-access-qd4rc\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:06.627493 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:06.627472    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk"]
Sep 18 22:44:07.403599 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:07.403566    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" path="/var/lib/kubelet/pods/e05a7b06-5edc-40cd-8ae8-820e1cabd1ae/volumes"
Sep 18 22:44:13.097883 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:13.097851    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"]
Sep 18 22:44:13.121545 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:13.121518    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:14.257567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:14.257532    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:19.828652 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:19.828612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:19.927448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:19.927414    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:21.519803 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:21.519742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:28.117618 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.117575    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp" podUID="fe14ff72-36d6-4a95-8693-6599dd8f1f38" containerName="main" containerID="cri-o://f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e" gracePeriod=45
Sep 18 22:44:28.376206 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.376145    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:44:28.424463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424421    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9kj9\" (UniqueName: \"kubernetes.io/projected/fe14ff72-36d6-4a95-8693-6599dd8f1f38-kube-api-access-j9kj9\") pod \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") "
Sep 18 22:44:28.424638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424495    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-home\") pod \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") "
Sep 18 22:44:28.424638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424520    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-model-cache\") pod \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") "
Sep 18 22:44:28.424638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424553    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tmp-dir\") pod \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") "
Sep 18 22:44:28.424638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424617    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tls-certs\") pod \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") "
Sep 18 22:44:28.424897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424655    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-dshm\") pod \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\" (UID: \"fe14ff72-36d6-4a95-8693-6599dd8f1f38\") "
Sep 18 22:44:28.424897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424814    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe14ff72-36d6-4a95-8693-6599dd8f1f38" (UID: "fe14ff72-36d6-4a95-8693-6599dd8f1f38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:28.424897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424825    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-home" (OuterVolumeSpecName: "home") pod "fe14ff72-36d6-4a95-8693-6599dd8f1f38" (UID: "fe14ff72-36d6-4a95-8693-6599dd8f1f38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:28.425047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.424942    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe14ff72-36d6-4a95-8693-6599dd8f1f38" (UID: "fe14ff72-36d6-4a95-8693-6599dd8f1f38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:28.425184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.425160    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:28.425370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.425342    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:28.425475 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.425373    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:28.427580 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.427551    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe14ff72-36d6-4a95-8693-6599dd8f1f38" (UID: "fe14ff72-36d6-4a95-8693-6599dd8f1f38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:44:28.427666 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.427613    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe14ff72-36d6-4a95-8693-6599dd8f1f38-kube-api-access-j9kj9" (OuterVolumeSpecName: "kube-api-access-j9kj9") pod "fe14ff72-36d6-4a95-8693-6599dd8f1f38" (UID: "fe14ff72-36d6-4a95-8693-6599dd8f1f38"). InnerVolumeSpecName "kube-api-access-j9kj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:44:28.427666 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.427635    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-dshm" (OuterVolumeSpecName: "dshm") pod "fe14ff72-36d6-4a95-8693-6599dd8f1f38" (UID: "fe14ff72-36d6-4a95-8693-6599dd8f1f38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:44:28.531139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.531104    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9kj9\" (UniqueName: \"kubernetes.io/projected/fe14ff72-36d6-4a95-8693-6599dd8f1f38-kube-api-access-j9kj9\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:28.531139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.531139    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe14ff72-36d6-4a95-8693-6599dd8f1f38-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:28.531339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.531153    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe14ff72-36d6-4a95-8693-6599dd8f1f38-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:44:28.711669 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.711568    2570 generic.go:356] "Generic (PLEG): container finished" podID="fe14ff72-36d6-4a95-8693-6599dd8f1f38" containerID="f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e" exitCode=0
Sep 18 22:44:28.711669 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.711639    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"
Sep 18 22:44:28.711917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.711660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp" event={"ID":"fe14ff72-36d6-4a95-8693-6599dd8f1f38","Type":"ContainerDied","Data":"f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e"}
Sep 18 22:44:28.711917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.711710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp" event={"ID":"fe14ff72-36d6-4a95-8693-6599dd8f1f38","Type":"ContainerDied","Data":"4526f7fe80a5a82cea52ddb5a56175cd850d0964f5dab3b5e18984cca7ee40b5"}
Sep 18 22:44:28.711917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.711728    2570 scope.go:117] "RemoveContainer" containerID="f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e"
Sep 18 22:44:28.721231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.721211    2570 scope.go:117] "RemoveContainer" containerID="f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e"
Sep 18 22:44:28.721528 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:44:28.721503    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e\": container with ID starting with f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e not found: ID does not exist" containerID="f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e"
Sep 18 22:44:28.721604 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.721541    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e"} err="failed to get container status \"f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e\": rpc error: code = NotFound desc = could not find container \"f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e\": container with ID starting with f7f71ed3252abf140f67a398a1f4f11356068dd4bf90ae913f9eeab50257973e not found: ID does not exist"
Sep 18 22:44:28.735103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.735067    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"]
Sep 18 22:44:28.743826 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:28.743806    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/auth-test-model-d6c0ac-kserve-75d7bb99c5-rxcrp"]
Sep 18 22:44:29.403746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:29.403705    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe14ff72-36d6-4a95-8693-6599dd8f1f38" path="/var/lib/kubelet/pods/fe14ff72-36d6-4a95-8693-6599dd8f1f38/volumes"
Sep 18 22:44:37.058837 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.058753    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"]
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059170    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10989eef-81ef-4632-b7ad-713352a2d3e3" containerName="main"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059182    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="10989eef-81ef-4632-b7ad-713352a2d3e3" containerName="main"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059194    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe14ff72-36d6-4a95-8693-6599dd8f1f38" containerName="main"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059200    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe14ff72-36d6-4a95-8693-6599dd8f1f38" containerName="main"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059208    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059214    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059222    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059228    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059238    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059244    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059253    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059258    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059264    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df4ed59c-4fbb-4314-a64c-1af779b631ce" containerName="main"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059269    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="df4ed59c-4fbb-4314-a64c-1af779b631ce" containerName="main"
Sep 18 22:44:37.059270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059276    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ff8d80-58b1-49cb-9d47-4396ebc12d97" containerName="maas-api"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059282    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ff8d80-58b1-49cb-9d47-4396ebc12d97" containerName="maas-api"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059288    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059293    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059300    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eb68617-c0e7-44c4-9267-f85c0e6094b4" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059305    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eb68617-c0e7-44c4-9267-f85c0e6094b4" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059311    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1809b92c-fa56-4ce8-be53-5046383ee4af" containerName="maas-api"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059316    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1809b92c-fa56-4ce8-be53-5046383ee4af" containerName="maas-api"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059323    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6abb33b3-ad46-44ee-a8f5-c9e7da06a280" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059328    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6abb33b3-ad46-44ee-a8f5-c9e7da06a280" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059334    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059338    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059345    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059350    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059410    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059417    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eb68617-c0e7-44c4-9267-f85c0e6094b4" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059423    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="10989eef-81ef-4632-b7ad-713352a2d3e3" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059429    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059437    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="df4ed59c-4fbb-4314-a64c-1af779b631ce" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059444    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a03ac31a-4b9f-4e95-8f63-2a349e4f48eb" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059450    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059455    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059460    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="98ff8d80-58b1-49cb-9d47-4396ebc12d97" containerName="maas-api"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059465    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6abb33b3-ad46-44ee-a8f5-c9e7da06a280" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059471    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3db8e9e-a3b4-4965-a710-4166daa84f76" containerName="istio-proxy"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059476    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1809b92c-fa56-4ce8-be53-5046383ee4af" containerName="maas-api"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059482    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe14ff72-36d6-4a95-8693-6599dd8f1f38" containerName="main"
Sep 18 22:44:37.059733 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.059487    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy"
Sep 18 22:44:37.064044 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.064024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.066479 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.066458    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"openshift-service-ca.crt\""
Sep 18 22:44:37.067364 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.067347    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"default-dockercfg-lph27\""
Sep 18 22:44:37.067436 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.067419    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"sub-test-model-d6c0ac-kserve-self-signed-certs\""
Sep 18 22:44:37.067511 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.067354    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"kube-root-ca.crt\""
Sep 18 22:44:37.075536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.075062    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"]
Sep 18 22:44:37.083332 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.083310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:37.110137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.110112    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-dshm\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.110283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.110157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-tmp-dir\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.110283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.110191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzkt5\" (UniqueName: \"kubernetes.io/projected/c6a832b6-aaed-414a-b189-3cac777f6be0-kube-api-access-wzkt5\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.110283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.110230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a832b6-aaed-414a-b189-3cac777f6be0-tls-certs\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.110442 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.110295    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-home\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.110442 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.110317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-model-cache\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-home\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-model-cache\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-dshm\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-tmp-dir\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211607    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzkt5\" (UniqueName: \"kubernetes.io/projected/c6a832b6-aaed-414a-b189-3cac777f6be0-kube-api-access-wzkt5\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211687 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a832b6-aaed-414a-b189-3cac777f6be0-tls-certs\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211924 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211904    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-home\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.211984 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211942    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-model-cache\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.212039 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.211997    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-tmp-dir\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.214074 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.214043    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-dshm\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.214314 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.214299    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a832b6-aaed-414a-b189-3cac777f6be0-tls-certs\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.219971 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.219949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzkt5\" (UniqueName: \"kubernetes.io/projected/c6a832b6-aaed-414a-b189-3cac777f6be0-kube-api-access-wzkt5\") pod \"sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.375693 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.375657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:37.671114 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.671088    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"]
Sep 18 22:44:37.673616 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:44:37.673580    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6a832b6_aaed_414a_b189_3cac777f6be0.slice/crio-87771ed1dc068c7cbd12948e34bbb7119cd9819a346c049e3aa7c5b803452013 WatchSource:0}: Error finding container 87771ed1dc068c7cbd12948e34bbb7119cd9819a346c049e3aa7c5b803452013: Status 404 returned error can't find the container with id 87771ed1dc068c7cbd12948e34bbb7119cd9819a346c049e3aa7c5b803452013
Sep 18 22:44:37.763393 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.763356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn" event={"ID":"c6a832b6-aaed-414a-b189-3cac777f6be0","Type":"ContainerStarted","Data":"07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f"}
Sep 18 22:44:37.763393 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.763405    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn" event={"ID":"c6a832b6-aaed-414a-b189-3cac777f6be0","Type":"ContainerStarted","Data":"87771ed1dc068c7cbd12948e34bbb7119cd9819a346c049e3aa7c5b803452013"}
Sep 18 22:44:37.784435 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:37.784370    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn" podStartSLOduration=0.784353602 podStartE2EDuration="784.353602ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:44:37.782571162 +0000 UTC m=+1668.360516331" watchObservedRunningTime="2026-09-18 22:44:37.784353602 +0000 UTC m=+1668.362298746"
Sep 18 22:44:44.438921 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:44.438886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:44:47.375987 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:47.375947    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:47.376388 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:47.376003    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:47.388934 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:47.388906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:44:47.826639 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:44:47.826555    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:45:02.523729 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:02.523697    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:45:02.600825 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:02.600763    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:45:03.174090 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:03.174039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:45:42.272267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:42.272237    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"]
Sep 18 22:45:42.296635 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:42.296607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:45:43.260340 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:43.260305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:45:47.993914 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:47.993883    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:45:49.372503 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.372470    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"]
Sep 18 22:45:49.372909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.372896    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy"
Sep 18 22:45:49.372909 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.372909    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05a7b06-5edc-40cd-8ae8-820e1cabd1ae" containerName="istio-proxy"
Sep 18 22:45:49.372987 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.372974    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a023b19d-807f-4cd8-aa20-d8d81abee365" containerName="istio-proxy"
Sep 18 22:45:49.375995 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.375978    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.379072 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.379047    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d6c0ac\"/\"rate-test-model-d6c0ac-kserve-self-signed-certs\""
Sep 18 22:45:49.386664 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.386635    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"]
Sep 18 22:45:49.394290 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.394267    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:45:49.428280 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.428249    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tmp-dir\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.428420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.428290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-model-cache\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.428420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.428321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-home\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.428508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.428453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-dshm\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.428508 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.428488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ct5\" (UniqueName: \"kubernetes.io/projected/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-kube-api-access-s4ct5\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.428623 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.428512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tls-certs\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.529434 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.529395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-dshm\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.529609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.529461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ct5\" (UniqueName: \"kubernetes.io/projected/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-kube-api-access-s4ct5\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.529609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.529497    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tls-certs\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.529609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.529568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tmp-dir\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.529609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.529597    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-model-cache\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.529884 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.529637    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-home\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.530064 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.530037    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-home\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.530139 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.530093    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tmp-dir\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.530433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.530403    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-model-cache\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.532372 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.532331    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-dshm\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.532486 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.532444    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tls-certs\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.539997 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.539976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ct5\" (UniqueName: \"kubernetes.io/projected/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-kube-api-access-s4ct5\") pod \"rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") " pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.686419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.686338    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:49.967323 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:49.967295    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"]
Sep 18 22:45:49.969439 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:45:49.969406    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c8cc4b4_5a71_4cd9_bbed_5f77954e2338.slice/crio-2233352614bae9d74e4ef43bd61638d4b9e9e46f5cc916ac29a43e7b357edff4 WatchSource:0}: Error finding container 2233352614bae9d74e4ef43bd61638d4b9e9e46f5cc916ac29a43e7b357edff4: Status 404 returned error can't find the container with id 2233352614bae9d74e4ef43bd61638d4b9e9e46f5cc916ac29a43e7b357edff4
Sep 18 22:45:50.144287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:50.144249    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm" event={"ID":"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338","Type":"ContainerStarted","Data":"e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4"}
Sep 18 22:45:50.144287 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:50.144287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm" event={"ID":"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338","Type":"ContainerStarted","Data":"2233352614bae9d74e4ef43bd61638d4b9e9e46f5cc916ac29a43e7b357edff4"}
Sep 18 22:45:50.164007 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:50.163964    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm" podStartSLOduration=1.16394993 podStartE2EDuration="1.16394993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:45:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:45:50.161965471 +0000 UTC m=+1740.739910617" watchObservedRunningTime="2026-09-18 22:45:50.16394993 +0000 UTC m=+1740.741895074"
Sep 18 22:45:57.292357 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.292313    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn" podUID="c6a832b6-aaed-414a-b189-3cac777f6be0" containerName="main" containerID="cri-o://07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f" gracePeriod=45
Sep 18 22:45:57.546498 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.546435    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:45:57.610080 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610050    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-tmp-dir\") pod \"c6a832b6-aaed-414a-b189-3cac777f6be0\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") "
Sep 18 22:45:57.610234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-dshm\") pod \"c6a832b6-aaed-414a-b189-3cac777f6be0\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") "
Sep 18 22:45:57.610234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610140    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a832b6-aaed-414a-b189-3cac777f6be0-tls-certs\") pod \"c6a832b6-aaed-414a-b189-3cac777f6be0\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") "
Sep 18 22:45:57.610234 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610161    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzkt5\" (UniqueName: \"kubernetes.io/projected/c6a832b6-aaed-414a-b189-3cac777f6be0-kube-api-access-wzkt5\") pod \"c6a832b6-aaed-414a-b189-3cac777f6be0\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") "
Sep 18 22:45:57.610424 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610263    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-home\") pod \"c6a832b6-aaed-414a-b189-3cac777f6be0\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") "
Sep 18 22:45:57.610424 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610295    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-model-cache\") pod \"c6a832b6-aaed-414a-b189-3cac777f6be0\" (UID: \"c6a832b6-aaed-414a-b189-3cac777f6be0\") "
Sep 18 22:45:57.610424 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610311    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6a832b6-aaed-414a-b189-3cac777f6be0" (UID: "c6a832b6-aaed-414a-b189-3cac777f6be0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:45:57.610588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610520    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-home" (OuterVolumeSpecName: "home") pod "c6a832b6-aaed-414a-b189-3cac777f6be0" (UID: "c6a832b6-aaed-414a-b189-3cac777f6be0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:45:57.610646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610622    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6a832b6-aaed-414a-b189-3cac777f6be0" (UID: "c6a832b6-aaed-414a-b189-3cac777f6be0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:45:57.610740 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610726    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:45:57.610814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610746    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:45:57.610814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.610759    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:45:57.612524 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.612503    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-dshm" (OuterVolumeSpecName: "dshm") pod "c6a832b6-aaed-414a-b189-3cac777f6be0" (UID: "c6a832b6-aaed-414a-b189-3cac777f6be0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:45:57.612621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.612555    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a832b6-aaed-414a-b189-3cac777f6be0-kube-api-access-wzkt5" (OuterVolumeSpecName: "kube-api-access-wzkt5") pod "c6a832b6-aaed-414a-b189-3cac777f6be0" (UID: "c6a832b6-aaed-414a-b189-3cac777f6be0"). InnerVolumeSpecName "kube-api-access-wzkt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:45:57.612621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.612608    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6a832b6-aaed-414a-b189-3cac777f6be0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6a832b6-aaed-414a-b189-3cac777f6be0" (UID: "c6a832b6-aaed-414a-b189-3cac777f6be0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:45:57.718696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.718661    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6a832b6-aaed-414a-b189-3cac777f6be0-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:45:57.718696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.718688    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6a832b6-aaed-414a-b189-3cac777f6be0-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:45:57.718696 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:57.718698    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzkt5\" (UniqueName: \"kubernetes.io/projected/c6a832b6-aaed-414a-b189-3cac777f6be0-kube-api-access-wzkt5\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:45:58.189168 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.189132    2570 generic.go:356] "Generic (PLEG): container finished" podID="c6a832b6-aaed-414a-b189-3cac777f6be0" containerID="07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f" exitCode=0
Sep 18 22:45:58.189343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.189190    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"
Sep 18 22:45:58.189343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.189198    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn" event={"ID":"c6a832b6-aaed-414a-b189-3cac777f6be0","Type":"ContainerDied","Data":"07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f"}
Sep 18 22:45:58.189343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.189311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn" event={"ID":"c6a832b6-aaed-414a-b189-3cac777f6be0","Type":"ContainerDied","Data":"87771ed1dc068c7cbd12948e34bbb7119cd9819a346c049e3aa7c5b803452013"}
Sep 18 22:45:58.189343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.189334    2570 scope.go:117] "RemoveContainer" containerID="07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f"
Sep 18 22:45:58.199169 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.199156    2570 scope.go:117] "RemoveContainer" containerID="07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f"
Sep 18 22:45:58.199444 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:45:58.199427    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f\": container with ID starting with 07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f not found: ID does not exist" containerID="07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f"
Sep 18 22:45:58.199491 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.199451    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f"} err="failed to get container status \"07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f\": rpc error: code = NotFound desc = could not find container \"07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f\": container with ID starting with 07c0c830f08f0a2f06862ddc30540ba5c72494da0c9d14a2b987c971fd10184f not found: ID does not exist"
Sep 18 22:45:58.210828 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.210801    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"]
Sep 18 22:45:58.215259 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:58.215238    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/sub-test-model-d6c0ac-kserve-55f694f8b5-q22vn"]
Sep 18 22:45:59.403433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:59.403400    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6a832b6-aaed-414a-b189-3cac777f6be0" path="/var/lib/kubelet/pods/c6a832b6-aaed-414a-b189-3cac777f6be0/volumes"
Sep 18 22:45:59.687468 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:59.687370    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:59.687468 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:59.687427    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:45:59.700208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:45:59.700177    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:46:00.212073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:00.212038    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:46:13.081411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:13.081362    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:44.473108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:44.473074    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"]
Sep 18 22:46:44.506158 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:44.506095    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:44.906086 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:44.906054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:45.505493 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:45.505438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:45.903461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:45.903423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:46.371177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:46.371145    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:46.541047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:46.541016    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:48.252276 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:48.252228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:48.974630 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:48.974601    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:49.067147 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:49.067114    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:50.026718 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:50.026679    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:51.122864 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:51.122827    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:51.244052 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:51.244007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:51.456376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:51.456287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:51.506644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:51.506616    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:46:51.510295 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:51.510273    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:46:51.681044 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:51.681007    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:51.800037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:51.800006    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:46:59.492870 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.492808    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm" podUID="3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" containerName="main" containerID="cri-o://e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4" gracePeriod=45
Sep 18 22:46:59.756090 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.756029    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:46:59.820261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820226    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-model-cache\") pod \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") "
Sep 18 22:46:59.820423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820280    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4ct5\" (UniqueName: \"kubernetes.io/projected/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-kube-api-access-s4ct5\") pod \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") "
Sep 18 22:46:59.820423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820320    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tls-certs\") pod \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") "
Sep 18 22:46:59.820423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820349    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tmp-dir\") pod \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") "
Sep 18 22:46:59.820423 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820365    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-home\") pod \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") "
Sep 18 22:46:59.820638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820463    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-dshm\") pod \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\" (UID: \"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338\") "
Sep 18 22:46:59.820638 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820468    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" (UID: "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:46:59.820755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820657    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-home" (OuterVolumeSpecName: "home") pod "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" (UID: "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:46:59.820755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820679    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" (UID: "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:46:59.820913 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820896    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-model-cache\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:46:59.820968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820936    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tmp-dir\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:46:59.820968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.820949    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-home\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:46:59.822701 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.822672    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-dshm" (OuterVolumeSpecName: "dshm") pod "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" (UID: "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:46:59.823129 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.823106    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-kube-api-access-s4ct5" (OuterVolumeSpecName: "kube-api-access-s4ct5") pod "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" (UID: "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338"). InnerVolumeSpecName "kube-api-access-s4ct5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:46:59.823191 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.823174    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" (UID: "3c8cc4b4-5a71-4cd9-bbed-5f77954e2338"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:46:59.922003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.921969    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-tls-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:46:59.922003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.921998    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-dshm\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:46:59.922003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:46:59.922007    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4ct5\" (UniqueName: \"kubernetes.io/projected/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338-kube-api-access-s4ct5\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:47:00.516952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.516911    2570 generic.go:356] "Generic (PLEG): container finished" podID="3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" containerID="e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4" exitCode=0
Sep 18 22:47:00.516952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.516945    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"
Sep 18 22:47:00.516952 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.516956    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm" event={"ID":"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338","Type":"ContainerDied","Data":"e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4"}
Sep 18 22:47:00.517542 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.516984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm" event={"ID":"3c8cc4b4-5a71-4cd9-bbed-5f77954e2338","Type":"ContainerDied","Data":"2233352614bae9d74e4ef43bd61638d4b9e9e46f5cc916ac29a43e7b357edff4"}
Sep 18 22:47:00.517542 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.516999    2570 scope.go:117] "RemoveContainer" containerID="e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4"
Sep 18 22:47:00.526681 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.526661    2570 scope.go:117] "RemoveContainer" containerID="e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4"
Sep 18 22:47:00.527062 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:47:00.527041    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4\": container with ID starting with e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4 not found: ID does not exist" containerID="e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4"
Sep 18 22:47:00.527151 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.527085    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4"} err="failed to get container status \"e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4\": rpc error: code = NotFound desc = could not find container \"e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4\": container with ID starting with e5321125dc02660cdefd9b0fd57e9c972076eea87f998fea3d508ca7d76023a4 not found: ID does not exist"
Sep 18 22:47:00.541700 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.541676    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"]
Sep 18 22:47:00.548911 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:00.548882    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d6c0ac/rate-test-model-d6c0ac-kserve-5dd6b74c7f-9r8dm"]
Sep 18 22:47:01.403746 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:01.403714    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" path="/var/lib/kubelet/pods/3c8cc4b4-5a71-4cd9-bbed-5f77954e2338/volumes"
Sep 18 22:47:13.973652 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:13.973616    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:14.118680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.118645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:14.676043 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.676011    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:14.952843 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.952750    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"]
Sep 18 22:47:14.953222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.953205    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a832b6-aaed-414a-b189-3cac777f6be0" containerName="main"
Sep 18 22:47:14.953268 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.953228    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a832b6-aaed-414a-b189-3cac777f6be0" containerName="main"
Sep 18 22:47:14.953315 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.953269    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" containerName="main"
Sep 18 22:47:14.953315 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.953280    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" containerName="main"
Sep 18 22:47:14.953411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.953358    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a832b6-aaed-414a-b189-3cac777f6be0" containerName="main"
Sep 18 22:47:14.953411 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.953373    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c8cc4b4-5a71-4cd9-bbed-5f77954e2338" containerName="main"
Sep 18 22:47:14.956591 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.956572    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:14.959045 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.959027    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-36f843-openshift-default-dockercfg-sqkqx\""
Sep 18 22:47:14.970140 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.970115    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"]
Sep 18 22:47:14.990279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:14.990247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:15.064566 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064534    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-credential-socket\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064729 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064592    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-istio-token\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064729 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064640    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e18c6f9-1071-42f3-9053-b886791144dd-istiod-ca-cert\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064729 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-envoy\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064869 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-socket\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064869 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-certs\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064869 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-data\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064965 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064881    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-kube-api-access-2qxw4\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.064965 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.064927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e18c6f9-1071-42f3-9053-b886791144dd-istio-podinfo\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.090744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.090708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:15.166254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166219    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-istio-token\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166254 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e18c6f9-1071-42f3-9053-b886791144dd-istiod-ca-cert\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-envoy\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-socket\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166370    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-certs\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-data\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-kube-api-access-2qxw4\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166588    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e18c6f9-1071-42f3-9053-b886791144dd-istio-podinfo\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-credential-socket\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166809 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166746    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-data\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.166966 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.166906    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-certs\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.167047 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.167029    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-socket\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.167102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.167031    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-credential-socket\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.167261 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.167244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e18c6f9-1071-42f3-9053-b886791144dd-istiod-ca-cert\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.168833 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.168817    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-envoy\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.169489 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.169472    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e18c6f9-1071-42f3-9053-b886791144dd-istio-podinfo\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.176310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.176286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-istio-token\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.180117 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.180097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-kube-api-access-2qxw4\") pod \"e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") " pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.268594 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.268519    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:15.367233 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.367201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:15.551995 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.551970    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"]
Sep 18 22:47:15.557348 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.557318    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:47:15.557432 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.557384    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:47:15.557432 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.557417    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:47:15.597611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.597585    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" event={"ID":"0e18c6f9-1071-42f3-9053-b886791144dd","Type":"ContainerStarted","Data":"7f3a946d9676e47dfcedd7e9eab1cd3d63d370be10ceffa38b1bd5c2f5c6d7d2"}
Sep 18 22:47:15.841846 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:15.841816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:16.604591 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:16.604553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" event={"ID":"0e18c6f9-1071-42f3-9053-b886791144dd","Type":"ContainerStarted","Data":"e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf"}
Sep 18 22:47:16.629711 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:16.629661    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podStartSLOduration=2.629646663 podStartE2EDuration="2.629646663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:47:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:47:16.626833064 +0000 UTC m=+1827.204778209" watchObservedRunningTime="2026-09-18 22:47:16.629646663 +0000 UTC m=+1827.207591807"
Sep 18 22:47:16.703622 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:16.703582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:17.268849 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:17.268809    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:17.273859 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:17.273837    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:17.610397 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:17.610367    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:17.611398 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:17.611379    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:17.919817 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:17.919719    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:18.599005 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:18.598965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:18.697186 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:18.697157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:18.900588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:18.900495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:19.641596 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:19.641563    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:20.697370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:20.697329    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:21.405856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.405825    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"]
Sep 18 22:47:21.410398 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.410375    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.413173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.413148    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-36f843-serving-cert\""
Sep 18 22:47:21.419600 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.419574    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"]
Sep 18 22:47:21.437307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.437280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:21.534284 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.534248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:21.536656 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.536627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8xrp\" (UniqueName: \"kubernetes.io/projected/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-kube-api-access-n8xrp\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.536810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.536719    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.536810 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.536753    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-metrics-certs\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.536942 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.536836    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.638181 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.638152    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8xrp\" (UniqueName: \"kubernetes.io/projected/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-kube-api-access-n8xrp\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.638318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.638199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.638318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.638222    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-metrics-certs\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.638318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.638246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.638483 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:47:21.638319    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-serving-cert: secret "maas-api-e2e-ipp-b-36f843-serving-cert" not found
Sep 18 22:47:21.638483 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:47:21.638388    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls podName:ccbecf5f-d3c4-4d43-be17-d1bcc800da65 nodeName:}" failed. No retries permitted until 2026-09-18 22:47:22.138368996 +0000 UTC m=+1832.716314139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls") pod "maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l" (UID: "ccbecf5f-d3c4-4d43-be17-d1bcc800da65") : secret "maas-api-e2e-ipp-b-36f843-serving-cert" not found
Sep 18 22:47:21.638918 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.638899    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.640859 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.640837    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-metrics-certs\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.652866 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.652847    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8xrp\" (UniqueName: \"kubernetes.io/projected/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-kube-api-access-n8xrp\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:21.952421 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:21.952394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:22.053343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.053303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:22.143916 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.143878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:22.146464 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.146442    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls\") pod \"maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:22.151719 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.151695    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:22.324427 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.324344    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:22.451492 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.451428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:22.601012 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.600987    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"]
Sep 18 22:47:22.602673 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:47:22.602647    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbecf5f_d3c4_4d43_be17_d1bcc800da65.slice/crio-c9640785808719f5e193e0caf9de415eea7cb08d405247fdf0ba751d1e62393d WatchSource:0}: Error finding container c9640785808719f5e193e0caf9de415eea7cb08d405247fdf0ba751d1e62393d: Status 404 returned error can't find the container with id c9640785808719f5e193e0caf9de415eea7cb08d405247fdf0ba751d1e62393d
Sep 18 22:47:22.604037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.604021    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:47:22.637793 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:22.637746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l" event={"ID":"ccbecf5f-d3c4-4d43-be17-d1bcc800da65","Type":"ContainerStarted","Data":"c9640785808719f5e193e0caf9de415eea7cb08d405247fdf0ba751d1e62393d"}
Sep 18 22:47:23.543469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:23.543438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:23.646642 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:23.646604    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l" event={"ID":"ccbecf5f-d3c4-4d43-be17-d1bcc800da65","Type":"ContainerStarted","Data":"83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636"}
Sep 18 22:47:23.646982 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:23.646719    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:23.666995 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:23.666938    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l" podStartSLOduration=2.244184588 podStartE2EDuration="2.666923766s" totalImagesPullingTime="422.739178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:47:23.666093808 +0000 UTC m=+1834.244038954" watchObservedRunningTime="2026-09-18 22:47:23.666923766 +0000 UTC m=+1834.244868911"
Sep 18 22:47:29.657059 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:29.657026    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:47:37.729264 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:37.729228    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e18c6f9-1071-42f3-9053-b886791144dd" containerID="e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf" exitCode=0
Sep 18 22:47:37.729690 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:37.729301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" event={"ID":"0e18c6f9-1071-42f3-9053-b886791144dd","Type":"ContainerDied","Data":"e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf"}
Sep 18 22:47:37.729747 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:37.729734    2570 scope.go:117] "RemoveContainer" containerID="e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf"
Sep 18 22:47:37.730868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:37.730839    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:47:37.730969 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:37.730904    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:47:37.730969 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:37.730933    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:47:38.736243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:38.736211    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" event={"ID":"0e18c6f9-1071-42f3-9053-b886791144dd","Type":"ContainerStarted","Data":"ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac"}
Sep 18 22:47:39.269298 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:39.269264    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:39.269514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:39.269493    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 18 22:47:39.269567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:39.269542    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 18 22:47:40.268985 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:40.268943    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 18 22:47:40.269402 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:40.269018    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 18 22:47:41.269496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:41.269452    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 18 22:47:41.269917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:41.269526    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 18 22:47:42.269137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:42.269093    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 18 22:47:42.269334 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:42.269162    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 18 22:47:43.269232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:43.269192    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 18 22:47:43.269646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:43.269248    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 18 22:47:44.275033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:44.274995    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:44.275554 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:44.275381    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:44.276289 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:44.276256    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:47:45.398414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:45.398379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:46.188116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:46.188081    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:46.917632 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:46.917587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:47.732625 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:47.732592    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:48.559727 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:48.559686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:48.709214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:48.709184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:50.780466 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:50.780435    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:47:58.336034 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:47:58.335990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:06.023842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:06.023748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:21.963269 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:21.963236    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:25.301215 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.301173    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:25.572844 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.572753    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"]
Sep 18 22:48:25.576376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.576351    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.579217 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.579194    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-f696b1-openshift-default-dockercfg-k7kfv\""
Sep 18 22:48:25.590496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.590473    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"]
Sep 18 22:48:25.597803 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.597746    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:25.682357 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682316    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-envoy\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-data\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-certs\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682502    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmzxj\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-kube-api-access-cmzxj\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-credential-socket\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eb958e-6922-44e2-b7b7-aa535ffc04de-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682621    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-token\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-podinfo\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.682829 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.682682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-socket\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.783975 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.783932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-certs\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmzxj\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-kube-api-access-cmzxj\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-credential-socket\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eb958e-6922-44e2-b7b7-aa535ffc04de-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-token\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784152    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-podinfo\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784460 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-socket\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784460 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-envoy\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784460 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-data\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-certs\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.784917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.784891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eb958e-6922-44e2-b7b7-aa535ffc04de-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.785107 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.785082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-credential-socket\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.785205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.785031    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-data\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.785205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.785015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-socket\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.787098 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.787079    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-podinfo\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.787181 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.787087    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-envoy\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.802225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.802195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-token\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.802395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.802377    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmzxj\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-kube-api-access-cmzxj\") pod \"e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") " pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.889349 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.889315    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:25.926438 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:25.926409    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:26.174400 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:26.174374    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"]
Sep 18 22:48:26.176078 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:48:26.176049    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38eb958e_6922_44e2_b7b7_aa535ffc04de.slice/crio-84d10dbaef3939ce9caf27633975ec77ed4b6cd6b2d7c4209fff013d9b87b11f WatchSource:0}: Error finding container 84d10dbaef3939ce9caf27633975ec77ed4b6cd6b2d7c4209fff013d9b87b11f: Status 404 returned error can't find the container with id 84d10dbaef3939ce9caf27633975ec77ed4b6cd6b2d7c4209fff013d9b87b11f
Sep 18 22:48:26.178451 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:26.178421    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:48:26.178514 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:26.178489    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:48:26.178550 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:26.178518    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:48:27.000813 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:27.000753    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" event={"ID":"38eb958e-6922-44e2-b7b7-aa535ffc04de","Type":"ContainerStarted","Data":"23e68289be62f52cb17ad8e380eca9cc521c3869f7dcaf9cf58d0b01afa8d6b5"}
Sep 18 22:48:27.001177 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:27.000839    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" event={"ID":"38eb958e-6922-44e2-b7b7-aa535ffc04de","Type":"ContainerStarted","Data":"84d10dbaef3939ce9caf27633975ec77ed4b6cd6b2d7c4209fff013d9b87b11f"}
Sep 18 22:48:27.044206 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:27.044144    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" podStartSLOduration=2.044127507 podStartE2EDuration="2.044127507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:48:27.042953463 +0000 UTC m=+1897.620898607" watchObservedRunningTime="2026-09-18 22:48:27.044127507 +0000 UTC m=+1897.622072652"
Sep 18 22:48:27.889948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:27.889911    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:27.895143 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:27.895118    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:28.006856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:28.006822    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:28.007730 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:28.007709    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:28.290380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:28.290297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:28.946160 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:28.946130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:29.056439 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:29.056412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:29.165814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:29.165698    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:30.227220 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:30.227189    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:31.003572 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:31.003539    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:31.702491 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:31.702456    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:32.591941 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:32.591909    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:32.674653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:32.674624    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:32.773579 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:32.773550    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:33.145065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:33.145020    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:33.239208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:33.239174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:48.128593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:48.128557    2570 generic.go:356] "Generic (PLEG): container finished" podID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerID="23e68289be62f52cb17ad8e380eca9cc521c3869f7dcaf9cf58d0b01afa8d6b5" exitCode=0
Sep 18 22:48:48.129155 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:48.128603    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" event={"ID":"38eb958e-6922-44e2-b7b7-aa535ffc04de","Type":"ContainerDied","Data":"23e68289be62f52cb17ad8e380eca9cc521c3869f7dcaf9cf58d0b01afa8d6b5"}
Sep 18 22:48:48.129224 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:48.129198    2570 scope.go:117] "RemoveContainer" containerID="23e68289be62f52cb17ad8e380eca9cc521c3869f7dcaf9cf58d0b01afa8d6b5"
Sep 18 22:48:48.134102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:48.133907    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:48:48.134102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:48.134000    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:48:48.134102 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:48.134047    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 22:48:49.135989 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:49.135952    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" event={"ID":"38eb958e-6922-44e2-b7b7-aa535ffc04de","Type":"ContainerStarted","Data":"49aaab38bd04afe298b8a80a037956bb67c53302c77c5c5e9df0e83471535f20"}
Sep 18 22:48:49.890358 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:49.890320    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:49.890766 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:49.890671    2570 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:48:49.890994 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:49.890970    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:48:50.890950 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:50.890910    2570 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:48:50.891562 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:50.891527    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:48:51.890310 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:51.890267    2570 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:48:51.890528 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:51.890337    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:48:52.890509 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:52.890471    2570 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:48:52.891142 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:52.891111    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:48:53.890659 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:53.890619    2570 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 18 22:48:53.891428 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:53.891390    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 18 22:48:54.906805 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:54.906750    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:54.907178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:54.907144    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:54.907961 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:54.907942    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:48:55.477552 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:55.477516    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:56.407327 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:56.407280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:57.110806 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:57.110748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:57.764634 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:57.764597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:58.636241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:58.636207    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:59.136109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:59.136072    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:48:59.449869 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:48:59.449760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:00.234526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:00.234478    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:01.224339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:01.224306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:01.979343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:01.979305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:02.675761 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:02.675726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:03.605256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:03.605227    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:04.397051 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:04.397015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:10.819219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:10.819181    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:10.920214 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:10.920177    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:11.021526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:11.021494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:11.121271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:11.121228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:11.404974 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:11.404896    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:11.510499 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:11.510470    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:12.220190 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:12.220155    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:13.226849 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:13.226818    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:14.121247 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:14.121211    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:14.801395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:14.801365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:14.903218 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:14.903184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:15.007390 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:15.007347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:17.840294 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:17.840235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:17.942471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:17.942411    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:18.089749 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:18.089714    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"]
Sep 18 22:49:18.090011 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:18.089965    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy" containerID="cri-o://49aaab38bd04afe298b8a80a037956bb67c53302c77c5c5e9df0e83471535f20" gracePeriod=30
Sep 18 22:49:18.115160 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:18.115125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:22.101260 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:22.101225    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:23.013042 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.012989    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:23.335593 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.335566    2570 generic.go:356] "Generic (PLEG): container finished" podID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerID="49aaab38bd04afe298b8a80a037956bb67c53302c77c5c5e9df0e83471535f20" exitCode=0
Sep 18 22:49:23.336013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.335643    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" event={"ID":"38eb958e-6922-44e2-b7b7-aa535ffc04de","Type":"ContainerDied","Data":"49aaab38bd04afe298b8a80a037956bb67c53302c77c5c5e9df0e83471535f20"}
Sep 18 22:49:23.336013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.335716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf" event={"ID":"38eb958e-6922-44e2-b7b7-aa535ffc04de","Type":"ContainerDied","Data":"84d10dbaef3939ce9caf27633975ec77ed4b6cd6b2d7c4209fff013d9b87b11f"}
Sep 18 22:49:23.336013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.335742    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84d10dbaef3939ce9caf27633975ec77ed4b6cd6b2d7c4209fff013d9b87b11f"
Sep 18 22:49:23.336013 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.335762    2570 scope.go:117] "RemoveContainer" containerID="23e68289be62f52cb17ad8e380eca9cc521c3869f7dcaf9cf58d0b01afa8d6b5"
Sep 18 22:49:23.351480 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.351459    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:49:23.363697 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.363674    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-socket\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.363830 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.363715    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eb958e-6922-44e2-b7b7-aa535ffc04de-istiod-ca-cert\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.363830 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.363756    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmzxj\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-kube-api-access-cmzxj\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.363830 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.363826    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-envoy\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.363986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.363920    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:49:23.363986 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.363948    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-token\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.364156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.363994    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-credential-socket\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.364156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364022    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-data\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.364156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364075    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-certs\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.364156 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364105    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-podinfo\") pod \"38eb958e-6922-44e2-b7b7-aa535ffc04de\" (UID: \"38eb958e-6922-44e2-b7b7-aa535ffc04de\") "
Sep 18 22:49:23.364378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364237    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:49:23.364378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364245    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38eb958e-6922-44e2-b7b7-aa535ffc04de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:49:23.364378 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364264    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-data" (OuterVolumeSpecName: "istio-data") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:49:23.364704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364431    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:49:23.364704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364559    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.364704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364572    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.364704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364581    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.364704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364589    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.364704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.364597    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eb958e-6922-44e2-b7b7-aa535ffc04de-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.366213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.366189    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-kube-api-access-cmzxj" (OuterVolumeSpecName: "kube-api-access-cmzxj") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "kube-api-access-cmzxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:49:23.366462 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.366421    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:49:23.366598 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.366583    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:49:23.366871 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.366843    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-token" (OuterVolumeSpecName: "istio-token") pod "38eb958e-6922-44e2-b7b7-aa535ffc04de" (UID: "38eb958e-6922-44e2-b7b7-aa535ffc04de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:49:23.465241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.465211    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.465241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.465237    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmzxj\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-kube-api-access-cmzxj\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.465241 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.465247    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.465501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.465256    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eb958e-6922-44e2-b7b7-aa535ffc04de-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:49:23.813008 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:23.812969    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:24.342541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:24.342511    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"
Sep 18 22:49:24.378033 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:24.377999    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"]
Sep 18 22:49:24.381610 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:24.381584    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf"]
Sep 18 22:49:24.584744 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:24.584714    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:25.403351 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:25.403315    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" path="/var/lib/kubelet/pods/38eb958e-6922-44e2-b7b7-aa535ffc04de/volumes"
Sep 18 22:49:25.716065 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:25.715961    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:26.406644 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:26.406603    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:37.299122 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:37.299046    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:37.474119 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:37.474089    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:37.611621 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:37.611576    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:37.715956 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:37.715924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:37.791207 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:37.791172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:38.119382 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:38.119337    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:38.310099 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:38.310071    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:39.305813 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:39.305759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:40.014904 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:40.014866    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:40.806554 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:40.806526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:42.908454 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:42.908410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:42.971559 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:42.971525    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:49:43.177271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:49:43.177191    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:13.513583 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:13.513553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:19.243536 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:19.243503    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:20.613991 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:20.613958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:26.297415 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:26.297359    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:40.934101 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:40.934066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:41.031215 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:41.031179    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:41.183510 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:41.183474    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:42.507339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:42.507305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:43.231527 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:43.231498    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:44.195703 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:44.195669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:44.880769 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:44.880738    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:52.146271 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.146240    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"]
Sep 18 22:50:52.146802 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.146538    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l" podUID="ccbecf5f-d3c4-4d43-be17-d1bcc800da65" containerName="maas-api" containerID="cri-o://83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636" gracePeriod=30
Sep 18 22:50:52.176612 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.176577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:52.261164 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.261136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:52.371347 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.371311    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:52.416130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.416068    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:50:52.536344 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.536303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:52.548835 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.548806    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-openshift-service-ca\") pod \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") "
Sep 18 22:50:52.548990 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.548854    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls\") pod \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") "
Sep 18 22:50:52.548990 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.548887    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8xrp\" (UniqueName: \"kubernetes.io/projected/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-kube-api-access-n8xrp\") pod \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") "
Sep 18 22:50:52.548990 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.548922    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-metrics-certs\") pod \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\" (UID: \"ccbecf5f-d3c4-4d43-be17-d1bcc800da65\") "
Sep 18 22:50:52.549240 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.549193    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccbecf5f-d3c4-4d43-be17-d1bcc800da65" (UID: "ccbecf5f-d3c4-4d43-be17-d1bcc800da65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:50:52.549590 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.549530    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-openshift-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:50:52.551526 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.551488    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ccbecf5f-d3c4-4d43-be17-d1bcc800da65" (UID: "ccbecf5f-d3c4-4d43-be17-d1bcc800da65"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:50:52.551646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.551604    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccbecf5f-d3c4-4d43-be17-d1bcc800da65" (UID: "ccbecf5f-d3c4-4d43-be17-d1bcc800da65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:50:52.551737 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.551711    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-kube-api-access-n8xrp" (OuterVolumeSpecName: "kube-api-access-n8xrp") pod "ccbecf5f-d3c4-4d43-be17-d1bcc800da65" (UID: "ccbecf5f-d3c4-4d43-be17-d1bcc800da65"). InnerVolumeSpecName "kube-api-access-n8xrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:50:52.628962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.628926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:52.650213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.650184    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-maas-api-tls\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:50:52.650213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.650209    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8xrp\" (UniqueName: \"kubernetes.io/projected/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-kube-api-access-n8xrp\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:50:52.650213 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.650218    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccbecf5f-d3c4-4d43-be17-d1bcc800da65-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:50:52.806370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.806285    2570 generic.go:356] "Generic (PLEG): container finished" podID="ccbecf5f-d3c4-4d43-be17-d1bcc800da65" containerID="83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636" exitCode=0
Sep 18 22:50:52.806370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.806337    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"
Sep 18 22:50:52.806535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.806385    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l" event={"ID":"ccbecf5f-d3c4-4d43-be17-d1bcc800da65","Type":"ContainerDied","Data":"83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636"}
Sep 18 22:50:52.806535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.806442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l" event={"ID":"ccbecf5f-d3c4-4d43-be17-d1bcc800da65","Type":"ContainerDied","Data":"c9640785808719f5e193e0caf9de415eea7cb08d405247fdf0ba751d1e62393d"}
Sep 18 22:50:52.806535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.806469    2570 scope.go:117] "RemoveContainer" containerID="83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636"
Sep 18 22:50:52.816571 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.816555    2570 scope.go:117] "RemoveContainer" containerID="83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636"
Sep 18 22:50:52.816868 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:50:52.816850    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636\": container with ID starting with 83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636 not found: ID does not exist" containerID="83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636"
Sep 18 22:50:52.817003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.816880    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636"} err="failed to get container status \"83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636\": rpc error: code = NotFound desc = could not find container \"83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636\": container with ID starting with 83c7bbd4a1da87a24c09da353c32915cecf857beb84eb1324571ee92d947e636 not found: ID does not exist"
Sep 18 22:50:52.857343 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.857312    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"]
Sep 18 22:50:52.860284 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:52.860265    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-36f843-5656695b4f-6qf2l"]
Sep 18 22:50:53.009595 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:53.009569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:53.134958 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:53.134928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:53.403345 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:53.403274    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccbecf5f-d3c4-4d43-be17-d1bcc800da65" path="/var/lib/kubelet/pods/ccbecf5f-d3c4-4d43-be17-d1bcc800da65/volumes"
Sep 18 22:50:54.050469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:54.050438    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:54.738452 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:54.738421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:58.711175 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:58.711141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:58.784660 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:58.784627    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:58.977647 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:58.977563    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"]
Sep 18 22:50:58.977911 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:58.977886    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy" containerID="cri-o://ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac" gracePeriod=30
Sep 18 22:50:58.997116 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:58.997085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:50:59.278232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:59.278152    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:50:59.278232 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:59.278216    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:50:59.859450 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:50:59.859418    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:00.815090 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:00.815054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:01.493203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:01.493171    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:02.342350 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:02.342313    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:04.246928 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.246868    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:51:04.363444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363409    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-envoy\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363444 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363448    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-kube-api-access-2qxw4\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363688 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363538    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-certs\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363688 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363572    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-socket\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363688 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363629    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-istio-token\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363688 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363664    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-credential-socket\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363704    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e18c6f9-1071-42f3-9053-b886791144dd-istio-podinfo\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363731    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-data\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363833    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e18c6f9-1071-42f3-9053-b886791144dd-istiod-ca-cert\") pod \"0e18c6f9-1071-42f3-9053-b886791144dd\" (UID: \"0e18c6f9-1071-42f3-9053-b886791144dd\") "
Sep 18 22:51:04.363948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363894    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:04.363948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.363906    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:04.364208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.364007    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:04.364208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.364135    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:04.364332 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.364233    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e18c6f9-1071-42f3-9053-b886791144dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:51:04.364384 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.364270    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.364496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.364440    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.364496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.364457    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.364496 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.364471    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.365950 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.365919    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:04.365950 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.365928    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-kube-api-access-2qxw4" (OuterVolumeSpecName: "kube-api-access-2qxw4") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "kube-api-access-2qxw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:51:04.365950 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.365936    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:51:04.366179 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.366164    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e18c6f9-1071-42f3-9053-b886791144dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e18c6f9-1071-42f3-9053-b886791144dd" (UID: "0e18c6f9-1071-42f3-9053-b886791144dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:51:04.465229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.465183    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.465229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.465224    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e18c6f9-1071-42f3-9053-b886791144dd-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.465229 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.465236    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e18c6f9-1071-42f3-9053-b886791144dd-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.465459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.465248    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e18c6f9-1071-42f3-9053-b886791144dd-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.465459 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.465260    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxw4\" (UniqueName: \"kubernetes.io/projected/0e18c6f9-1071-42f3-9053-b886791144dd-kube-api-access-2qxw4\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:04.874022 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.873986    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e18c6f9-1071-42f3-9053-b886791144dd" containerID="ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac" exitCode=0
Sep 18 22:51:04.874225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.874048    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"
Sep 18 22:51:04.874225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.874068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" event={"ID":"0e18c6f9-1071-42f3-9053-b886791144dd","Type":"ContainerDied","Data":"ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac"}
Sep 18 22:51:04.874225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.874127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26" event={"ID":"0e18c6f9-1071-42f3-9053-b886791144dd","Type":"ContainerDied","Data":"7f3a946d9676e47dfcedd7e9eab1cd3d63d370be10ceffa38b1bd5c2f5c6d7d2"}
Sep 18 22:51:04.874225 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.874152    2570 scope.go:117] "RemoveContainer" containerID="ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac"
Sep 18 22:51:04.883826 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.883806    2570 scope.go:117] "RemoveContainer" containerID="e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf"
Sep 18 22:51:04.892302 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.892286    2570 scope.go:117] "RemoveContainer" containerID="ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac"
Sep 18 22:51:04.892573 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:51:04.892553    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac\": container with ID starting with ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac not found: ID does not exist" containerID="ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac"
Sep 18 22:51:04.892646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.892586    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac"} err="failed to get container status \"ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac\": rpc error: code = NotFound desc = could not find container \"ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac\": container with ID starting with ca264afbfcd622e4ad35b9400af82fab9a7f17939f6982bf4348f1fb8e389aac not found: ID does not exist"
Sep 18 22:51:04.892646 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.892611    2570 scope.go:117] "RemoveContainer" containerID="e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf"
Sep 18 22:51:04.892892 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:51:04.892873    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf\": container with ID starting with e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf not found: ID does not exist" containerID="e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf"
Sep 18 22:51:04.892941 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.892902    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf"} err="failed to get container status \"e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf\": rpc error: code = NotFound desc = could not find container \"e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf\": container with ID starting with e39b20cf6db1afba863b833a1e880afdfa05610cca5cdfba6cfbc8ea12fdacbf not found: ID does not exist"
Sep 18 22:51:04.898545 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.898513    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"]
Sep 18 22:51:04.904109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:04.904085    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26"]
Sep 18 22:51:05.403972 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:05.403941    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" path="/var/lib/kubelet/pods/0e18c6f9-1071-42f3-9053-b886791144dd/volumes"
Sep 18 22:51:09.832162 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:09.832126    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"]
Sep 18 22:51:09.833029 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:09.832995    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" podUID="d1600330-f0c1-447f-837c-455b0225945e" containerName="maas-api" containerID="cri-o://db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9" gracePeriod=30
Sep 18 22:51:09.864911 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:09.864881    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:09.936073 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:09.936042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:10.010673 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.010623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:10.088830 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.088805    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:10.090256 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.090240    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:51:10.119414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.119383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls\") pod \"d1600330-f0c1-447f-837c-455b0225945e\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") "
Sep 18 22:51:10.119574 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.119456    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-metrics-certs\") pod \"d1600330-f0c1-447f-837c-455b0225945e\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") "
Sep 18 22:51:10.119574 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.119513    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1600330-f0c1-447f-837c-455b0225945e-openshift-service-ca\") pod \"d1600330-f0c1-447f-837c-455b0225945e\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") "
Sep 18 22:51:10.119712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.119584    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp62c\" (UniqueName: \"kubernetes.io/projected/d1600330-f0c1-447f-837c-455b0225945e-kube-api-access-sp62c\") pod \"d1600330-f0c1-447f-837c-455b0225945e\" (UID: \"d1600330-f0c1-447f-837c-455b0225945e\") "
Sep 18 22:51:10.119960 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.119927    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1600330-f0c1-447f-837c-455b0225945e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1600330-f0c1-447f-837c-455b0225945e" (UID: "d1600330-f0c1-447f-837c-455b0225945e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:51:10.121793 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.121753    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1600330-f0c1-447f-837c-455b0225945e" (UID: "d1600330-f0c1-447f-837c-455b0225945e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:51:10.121907 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.121875    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1600330-f0c1-447f-837c-455b0225945e-kube-api-access-sp62c" (OuterVolumeSpecName: "kube-api-access-sp62c") pod "d1600330-f0c1-447f-837c-455b0225945e" (UID: "d1600330-f0c1-447f-837c-455b0225945e"). InnerVolumeSpecName "kube-api-access-sp62c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:51:10.121976 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.121940    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d1600330-f0c1-447f-837c-455b0225945e" (UID: "d1600330-f0c1-447f-837c-455b0225945e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:51:10.161661 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.161635    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:10.221103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.221073    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-maas-api-tls\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:10.221209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.221108    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1600330-f0c1-447f-837c-455b0225945e-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:10.221209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.221125    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1600330-f0c1-447f-837c-455b0225945e-openshift-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:10.221209 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.221140    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp62c\" (UniqueName: \"kubernetes.io/projected/d1600330-f0c1-447f-837c-455b0225945e-kube-api-access-sp62c\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:10.462380 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.462302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:10.562270 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.562232    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:10.909178 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.909144    2570 generic.go:356] "Generic (PLEG): container finished" podID="d1600330-f0c1-447f-837c-455b0225945e" containerID="db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9" exitCode=0
Sep 18 22:51:10.909586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.909185    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"
Sep 18 22:51:10.909586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.909229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" event={"ID":"d1600330-f0c1-447f-837c-455b0225945e","Type":"ContainerDied","Data":"db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9"}
Sep 18 22:51:10.909586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.909279    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx" event={"ID":"d1600330-f0c1-447f-837c-455b0225945e","Type":"ContainerDied","Data":"9a5ed9791d94ba4f00577f3356ef8f4296cbebe76f13e5722cbd51f70ae2d1d6"}
Sep 18 22:51:10.909586 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.909309    2570 scope.go:117] "RemoveContainer" containerID="db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9"
Sep 18 22:51:10.919557 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.919540    2570 scope.go:117] "RemoveContainer" containerID="db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9"
Sep 18 22:51:10.919836 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:51:10.919817    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9\": container with ID starting with db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9 not found: ID does not exist" containerID="db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9"
Sep 18 22:51:10.919881 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.919845    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9"} err="failed to get container status \"db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9\": rpc error: code = NotFound desc = could not find container \"db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9\": container with ID starting with db9715527e8de25842d8aa30201df6d3ea5769b89d2cd6f3a9665f896da07fa9 not found: ID does not exist"
Sep 18 22:51:10.930704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.930682    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"]
Sep 18 22:51:10.936154 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:10.936131    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-d6c0ac-64bc4d8cdd-c9jwx"]
Sep 18 22:51:11.252910 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:11.252829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:11.403348 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:11.403316    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1600330-f0c1-447f-837c-455b0225945e" path="/var/lib/kubelet/pods/d1600330-f0c1-447f-837c-455b0225945e/volumes"
Sep 18 22:51:16.665900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:16.665868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:16.745833 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:16.745803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:17.056663 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:17.056573    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"]
Sep 18 22:51:17.056898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:17.056874    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy" containerID="cri-o://b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a" gracePeriod=30
Sep 18 22:51:17.143453 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:17.143421    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:17.689104 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:17.689076    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:18.519972 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:18.519929    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:19.198277 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:19.198247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:22.306653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.306624    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:51:22.443931 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.443896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-data\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.443964    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-credential-socket\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.443984    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-envoy\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444002    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864c90bb-ec66-4327-b61e-9483ee26de88-istiod-ca-cert\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444018    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-istio-token\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444046    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-socket\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444125 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444073    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f84s\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-kube-api-access-6f84s\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444169    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864c90bb-ec66-4327-b61e-9483ee26de88-istio-podinfo\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444190    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-data" (OuterVolumeSpecName: "istio-data") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:22.444469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444201    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-certs\") pod \"864c90bb-ec66-4327-b61e-9483ee26de88\" (UID: \"864c90bb-ec66-4327-b61e-9483ee26de88\") "
Sep 18 22:51:22.444469 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444320    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:22.444668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444495    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:22.444668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444562    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:22.444668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444563    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/864c90bb-ec66-4327-b61e-9483ee26de88-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:51:22.445037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444699    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-credential-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.445037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444723    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864c90bb-ec66-4327-b61e-9483ee26de88-istiod-ca-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.445037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444737    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-socket\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.445037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444750    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-workload-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.445037 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.444763    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-data\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.446419 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.446395    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-istio-token" (OuterVolumeSpecName: "istio-token") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:51:22.446527 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.446417    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:51:22.446527 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.446484    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/864c90bb-ec66-4327-b61e-9483ee26de88-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 22:51:22.447108 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.447084    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-kube-api-access-6f84s" (OuterVolumeSpecName: "kube-api-access-6f84s") pod "864c90bb-ec66-4327-b61e-9483ee26de88" (UID: "864c90bb-ec66-4327-b61e-9483ee26de88"). InnerVolumeSpecName "kube-api-access-6f84s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:51:22.545623 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.545591    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f84s\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-kube-api-access-6f84s\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.545623 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.545617    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864c90bb-ec66-4327-b61e-9483ee26de88-istio-podinfo\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.545623 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.545626    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864c90bb-ec66-4327-b61e-9483ee26de88-istio-envoy\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.545868 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.545634    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864c90bb-ec66-4327-b61e-9483ee26de88-istio-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:51:22.974686 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.974649    2570 generic.go:356] "Generic (PLEG): container finished" podID="864c90bb-ec66-4327-b61e-9483ee26de88" containerID="b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a" exitCode=0
Sep 18 22:51:22.974860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.974705    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"
Sep 18 22:51:22.974860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.974732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" event={"ID":"864c90bb-ec66-4327-b61e-9483ee26de88","Type":"ContainerDied","Data":"b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a"}
Sep 18 22:51:22.974860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.974807    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks" event={"ID":"864c90bb-ec66-4327-b61e-9483ee26de88","Type":"ContainerDied","Data":"2963ea6a340ae6907c2a4f1bb61809d836ca4f877520973cf3336fdcf6a35dfe"}
Sep 18 22:51:22.974860 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.974851    2570 scope.go:117] "RemoveContainer" containerID="b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a"
Sep 18 22:51:22.984267 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.984253    2570 scope.go:117] "RemoveContainer" containerID="7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470"
Sep 18 22:51:22.992594 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.992576    2570 scope.go:117] "RemoveContainer" containerID="b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a"
Sep 18 22:51:22.992862 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:51:22.992845    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a\": container with ID starting with b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a not found: ID does not exist" containerID="b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a"
Sep 18 22:51:22.992914 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.992871    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a"} err="failed to get container status \"b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a\": rpc error: code = NotFound desc = could not find container \"b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a\": container with ID starting with b45d249170030cd581411d3cb809f26ddd3907c9d016e8a8dbb78a39bbbf804a not found: ID does not exist"
Sep 18 22:51:22.992914 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.992887    2570 scope.go:117] "RemoveContainer" containerID="7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470"
Sep 18 22:51:22.993099 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:51:22.993086    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470\": container with ID starting with 7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470 not found: ID does not exist" containerID="7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470"
Sep 18 22:51:22.993137 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.993104    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470"} err="failed to get container status \"7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470\": rpc error: code = NotFound desc = could not find container \"7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470\": container with ID starting with 7ec4e803e8bc4e68b496fd27644b0e9332e9963d04fdfa8bc2b6b37689604470 not found: ID does not exist"
Sep 18 22:51:22.998647 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:22.998624    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"]
Sep 18 22:51:23.004996 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:23.004975    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks"]
Sep 18 22:51:23.403236 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:23.403203    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" path="/var/lib/kubelet/pods/864c90bb-ec66-4327-b61e-9483ee26de88/volumes"
Sep 18 22:51:27.850370 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:27.850328    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:27.952611 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:27.952578    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:28.050084 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:28.050051    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:28.130407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:28.130320    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:28.467448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:28.467359    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:28.567059 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:28.566994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:32.058961 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:32.058911    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:34.599691 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:34.599658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:34.675900 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:34.675864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:34.898103 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:34.898023    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:51:51.544337 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:51.544310    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:51:51.551928 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:51:51.551904    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:52:38.999774 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:38.999688    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8567457bbb-j8nn5"]
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000112    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000124    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000137    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000142    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000151    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000156    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000167    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000172    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000183    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1600330-f0c1-447f-837c-455b0225945e" containerName="maas-api"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000188    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1600330-f0c1-447f-837c-455b0225945e" containerName="maas-api"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000197    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy"
Sep 18 22:52:39.000203 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000202    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000213    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccbecf5f-d3c4-4d43-be17-d1bcc800da65" containerName="maas-api"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000218    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccbecf5f-d3c4-4d43-be17-d1bcc800da65" containerName="maas-api"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000276    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1600330-f0c1-447f-837c-455b0225945e" containerName="maas-api"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000284    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000290    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000295    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000300    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="38eb958e-6922-44e2-b7b7-aa535ffc04de" containerName="istio-proxy"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000307    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy"
Sep 18 22:52:39.000570 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.000311    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccbecf5f-d3c4-4d43-be17-d1bcc800da65" containerName="maas-api"
Sep 18 22:52:39.003422 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.003407    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.007129 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.007106    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 22:52:39.008126 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.008098    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 22:52:39.008244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.008102    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 22:52:39.008244 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.008158    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lqtmn\""
Sep 18 22:52:39.022917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.022889    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8567457bbb-j8nn5"]
Sep 18 22:52:39.059659 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.059622    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46hbj\" (UniqueName: \"kubernetes.io/projected/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-kube-api-access-46hbj\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.059841 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.059701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-webhook-cert\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.059921 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.059849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-metrics-certs\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.161066 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.161036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-webhook-cert\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.161222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.161121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-metrics-certs\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.161222 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.161146    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46hbj\" (UniqueName: \"kubernetes.io/projected/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-kube-api-access-46hbj\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.163856 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.163833    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-metrics-certs\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.163978 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.163889    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-webhook-cert\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.173081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.173058    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46hbj\" (UniqueName: \"kubernetes.io/projected/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-kube-api-access-46hbj\") pod \"maas-controller-8567457bbb-j8nn5\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") " pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.314205 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.314114    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:39.594871 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.594846    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8567457bbb-j8nn5"]
Sep 18 22:52:39.596701 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:52:39.596673    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865c9e53_fb79_4d38_a4e1_0eca88fdc3b2.slice/crio-9f7fe40b092a53023d0626676b812baae5d666bbb7dc26700d5890b4243082e1 WatchSource:0}: Error finding container 9f7fe40b092a53023d0626676b812baae5d666bbb7dc26700d5890b4243082e1: Status 404 returned error can't find the container with id 9f7fe40b092a53023d0626676b812baae5d666bbb7dc26700d5890b4243082e1
Sep 18 22:52:39.598123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:39.598106    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:52:40.377814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:40.377702    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8567457bbb-j8nn5" event={"ID":"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2","Type":"ContainerStarted","Data":"e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74"}
Sep 18 22:52:40.377814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:40.377760    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8567457bbb-j8nn5" event={"ID":"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2","Type":"ContainerStarted","Data":"9f7fe40b092a53023d0626676b812baae5d666bbb7dc26700d5890b4243082e1"}
Sep 18 22:52:40.377814 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:40.377812    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:52:40.410458 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:40.410409    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8567457bbb-j8nn5" podStartSLOduration=1.913185777 podStartE2EDuration="2.410388708s" totalImagesPullingTime="497.202931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:52:40.408673752 +0000 UTC m=+2150.986618898" watchObservedRunningTime="2026-09-18 22:52:40.410388708 +0000 UTC m=+2150.988333858"
Sep 18 22:52:51.386093 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:52:51.386062    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:53:02.706365 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:02.706324    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:53:02.804606 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:02.804569    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8567457bbb-j8nn5"]
Sep 18 22:53:02.804924 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:02.804888    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8567457bbb-j8nn5" podUID="865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" containerName="manager" containerID="cri-o://e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74" gracePeriod=30
Sep 18 22:53:03.059279 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.059253    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:53:03.187357 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.187325    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-webhook-cert\") pod \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") "
Sep 18 22:53:03.187558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.187428    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46hbj\" (UniqueName: \"kubernetes.io/projected/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-kube-api-access-46hbj\") pod \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") "
Sep 18 22:53:03.187558 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.187471    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-metrics-certs\") pod \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\" (UID: \"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2\") "
Sep 18 22:53:03.189649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.189618    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" (UID: "865c9e53-fb79-4d38-a4e1-0eca88fdc3b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:53:03.189763 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.189705    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" (UID: "865c9e53-fb79-4d38-a4e1-0eca88fdc3b2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:53:03.189838 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.189801    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-kube-api-access-46hbj" (OuterVolumeSpecName: "kube-api-access-46hbj") pod "865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" (UID: "865c9e53-fb79-4d38-a4e1-0eca88fdc3b2"). InnerVolumeSpecName "kube-api-access-46hbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:53:03.288823 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.288737    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-webhook-cert\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:53:03.288823 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.288762    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46hbj\" (UniqueName: \"kubernetes.io/projected/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-kube-api-access-46hbj\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:53:03.288823 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.288773    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:53:03.494259 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.494226    2570 generic.go:356] "Generic (PLEG): container finished" podID="865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" containerID="e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74" exitCode=0
Sep 18 22:53:03.494433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.494270    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8567457bbb-j8nn5"
Sep 18 22:53:03.494433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.494320    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8567457bbb-j8nn5" event={"ID":"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2","Type":"ContainerDied","Data":"e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74"}
Sep 18 22:53:03.494433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.494376    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8567457bbb-j8nn5" event={"ID":"865c9e53-fb79-4d38-a4e1-0eca88fdc3b2","Type":"ContainerDied","Data":"9f7fe40b092a53023d0626676b812baae5d666bbb7dc26700d5890b4243082e1"}
Sep 18 22:53:03.494433 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.494406    2570 scope.go:117] "RemoveContainer" containerID="e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74"
Sep 18 22:53:03.503463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.503438    2570 scope.go:117] "RemoveContainer" containerID="e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74"
Sep 18 22:53:03.503735 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:53:03.503715    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74\": container with ID starting with e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74 not found: ID does not exist" containerID="e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74"
Sep 18 22:53:03.503840 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.503747    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74"} err="failed to get container status \"e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74\": rpc error: code = NotFound desc = could not find container \"e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74\": container with ID starting with e56caea97e894a451e1d0c61a69b7c12d2163271d3d3d95bba2c516a95493d74 not found: ID does not exist"
Sep 18 22:53:03.511793 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.511761    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8567457bbb-j8nn5"]
Sep 18 22:53:03.516479 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:03.516458    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8567457bbb-j8nn5"]
Sep 18 22:53:04.159661 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.159628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:53:04.271040 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.270993    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8567457bbb-f2zhw"]
Sep 18 22:53:04.271420 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.271407    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy"
Sep 18 22:53:04.271471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.271423    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e18c6f9-1071-42f3-9053-b886791144dd" containerName="istio-proxy"
Sep 18 22:53:04.271471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.271437    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" containerName="manager"
Sep 18 22:53:04.271471 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.271444    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" containerName="manager"
Sep 18 22:53:04.271576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.271524    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" containerName="manager"
Sep 18 22:53:04.271576 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.271533    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="864c90bb-ec66-4327-b61e-9483ee26de88" containerName="istio-proxy"
Sep 18 22:53:04.276039 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.276023    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.279196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.279162    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 22:53:04.279196 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.279182    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lqtmn\""
Sep 18 22:53:04.279407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.279165    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 22:53:04.279407 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.279287    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 22:53:04.283474 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.283448    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8567457bbb-f2zhw"]
Sep 18 22:53:04.398414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.398382    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5054bcae-c892-4b80-8749-f69fe76060df-metrics-certs\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.398414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.398428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5054bcae-c892-4b80-8749-f69fe76060df-webhook-cert\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.398649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.398541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8h2f\" (UniqueName: \"kubernetes.io/projected/5054bcae-c892-4b80-8749-f69fe76060df-kube-api-access-k8h2f\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.499383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.499296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5054bcae-c892-4b80-8749-f69fe76060df-metrics-certs\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.499383 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.499333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5054bcae-c892-4b80-8749-f69fe76060df-webhook-cert\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.499617 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.499488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8h2f\" (UniqueName: \"kubernetes.io/projected/5054bcae-c892-4b80-8749-f69fe76060df-kube-api-access-k8h2f\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.502338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.502315    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5054bcae-c892-4b80-8749-f69fe76060df-webhook-cert\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.502338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.502324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5054bcae-c892-4b80-8749-f69fe76060df-metrics-certs\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.507470 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.507450    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8h2f\" (UniqueName: \"kubernetes.io/projected/5054bcae-c892-4b80-8749-f69fe76060df-kube-api-access-k8h2f\") pod \"maas-controller-8567457bbb-f2zhw\" (UID: \"5054bcae-c892-4b80-8749-f69fe76060df\") " pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.589555 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.589517    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:04.861640 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:04.861513    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8567457bbb-f2zhw"]
Sep 18 22:53:04.864642 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:53:04.864614    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5054bcae_c892_4b80_8749_f69fe76060df.slice/crio-d9df34517beacad5d29344ad96d9577f382ba3ea57c6247cd82b6ff828e1fb43 WatchSource:0}: Error finding container d9df34517beacad5d29344ad96d9577f382ba3ea57c6247cd82b6ff828e1fb43: Status 404 returned error can't find the container with id d9df34517beacad5d29344ad96d9577f382ba3ea57c6247cd82b6ff828e1fb43
Sep 18 22:53:05.404335 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:05.404303    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865c9e53-fb79-4d38-a4e1-0eca88fdc3b2" path="/var/lib/kubelet/pods/865c9e53-fb79-4d38-a4e1-0eca88fdc3b2/volumes"
Sep 18 22:53:05.509413 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:05.509327    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8567457bbb-f2zhw" event={"ID":"5054bcae-c892-4b80-8749-f69fe76060df","Type":"ContainerStarted","Data":"66a3d21fe77e888359e190d532f31b247edd738d6fdfe644eef6b13a07638f93"}
Sep 18 22:53:05.509413 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:05.509389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8567457bbb-f2zhw" event={"ID":"5054bcae-c892-4b80-8749-f69fe76060df","Type":"ContainerStarted","Data":"d9df34517beacad5d29344ad96d9577f382ba3ea57c6247cd82b6ff828e1fb43"}
Sep 18 22:53:05.509585 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:05.509468    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:05.532249 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:05.532200    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8567457bbb-f2zhw" podStartSLOduration=1.240257621 podStartE2EDuration="1.532183669s" totalImagesPullingTime="291.926048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:53:05.530375601 +0000 UTC m=+2176.108320747" watchObservedRunningTime="2026-09-18 22:53:05.532183669 +0000 UTC m=+2176.110128814"
Sep 18 22:53:16.516721 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:16.516690    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8567457bbb-f2zhw"
Sep 18 22:53:34.583197 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:53:34.583148    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:54:00.941157 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:54:00.941120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:54:37.617912 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:54:37.617875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:54:37.718058 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:54:37.718022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:54:51.869680 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:54:51.869648    2570 scope.go:117] "RemoveContainer" containerID="49aaab38bd04afe298b8a80a037956bb67c53302c77c5c5e9df0e83471535f20"
Sep 18 22:56:05.412842 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:05.412808    2570 generic.go:356] "Generic (PLEG): container finished" podID="acdb403a-0273-4907-9eee-c95be4eb980e" containerID="8aad0de1fe5d90d0592cf9dfe34c08129b6e9be954c2a08a681ef05e507b82ba" exitCode=1
Sep 18 22:56:05.413307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:05.412858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr" event={"ID":"acdb403a-0273-4907-9eee-c95be4eb980e","Type":"ContainerDied","Data":"8aad0de1fe5d90d0592cf9dfe34c08129b6e9be954c2a08a681ef05e507b82ba"}
Sep 18 22:56:05.413307 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:05.413207    2570 scope.go:117] "RemoveContainer" containerID="8aad0de1fe5d90d0592cf9dfe34c08129b6e9be954c2a08a681ef05e507b82ba"
Sep 18 22:56:06.419750 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:06.419716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr" event={"ID":"acdb403a-0273-4907-9eee-c95be4eb980e","Type":"ContainerStarted","Data":"161905afcc37be4b931a31796e45f235991d2670349eb7ebb76c87591f132176"}
Sep 18 22:56:06.420173 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:06.419934    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:56:07.425982 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:07.425951    2570 generic.go:356] "Generic (PLEG): container finished" podID="a2b169e5-e868-4b63-86e8-eef7304f093d" containerID="cf6e73e805c571272faffc19f8fafe191dc6183be8e70903ee92282bd7620c5f" exitCode=1
Sep 18 22:56:07.426364 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:07.426036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" event={"ID":"a2b169e5-e868-4b63-86e8-eef7304f093d","Type":"ContainerDied","Data":"cf6e73e805c571272faffc19f8fafe191dc6183be8e70903ee92282bd7620c5f"}
Sep 18 22:56:07.426441 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:07.426427    2570 scope.go:117] "RemoveContainer" containerID="cf6e73e805c571272faffc19f8fafe191dc6183be8e70903ee92282bd7620c5f"
Sep 18 22:56:08.434700 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:08.434665    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" event={"ID":"a2b169e5-e868-4b63-86e8-eef7304f093d","Type":"ContainerStarted","Data":"c19246c94cd3833cfa450b44f050bd08bde48d25cb31878727540887a132303d"}
Sep 18 22:56:08.435161 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:08.434881    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:56:19.491707 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:19.491672    2570 generic.go:356] "Generic (PLEG): container finished" podID="a2b169e5-e868-4b63-86e8-eef7304f093d" containerID="c19246c94cd3833cfa450b44f050bd08bde48d25cb31878727540887a132303d" exitCode=1
Sep 18 22:56:19.492243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:19.491747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" event={"ID":"a2b169e5-e868-4b63-86e8-eef7304f093d","Type":"ContainerDied","Data":"c19246c94cd3833cfa450b44f050bd08bde48d25cb31878727540887a132303d"}
Sep 18 22:56:19.492243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:19.491842    2570 scope.go:117] "RemoveContainer" containerID="cf6e73e805c571272faffc19f8fafe191dc6183be8e70903ee92282bd7620c5f"
Sep 18 22:56:19.492243 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:19.492154    2570 scope.go:117] "RemoveContainer" containerID="c19246c94cd3833cfa450b44f050bd08bde48d25cb31878727540887a132303d"
Sep 18 22:56:19.492370 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:56:19.492340    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-777c6bd7d5-mg49l_opendatahub(a2b169e5-e868-4b63-86e8-eef7304f093d)\"" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" podUID="a2b169e5-e868-4b63-86e8-eef7304f093d"
Sep 18 22:56:28.883588 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:28.883554    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:56:28.884003 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:28.883950    2570 scope.go:117] "RemoveContainer" containerID="c19246c94cd3833cfa450b44f050bd08bde48d25cb31878727540887a132303d"
Sep 18 22:56:29.548394 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:29.548312    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l" event={"ID":"a2b169e5-e868-4b63-86e8-eef7304f093d","Type":"ContainerStarted","Data":"e70d347646be52d24402999f98d2b08fcf6c6f963239b30d678aa9cf9e733e94"}
Sep 18 22:56:29.548541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:29.548510    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:56:37.431773 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:37.431743    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-62zgr"
Sep 18 22:56:47.482306 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:47.482265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:56:47.543994 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:47.543962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:56:51.577913 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:51.577883    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:56:51.585329 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:51.585310    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnrp7_cf765131-c9a6-49d3-8707-daecd8fd59d1/ovn-acl-logging/0.log"
Sep 18 22:56:58.091645 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.091606    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"]
Sep 18 22:56:58.095712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.095694    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.105762 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.105734    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"]
Sep 18 22:56:58.231876 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.231834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2b62be0-6134-4a4a-970e-88a65c852ce0-maas-api-tls\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.232080 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.231905    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b62be0-6134-4a4a-970e-88a65c852ce0-metrics-certs\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.232080 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.231954    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b62be0-6134-4a4a-970e-88a65c852ce0-openshift-service-ca\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.232080 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.231973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlw4\" (UniqueName: \"kubernetes.io/projected/e2b62be0-6134-4a4a-970e-88a65c852ce0-kube-api-access-xtlw4\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.333274 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.333242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2b62be0-6134-4a4a-970e-88a65c852ce0-maas-api-tls\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.333523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.333296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b62be0-6134-4a4a-970e-88a65c852ce0-metrics-certs\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.333523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.333359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b62be0-6134-4a4a-970e-88a65c852ce0-openshift-service-ca\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.333523 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.333378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlw4\" (UniqueName: \"kubernetes.io/projected/e2b62be0-6134-4a4a-970e-88a65c852ce0-kube-api-access-xtlw4\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.334283 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.334256    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2b62be0-6134-4a4a-970e-88a65c852ce0-openshift-service-ca\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.336239 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.336210    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2b62be0-6134-4a4a-970e-88a65c852ce0-metrics-certs\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.336418 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.336307    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2b62be0-6134-4a4a-970e-88a65c852ce0-maas-api-tls\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.341142 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.341120    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlw4\" (UniqueName: \"kubernetes.io/projected/e2b62be0-6134-4a4a-970e-88a65c852ce0-kube-api-access-xtlw4\") pod \"maas-api-68c86dfd56-kmhvc\" (UID: \"e2b62be0-6134-4a4a-970e-88a65c852ce0\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.408123 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.408031    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:58.699052 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:58.698963    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"]
Sep 18 22:56:59.713449 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:59.713397    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc" event={"ID":"e2b62be0-6134-4a4a-970e-88a65c852ce0","Type":"ContainerStarted","Data":"09b43c4c7f8e3471b3bba4158d508c1fcd4dece8d44d21bf6041f745cda10318"}
Sep 18 22:56:59.713887 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:59.713471    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:56:59.713887 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:59.713491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc" event={"ID":"e2b62be0-6134-4a4a-970e-88a65c852ce0","Type":"ContainerStarted","Data":"b80eeed15fc640bc1ff46a7053afb79b3ee40c3d4c8c8c54e0748e245639d77e"}
Sep 18 22:56:59.733299 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:56:59.733251    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc" podStartSLOduration=1.302160564 podStartE2EDuration="1.733233478s" totalImagesPullingTime="431.072914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:56:59.731884265 +0000 UTC m=+2410.309829411" watchObservedRunningTime="2026-09-18 22:56:59.733233478 +0000 UTC m=+2410.311178622"
Sep 18 22:57:00.555541 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:00.555505    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mg49l"
Sep 18 22:57:05.724670 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:05.724583    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-kmhvc"
Sep 18 22:57:13.465392 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:13.465359    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"]
Sep 18 22:57:13.465833 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:13.465624    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8" podUID="ddc7dfae-3790-4555-95c1-d2aae82a49fd" containerName="maas-api" containerID="cri-o://11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c" gracePeriod=30
Sep 18 22:57:14.722954 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.722928    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:57:14.795445 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.795360    2570 generic.go:356] "Generic (PLEG): container finished" podID="ddc7dfae-3790-4555-95c1-d2aae82a49fd" containerID="11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c" exitCode=0
Sep 18 22:57:14.795445 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.795403    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"
Sep 18 22:57:14.795614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.795442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8" event={"ID":"ddc7dfae-3790-4555-95c1-d2aae82a49fd","Type":"ContainerDied","Data":"11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c"}
Sep 18 22:57:14.795614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.795495    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8" event={"ID":"ddc7dfae-3790-4555-95c1-d2aae82a49fd","Type":"ContainerDied","Data":"33900dbd45bf51df64219666855c3ae96c1da06cb94f2c9ade0ff230f022fe45"}
Sep 18 22:57:14.795614 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.795517    2570 scope.go:117] "RemoveContainer" containerID="11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c"
Sep 18 22:57:14.804867 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.804844    2570 scope.go:117] "RemoveContainer" containerID="11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c"
Sep 18 22:57:14.805183 ip-10-0-139-21 kubenswrapper[2570]: E0918 22:57:14.805164    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c\": container with ID starting with 11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c not found: ID does not exist" containerID="11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c"
Sep 18 22:57:14.805251 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.805193    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c"} err="failed to get container status \"11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c\": rpc error: code = NotFound desc = could not find container \"11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c\": container with ID starting with 11d35d3fedf9b03edab97f5c699d1b09f29e27c436681fe6fdb0a75a47c8c42c not found: ID does not exist"
Sep 18 22:57:14.897339 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.897306    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kplc8\" (UniqueName: \"kubernetes.io/projected/ddc7dfae-3790-4555-95c1-d2aae82a49fd-kube-api-access-kplc8\") pod \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") "
Sep 18 22:57:14.897505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.897440    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls\") pod \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") "
Sep 18 22:57:14.897505 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.897486    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc7dfae-3790-4555-95c1-d2aae82a49fd-openshift-service-ca\") pod \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") "
Sep 18 22:57:14.897625 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.897517    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs\") pod \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\" (UID: \"ddc7dfae-3790-4555-95c1-d2aae82a49fd\") "
Sep 18 22:57:14.897894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.897853    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddc7dfae-3790-4555-95c1-d2aae82a49fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ddc7dfae-3790-4555-95c1-d2aae82a49fd" (UID: "ddc7dfae-3790-4555-95c1-d2aae82a49fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:57:14.898023 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.897944    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddc7dfae-3790-4555-95c1-d2aae82a49fd-openshift-service-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:57:14.899755 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.899726    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddc7dfae-3790-4555-95c1-d2aae82a49fd-kube-api-access-kplc8" (OuterVolumeSpecName: "kube-api-access-kplc8") pod "ddc7dfae-3790-4555-95c1-d2aae82a49fd" (UID: "ddc7dfae-3790-4555-95c1-d2aae82a49fd"). InnerVolumeSpecName "kube-api-access-kplc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:57:14.899916 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.899767    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ddc7dfae-3790-4555-95c1-d2aae82a49fd" (UID: "ddc7dfae-3790-4555-95c1-d2aae82a49fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:57:14.899916 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.899850    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ddc7dfae-3790-4555-95c1-d2aae82a49fd" (UID: "ddc7dfae-3790-4555-95c1-d2aae82a49fd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:57:14.998898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.998867    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kplc8\" (UniqueName: \"kubernetes.io/projected/ddc7dfae-3790-4555-95c1-d2aae82a49fd-kube-api-access-kplc8\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:57:14.998898 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.998894    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-maas-api-tls\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:57:14.999098 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:14.998909    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ddc7dfae-3790-4555-95c1-d2aae82a49fd-metrics-certs\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
Sep 18 22:57:15.116036 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:15.116005    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"]
Sep 18 22:57:15.122355 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:15.122327    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-bf8z8"]
Sep 18 22:57:15.403356 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:15.403272    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddc7dfae-3790-4555-95c1-d2aae82a49fd" path="/var/lib/kubelet/pods/ddc7dfae-3790-4555-95c1-d2aae82a49fd/volumes"
Sep 18 22:57:27.855901 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:27.855870    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-646f74d496-h24nm_d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a/authorino/0.log"
Sep 18 22:57:33.086977 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:33.086942    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-62zgr_acdb403a-0273-4907-9eee-c95be4eb980e/manager/1.log"
Sep 18 22:57:33.203318 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:33.203288    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mg49l_a2b169e5-e868-4b63-86e8-eef7304f093d/manager/2.log"
Sep 18 22:57:33.321026 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:33.320995    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8567457bbb-f2zhw_5054bcae-c892-4b80-8749-f69fe76060df/manager/0.log"
Sep 18 22:57:33.683376 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:33.683349    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c85dbc8b-w8qqh_327177e8-0ff4-4419-9fa3-5e69f5b71d2a/copy-manifests/0.log"
Sep 18 22:57:33.691967 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:33.691945    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c85dbc8b-w8qqh_327177e8-0ff4-4419-9fa3-5e69f5b71d2a/manager/0.log"
Sep 18 22:57:34.403996 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:34.403965    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-68c86dfd56-kmhvc_e2b62be0-6134-4a4a-970e-88a65c852ce0/maas-api/0.log"
Sep 18 22:57:34.733395 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:34.733308    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qhq9k_46651199-1b21-4eb1-a323-285ea147f97b/postgres/0.log"
Sep 18 22:57:35.487263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:35.487225    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-646f74d496-h24nm_d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a/authorino/0.log"
Sep 18 22:57:35.610004 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:35.609975    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-znmb8_03d5cf4c-b252-4796-9ad2-d9efef0bda0a/manager/0.log"
Sep 18 22:57:35.822531 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:35.822455    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4s2dn_24a3c4e7-f64c-4512-9d03-a02f87a3703a/kuadrant-console-plugin/0.log"
Sep 18 22:57:36.176401 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:36.176369    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-kqrr8_a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb/manager/0.log"
Sep 18 22:57:36.523802 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:36.523712    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb_9e7c86ab-3f40-4257-9040-d8bf3304964e/istio-proxy/0.log"
Sep 18 22:57:36.862878 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:36.862847    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b786b9564-lhwbt_2a1adce9-0c0c-4da8-9eee-92e60d09c3ac/kube-auth-proxy/0.log"
Sep 18 22:57:36.971790 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:36.971745    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9pkn8_96fef461-96b6-4e72-929a-2b64f97f9be1/istio-proxy/1.log"
Sep 18 22:57:37.317044 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:37.316949    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685768998d-vj8pc_9a9561c5-308e-4618-a8d4-c49745121a7a/router/0.log"
Sep 18 22:57:37.658009 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:37.657979    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lw7nz_847cd8e7-3a4f-4bef-a438-05540aab4c42/main/0.log"
Sep 18 22:57:37.878431 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:37.878388    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-7d9w5_a45efa93-454c-4938-8102-16b0b5ff5ac0/main/0.log"
Sep 18 22:57:38.099509 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:38.099482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8hzlg_884acf9a-cd5d-4720-87d6-df0a61329f96/main/0.log"
Sep 18 22:57:44.123823 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:44.123769    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:57:44.249237 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:44.249201    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:57:47.238946 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:47.238913    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qfmqn_fb35237d-fa0a-4732-9f7a-64783a41bcbf/global-pull-secret-syncer/0.log"
Sep 18 22:57:47.342704 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:47.342667    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log"
Sep 18 22:57:47.516894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:47.516824    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-21.ec2.internal_e0e3881ed91595ba0bbb3df028072a67/haproxy/0.log"
Sep 18 22:57:52.236796 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:52.236697    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-646f74d496-h24nm_d1007e2b-a27f-4c9f-bdaf-79bbb2dde61a/authorino/0.log"
Sep 18 22:57:52.279130 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:52.279105    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-znmb8_03d5cf4c-b252-4796-9ad2-d9efef0bda0a/manager/0.log"
Sep 18 22:57:52.351917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:52.351893    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-4s2dn_24a3c4e7-f64c-4512-9d03-a02f87a3703a/kuadrant-console-plugin/0.log"
Sep 18 22:57:52.489077 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:52.488999    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-kqrr8_a4bcab2c-ce44-4e0f-87a8-e4f8d92c32fb/manager/0.log"
Sep 18 22:57:54.183091 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.183060    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-nxmmw_bc6c2313-84db-4974-9821-c10d7f800b0f/cluster-monitoring-operator/0.log"
Sep 18 22:57:54.220535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.220513    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-52rbq_67178a84-1075-4569-a05c-4a6e2d2c3b44/kube-state-metrics/0.log"
Sep 18 22:57:54.255627 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.255606    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-52rbq_67178a84-1075-4569-a05c-4a6e2d2c3b44/kube-rbac-proxy-main/0.log"
Sep 18 22:57:54.287131 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.287106    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-52rbq_67178a84-1075-4569-a05c-4a6e2d2c3b44/kube-rbac-proxy-self/0.log"
Sep 18 22:57:54.369414 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.369385    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-k2pn6_c352fdd7-7f56-4982-9dc3-71ed2956ee2b/monitoring-plugin/0.log"
Sep 18 22:57:54.615968 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.615940    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8k7q_35afdf9d-93c4-46c0-88d8-065c52368692/node-exporter/0.log"
Sep 18 22:57:54.646475 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.646455    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8k7q_35afdf9d-93c4-46c0-88d8-065c52368692/kube-rbac-proxy/0.log"
Sep 18 22:57:54.673622 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:54.673599    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8k7q_35afdf9d-93c4-46c0-88d8-065c52368692/init-textfile/0.log"
Sep 18 22:57:55.105934 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:55.105904    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-xr2br_6544207c-b4ff-44cf-838d-4480a545300a/prometheus-operator-admission-webhook/0.log"
Sep 18 22:57:55.246452 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:55.246425    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d66f6ddd-gbqtm_66c6b42f-6e91-46c0-baa5-68d21c642b0d/thanos-query/0.log"
Sep 18 22:57:55.277854 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:55.277823    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d66f6ddd-gbqtm_66c6b42f-6e91-46c0-baa5-68d21c642b0d/kube-rbac-proxy-web/0.log"
Sep 18 22:57:55.306530 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:55.306507    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d66f6ddd-gbqtm_66c6b42f-6e91-46c0-baa5-68d21c642b0d/kube-rbac-proxy/0.log"
Sep 18 22:57:55.329535 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:55.329514    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d66f6ddd-gbqtm_66c6b42f-6e91-46c0-baa5-68d21c642b0d/prom-label-proxy/0.log"
Sep 18 22:57:55.354338 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:55.354313    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d66f6ddd-gbqtm_66c6b42f-6e91-46c0-baa5-68d21c642b0d/kube-rbac-proxy-rules/0.log"
Sep 18 22:57:55.376668 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:55.376608    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d66f6ddd-gbqtm_66c6b42f-6e91-46c0-baa5-68d21c642b0d/kube-rbac-proxy-metrics/0.log"
Sep 18 22:57:56.981016 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.980985    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"]
Sep 18 22:57:56.981417 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.981403    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddc7dfae-3790-4555-95c1-d2aae82a49fd" containerName="maas-api"
Sep 18 22:57:56.981463 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.981418    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddc7dfae-3790-4555-95c1-d2aae82a49fd" containerName="maas-api"
Sep 18 22:57:56.981501 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.981489    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddc7dfae-3790-4555-95c1-d2aae82a49fd" containerName="maas-api"
Sep 18 22:57:56.985662 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.985643    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:56.988649 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.988625    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-558dg\"/\"openshift-service-ca.crt\""
Sep 18 22:57:56.989497 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.989480    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-558dg\"/\"default-dockercfg-nqbcn\""
Sep 18 22:57:56.989497 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.989492    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-558dg\"/\"kube-root-ca.crt\""
Sep 18 22:57:56.995965 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.995943    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"]
Sep 18 22:57:56.999859 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.999839    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-podres\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:56.999964 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.999868    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-lib-modules\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:56.999964 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.999913    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-proc\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:56.999964 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.999955    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-sys\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.000109 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:56.999969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzrmt\" (UniqueName: \"kubernetes.io/projected/148a620f-236a-4e72-98a9-9c47a6d007e1-kube-api-access-qzrmt\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-podres\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101184 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101187    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-lib-modules\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-proc\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-sys\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzrmt\" (UniqueName: \"kubernetes.io/projected/148a620f-236a-4e72-98a9-9c47a6d007e1-kube-api-access-qzrmt\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-podres\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-proc\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101377    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-sys\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.101430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.101421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/148a620f-236a-4e72-98a9-9c47a6d007e1-lib-modules\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.110094 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.110063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzrmt\" (UniqueName: \"kubernetes.io/projected/148a620f-236a-4e72-98a9-9c47a6d007e1-kube-api-access-qzrmt\") pod \"perf-node-gather-daemonset-k2rbm\" (UID: \"148a620f-236a-4e72-98a9-9c47a6d007e1\") " pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.295897 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.295772    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:57.572893 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.572868    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"]
Sep 18 22:57:57.574837 ip-10-0-139-21 kubenswrapper[2570]: W0918 22:57:57.574808    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod148a620f_236a_4e72_98a9_9c47a6d007e1.slice/crio-3b1950217cb8707beaf431a48c3ca1f357e6018bfec1286d01fad645fc3b6265 WatchSource:0}: Error finding container 3b1950217cb8707beaf431a48c3ca1f357e6018bfec1286d01fad645fc3b6265: Status 404 returned error can't find the container with id 3b1950217cb8707beaf431a48c3ca1f357e6018bfec1286d01fad645fc3b6265
Sep 18 22:57:57.979406 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:57.979381    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fd677d89d-t4kb7_c475ad21-3d04-4b6f-98c7-c818cd4c37d3/console/0.log"
Sep 18 22:57:58.014567 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:58.014534    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm" event={"ID":"148a620f-236a-4e72-98a9-9c47a6d007e1","Type":"ContainerStarted","Data":"2ce6c77d46a6f5f0729408a3b17820d5f9a9a358d478d1006a50dd2ebd6093e3"}
Sep 18 22:57:58.014962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:58.014593    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm" event={"ID":"148a620f-236a-4e72-98a9-9c47a6d007e1","Type":"ContainerStarted","Data":"3b1950217cb8707beaf431a48c3ca1f357e6018bfec1286d01fad645fc3b6265"}
Sep 18 22:57:58.014962 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:58.014755    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:57:58.040943 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:58.040903    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm" podStartSLOduration=2.040888596 podStartE2EDuration="2.040888596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:57:58.040261984 +0000 UTC m=+2468.618207133" watchObservedRunningTime="2026-09-18 22:57:58.040888596 +0000 UTC m=+2468.618833763"
Sep 18 22:57:58.911295 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:58.911255    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gblr7_761ea664-e76a-468f-82b2-3bc1b4107204/konnectivity-agent/0.log" limit=1024
Sep 18 22:57:59.999791 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:57:59.999759    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pkvmd_4629738c-7cd1-4d11-bd40-b984ba28aa39/dns/0.log"
Sep 18 22:58:00.032725 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:00.032698    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pkvmd_4629738c-7cd1-4d11-bd40-b984ba28aa39/kube-rbac-proxy/0.log"
Sep 18 22:58:00.323562 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:00.323470    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6wbkd_bf6d6f80-59ad-457e-b964-5cd20aa3d4e2/dns-node-resolver/0.log"
Sep 18 22:58:00.989999 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:00.989971    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5457644cf4-ph2kg_2572fe1e-2cc0-42f4-8f7d-8cc9ae173cb2/registry/0.log"
Sep 18 22:58:01.052170 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:01.052142    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ghg7l_3da85a87-b538-439c-bb22-7d6614f772a8/node-ca/0.log"
Sep 18 22:58:02.162794 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:02.162753    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb_9e7c86ab-3f40-4257-9040-d8bf3304964e/istio-proxy/0.log"
Sep 18 22:58:02.647479 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:02.647456    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b786b9564-lhwbt_2a1adce9-0c0c-4da8-9eee-92e60d09c3ac/kube-auth-proxy/0.log"
Sep 18 22:58:02.681712 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:02.681691    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9pkn8_96fef461-96b6-4e72-929a-2b64f97f9be1/istio-proxy/0.log"
Sep 18 22:58:02.684448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:02.684434    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9pkn8_96fef461-96b6-4e72-929a-2b64f97f9be1/istio-proxy/1.log"
Sep 18 22:58:02.783609 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:02.783577    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685768998d-vj8pc_9a9561c5-308e-4618-a8d4-c49745121a7a/router/0.log"
Sep 18 22:58:03.746894 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:03.746863    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7dw4r_abd43bb6-c6d0-44fa-a636-d6154185132d/serve-healthcheck-canary/0.log"
Sep 18 22:58:04.030231 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:04.030159    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-558dg/perf-node-gather-daemonset-k2rbm"
Sep 18 22:58:04.347964 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:04.347936    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hx4t6_a43f2cdc-c758-4b59-9f16-5e79ffc4f242/kube-rbac-proxy/0.log"
Sep 18 22:58:04.372743 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:04.372713    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hx4t6_a43f2cdc-c758-4b59-9f16-5e79ffc4f242/exporter/0.log"
Sep 18 22:58:04.397948 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:04.397920    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hx4t6_a43f2cdc-c758-4b59-9f16-5e79ffc4f242/extractor/0.log"
Sep 18 22:58:06.707208 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:06.707186    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-62zgr_acdb403a-0273-4907-9eee-c95be4eb980e/manager/0.log"
Sep 18 22:58:06.707531 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:06.707213    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-62zgr_acdb403a-0273-4907-9eee-c95be4eb980e/manager/1.log"
Sep 18 22:58:06.732025 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:06.732002    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mg49l_a2b169e5-e868-4b63-86e8-eef7304f093d/manager/1.log"
Sep 18 22:58:06.743350 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:06.743314    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mg49l_a2b169e5-e868-4b63-86e8-eef7304f093d/manager/2.log"
Sep 18 22:58:06.792935 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:06.792913    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8567457bbb-f2zhw_5054bcae-c892-4b80-8749-f69fe76060df/manager/0.log"
Sep 18 22:58:06.948004 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:06.947973    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c85dbc8b-w8qqh_327177e8-0ff4-4419-9fa3-5e69f5b71d2a/manager/0.log"
Sep 18 22:58:06.983487 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:06.983404    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c85dbc8b-w8qqh_327177e8-0ff4-4419-9fa3-5e69f5b71d2a/copy-manifests/0.log"
Sep 18 22:58:07.013653 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:07.013620    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb_9e7c86ab-3f40-4257-9040-d8bf3304964e/istio-proxy/0.log"
Sep 18 22:58:07.458299 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:07.458269    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b786b9564-lhwbt_2a1adce9-0c0c-4da8-9eee-92e60d09c3ac/kube-auth-proxy/0.log"
Sep 18 22:58:07.483686 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:07.483661    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9pkn8_96fef461-96b6-4e72-929a-2b64f97f9be1/istio-proxy/0.log"
Sep 18 22:58:07.486219 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:07.486199    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9pkn8_96fef461-96b6-4e72-929a-2b64f97f9be1/istio-proxy/1.log"
Sep 18 22:58:07.555281 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:07.555217    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685768998d-vj8pc_9a9561c5-308e-4618-a8d4-c49745121a7a/router/0.log"
Sep 18 22:58:09.178430 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:09.178399    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb_9e7c86ab-3f40-4257-9040-d8bf3304964e/istio-proxy/0.log"
Sep 18 22:58:09.641134 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:09.641055    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b786b9564-lhwbt_2a1adce9-0c0c-4da8-9eee-92e60d09c3ac/kube-auth-proxy/0.log"
Sep 18 22:58:09.669292 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:09.669268    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9pkn8_96fef461-96b6-4e72-929a-2b64f97f9be1/istio-proxy/0.log"
Sep 18 22:58:09.672028 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:09.672007    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9pkn8_96fef461-96b6-4e72-929a-2b64f97f9be1/istio-proxy/1.log"
Sep 18 22:58:09.743081 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:09.743040    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-685768998d-vj8pc_9a9561c5-308e-4618-a8d4-c49745121a7a/router/0.log"
Sep 18 22:58:13.914461 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:13.914430    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-8jq4f_1b6551bf-1cdc-445e-87dd-05ab71984d12/kube-storage-version-migrator-operator/1.log"
Sep 18 22:58:13.915334 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:13.915311    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-8jq4f_1b6551bf-1cdc-445e-87dd-05ab71984d12/kube-storage-version-migrator-operator/0.log"
Sep 18 22:58:14.879099 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:14.879072    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqngn_b93cfc3c-e1f9-43db-945a-15a8992d02c6/kube-multus-additional-cni-plugins/0.log"
Sep 18 22:58:14.904448 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:14.904416    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqngn_b93cfc3c-e1f9-43db-945a-15a8992d02c6/egress-router-binary-copy/0.log"
Sep 18 22:58:14.927540 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:14.927517    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqngn_b93cfc3c-e1f9-43db-945a-15a8992d02c6/cni-plugins/0.log"
Sep 18 22:58:14.950263 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:14.950237    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqngn_b93cfc3c-e1f9-43db-945a-15a8992d02c6/bond-cni-plugin/0.log"
Sep 18 22:58:14.972202 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:14.972177    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqngn_b93cfc3c-e1f9-43db-945a-15a8992d02c6/routeoverride-cni/0.log"
Sep 18 22:58:14.999560 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:14.999541    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqngn_b93cfc3c-e1f9-43db-945a-15a8992d02c6/whereabouts-cni-bincopy/0.log"
Sep 18 22:58:15.021917 ip-10-0-139-21 kubenswrapper[2570]: I0918 22:58:15.021891    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqngn_b93cfc3c-e1f9-43db-945a-15a8992d02c6/whereabouts-cni/0.log"