Sep 11 19:24:22.361209 ip-10-0-130-171 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 19:24:22.361221 ip-10-0-130-171 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 19:24:22.361229 ip-10-0-130-171 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 19:24:22.361517 ip-10-0-130-171 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 19:24:32.361719 ip-10-0-130-171 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 19:24:32.361741 ip-10-0-130-171 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5de68a560fa5413fbf60dd5068b747b7 --
Sep 11 19:26:28.969691 ip-10-0-130-171 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 19:26:29.336796 ip-10-0-130-171 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:26:29.336796 ip-10-0-130-171 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 19:26:29.336796 ip-10-0-130-171 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:26:29.336796 ip-10-0-130-171 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 19:26:29.336796 ip-10-0-130-171 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:26:29.339521 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.339442    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 19:26:29.343026 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343006    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:26:29.343026 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343024    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:26:29.343026 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343029    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343033    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343038    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343042    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343046    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343050    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343054    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343058    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343064    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343069    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343072    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343076    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343080    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343085    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343089    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343093    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343097    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343105    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343109    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:26:29.343206 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343113    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343120    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343126    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343131    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343135    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343140    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343144    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343149    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343154    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343158    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343162    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343166    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343170    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343175    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343179    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343184    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343188    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343193    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343198    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:26:29.344003 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343202    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343208    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343214    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343221    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343225    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343230    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343234    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343238    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343243    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343248    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343252    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343256    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343261    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343265    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343269    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343275    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343280    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343284    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343289    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343293    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:26:29.344626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343297    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343302    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343306    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343310    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343314    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343318    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343323    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343327    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343332    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343336    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343340    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343345    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343349    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343353    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343357    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343361    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343366    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343369    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343374    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343378    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:26:29.345329 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343398    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343405    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343409    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343413    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343417    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343423    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343430    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343434    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343439    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343443    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343447    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343451    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343455    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343460    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343464    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343468    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343472    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343476    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.343481    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345173    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:26:29.346180 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345185    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345189    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345194    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345198    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345203    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345207    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345212    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345216    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345220    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345224    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345228    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345233    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345237    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345243    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345249    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345255    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345259    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345264    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345268    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:26:29.347051 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345274    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345279    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345283    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345287    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345292    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345296    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345300    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345304    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345308    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345312    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345317    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345321    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345325    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345329    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345333    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345337    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345341    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345345    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345353    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:26:29.347566 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345360    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345365    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345371    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345377    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345401    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345407    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345411    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345415    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345420    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345423    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345427    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345432    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345436    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345440    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345445    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345449    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345453    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345457    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345461    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:26:29.348200 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345465    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345469    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345473    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345477    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345481    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345486    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345491    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345495    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345501    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345505    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345509    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345517    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345521    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345526    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345530    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345534    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345538    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345543    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345547    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:26:29.349164 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345550    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345554    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345559    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345563    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345567    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345571    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345575    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345579    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345583    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345587    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345591    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345595    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345599    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345603    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345607    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345611    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345615    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345619    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345623    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345627    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:26:29.349737 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345631    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.345635    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346262    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346271    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346276    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346281    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346286    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346291    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346295    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346300    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346304    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346308    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346312    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346316    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346320    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346324    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346328    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346332    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346336    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346340    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:26:29.350244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346344    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346348    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346353    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346357    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346363    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346369    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346373    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346378    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346402    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346408    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346412    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346416    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346422    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346430    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346434    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346438    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346443    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346447    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346450    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:26:29.350955 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346455    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346460    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346464    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346468    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346472    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346477    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346481    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346485    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346489    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346493    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346497    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346501    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346505    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346509    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346513    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346517    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346521    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346525    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346529    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:26:29.351435 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346532    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346537    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346542    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346546    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346550    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346555    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346559    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346563    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346567    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346571    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346575    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346579    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346583    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346587    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346598    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346604    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346610    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346614    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346619    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:26:29.352035 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346623    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346627    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346631    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346635    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346639    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346643    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346647    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346651    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346655    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346659    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346663    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346667    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346671    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346675    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346679    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346683    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346687    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346694    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346698    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346702    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:26:29.352529 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346706    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346711    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346715    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.346719    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346817    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346867    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346877    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346884    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346891    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346896    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346902    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346908    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346913    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346919    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346924    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346929    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346934    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346939    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346943    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346948    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346953    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346957    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346963    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346967    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 19:26:29.353030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346972    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346977    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346982    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346988    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346993    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.346999    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347004    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347009    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347013    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347018    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347022    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347027    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347037    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347043    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347048    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347052    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347057    2576 flags.go:64] FLAG: --enable-server="true"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347062    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347899    2576 flags.go:64] FLAG: --event-burst="100"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347905    2576 flags.go:64] FLAG: --event-qps="50"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347911    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347916    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347921    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347927    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 19:26:29.353680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347934    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347939    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347943    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347948    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347953    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347958    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347963    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347968    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347972    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347977    2576 flags.go:64] FLAG: --feature-gates=""
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347983    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347988    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347993    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.347998    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348003    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348008    2576 flags.go:64] FLAG: --help="false"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348013    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348018    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348022    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348027    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348032    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348040    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348045    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 19:26:29.354245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348049    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348054    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348058    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348063    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348069    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348073    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348078    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348082    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348087    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348092    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348096    2576 flags.go:64] FLAG: --lock-file=""
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348100    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348105    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348110    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348118    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348122    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348126    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348131    2576 flags.go:64] FLAG: --logging-format="text"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348136    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348141    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348145    2576 flags.go:64] FLAG: --manifest-url=""
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348150    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348156    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348161    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348168    2576 flags.go:64] FLAG: --max-pods="110"
Sep 11 19:26:29.354911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348173    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348177    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348181    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348186    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348190    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348197    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348201    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348211    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348215    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348220    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348224    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348230    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348238    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348243    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348248    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348252    2576 flags.go:64] FLAG: --port="10250"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348257    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348261    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b19af5f8a2e4889b"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348266    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348270    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348275    2576 flags.go:64] FLAG: --register-node="true"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348280    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348285    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348289    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 11 19:26:29.355545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348293    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348297    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348302    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348306    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348311    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348315    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348320    2576 flags.go:64] FLAG: --runonce="false"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348324    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348328    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348332    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348336    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348341    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348345    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348351    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348356    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348360    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348365    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348369    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348373    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348378    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348403    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348409    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348418    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348422    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348426    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 19:26:29.356124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348432    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348436    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348440    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348444    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348449    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348453    2576 flags.go:64] FLAG: --v="2"
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348458    2576 flags.go:64] FLAG: --version="false"
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348464    2576 flags.go:64] FLAG: --vmodule=""
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348470    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.348475    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348660    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348670    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348675    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348680    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348685    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348690    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348694    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348698    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348703    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348708    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348714    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:26:29.356812 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348719    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348723    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348727    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348732    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348736    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348740    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348744    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348749    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348753    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348757    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348761    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348768    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348773    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348777    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348781    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348784    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348788    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348792    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348796    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348800    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:26:29.357380 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348804    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348808    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348814    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348818    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348824    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348830    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348835    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348839    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348844    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348848    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348853    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348858    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348863    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348867    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348871    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348875    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348879    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348883    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348887    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:26:29.357898 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348891    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348896    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348900    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348904    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348908    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348912    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348916    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348921    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348925    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348929    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348933    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348937    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348941    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348945    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348949    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348954    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348958    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348963    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348967    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348971    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:26:29.358409 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348976    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348979    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348983    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348988    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348994    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.348998    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349002    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349006    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349010    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349014    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349018    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349022    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349026    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349030    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349035    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349039    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349043    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349047    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349052    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349056    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:26:29.358899 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349060    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349064    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349068    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349081    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349085    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349089    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349093    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349099    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.349103    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.349111    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.356275    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.356294    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.357044    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.357055    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 19:26:29.359372 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357133    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357138    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357144    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357148    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357151    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357154    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357157    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357160    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357163    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357166    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357169    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357171    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357174    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357176    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357179    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357181    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357184    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357187    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357189    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357192    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:26:29.359750 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357194    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357196    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357199    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357201    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357204    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357207    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357209    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357211    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357214    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357219    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357223    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357225    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357228    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357231    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357233    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357236    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357238    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357241    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357244    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:26:29.360239 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357246    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357248    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357251    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357253    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357256    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357259    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357261    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357264    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357266    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357268    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357271    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357273    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357276    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357278    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357281    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357283    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357286    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357288    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357290    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357293    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:26:29.360845 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357296    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357298    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357301    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357304    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357307    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357310    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357312    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357315    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357317    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357319    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357322    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357324    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357327    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357329    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357332    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357334    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357336    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357339    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357342    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357344    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:26:29.361336 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357347    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357349    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357352    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357354    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357357    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357359    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357362    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357364    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357367    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357369    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357372    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357374    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357377    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357379    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357402    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357407    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357411    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357414    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:26:29.361850 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357417    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357419    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.357425    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357544    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357549    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357552    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357554    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357557    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357560    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357563    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357566    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357569    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357571    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357574    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357576    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:26:29.362281 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357579    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357581    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357584    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357586    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357588    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357591    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357593    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357596    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357599    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357601    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357604    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357606    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357609    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357612    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357614    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357617    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357620    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357622    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357625    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357628    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:26:29.362700 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357630    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357633    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357635    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357637    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357640    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357642    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357644    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357647    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357649    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357651    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357654    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357656    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357658    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357662    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357665    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357668    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357670    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357673    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357675    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:26:29.363172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357677    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357680    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357682    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357685    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357687    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357689    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357692    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357695    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357697    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357701    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357705    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357708    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357711    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357714    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357717    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357719    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357722    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357725    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357727    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:26:29.363719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357730    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357732    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357736    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357739    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357742    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357744    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357747    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357749    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357751    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357754    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357756    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357759    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357761    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357763    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357766    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357768    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357771    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357773    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357775    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:26:29.364177 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357778    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357780    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357783    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357785    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357788    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357791    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357793    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357795    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357798    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:29.357800    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.357805    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.357903    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.359832    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.360879    2576 server.go:1019] "Starting client certificate rotation"
Sep 11 19:26:29.364719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.360975    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:26:29.365171 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.361036    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:26:29.365541 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.365522    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:26:29.371157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.371139    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:26:29.382413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.382397    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 11 19:26:29.384860 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.384843    2576 log.go:25] "Validated CRI v1 image API"
Sep 11 19:26:29.385766 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.385748    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 19:26:29.388714 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.388688    2576 fs.go:135] Filesystem UUIDs: map[2c8d8f99-8493-47aa-a197-810abee90909:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cdda5459-47ff-4283-8c6d-f220f0efa60e:/dev/nvme0n1p4]
Sep 11 19:26:29.388776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.388713    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 19:26:29.390620 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.390601    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:26:29.394103 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.393990    2576 manager.go:216] Machine: {Timestamp:2026-09-11 19:26:29.392900426 +0000 UTC m=+0.314756369 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097526 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26806e3bb25cd917072b1703798dbe SystemUUID:ec26806e-3bb2-5cd9-1707-2b1703798dbe BootID:5de68a56-0fa5-413f-bf60-dd5068b747b7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:7f:26:c3:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:7f:26:c3:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:04:8c:27:85:91 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 19:26:29.394103 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.394098    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 19:26:29.394230 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.394170    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 19:26:29.395238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.395213    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 19:26:29.395405 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.395241    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-171.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 19:26:29.396054 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.396042    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 19:26:29.396106 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.396059    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 19:26:29.396106 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.396070    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:26:29.396780 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.396768    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:26:29.397604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.397592    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 19:26:29.400234 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400220    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:26:29.400364 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400353    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 19:26:29.400449 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400422    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 19:26:29.400449 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400436    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 19:26:29.400532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400452    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 19:26:29.400532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400464    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 11 19:26:29.400532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400477    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 19:26:29.400844 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400830    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:26:29.400910 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.400854    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:26:29.404232 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.404213    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 19:26:29.406025 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.406009    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 19:26:29.406088 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.406040    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 19:26:29.407657 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407645    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 19:26:29.407698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407662    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 19:26:29.407698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407668    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 19:26:29.407698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407673    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 19:26:29.407698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407683    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 19:26:29.407698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407691    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 19:26:29.407861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407704    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 19:26:29.407861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407709    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 19:26:29.407861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407716    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 19:26:29.407861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407721    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 19:26:29.407861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407729    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 19:26:29.407861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.407734    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 19:26:29.408415 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.408402    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 19:26:29.408415 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.408417    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 19:26:29.409246 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.409212    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 19:26:29.409246 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.409208    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 19:26:29.411171 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.411158    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-171.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 19:26:29.411998 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.411986    2576 server.go:1268] "Started kubelet"
Sep 11 19:26:29.412092 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.412060    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 19:26:29.412179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.412067    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 19:26:29.412179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.412125    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 19:26:29.412824 ip-10-0-130-171 systemd[1]: Started Kubernetes Kubelet.
Sep 11 19:26:29.413991 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.413816    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mm25h"
Sep 11 19:26:29.414360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.414334    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 19:26:29.414452 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.414416    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 19:26:29.417869 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.417848    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 19:26:29.419225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.419211    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 19:26:29.419797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.419776    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 19:26:29.423778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.420618    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 19:26:29.423778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.420637    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 19:26:29.423969 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.423818    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:29.424064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.423830    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 19:26:29.424064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.423893    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 19:26:29.424064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.423989    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 19:26:29.424202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424128    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mm25h"
Sep 11 19:26:29.424356 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424338    2576 factory.go:55] Registering systemd factory
Sep 11 19:26:29.424356 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424355    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 11 19:26:29.424593 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424578    2576 factory.go:153] Registering CRI-O factory
Sep 11 19:26:29.424673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424597    2576 factory.go:223] Registration of the crio container factory successfully
Sep 11 19:26:29.424673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424665    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 19:26:29.424750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424683    2576 factory.go:103] Registering Raw factory
Sep 11 19:26:29.424750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.424697    2576 manager.go:1196] Started watching for new ooms in manager
Sep 11 19:26:29.425651 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.425635    2576 manager.go:349] Starting recovery of all containers
Sep 11 19:26:29.427029 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.427008    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 19:26:29.427997 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.427050    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-171.ec2.internal.18d45acd3716aea5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-171.ec2.internal,UID:ip-10-0-130-171.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-171.ec2.internal,},FirstTimestamp:2026-09-11 19:26:29.411958437 +0000 UTC m=+0.333814359,LastTimestamp:2026-09-11 19:26:29.411958437 +0000 UTC m=+0.333814359,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-171.ec2.internal,}"
Sep 11 19:26:29.428130 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.428104    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-171.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 19:26:29.439415 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.439351    2576 manager.go:354] Recovery completed
Sep 11 19:26:29.443338 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.443325    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:26:29.445068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.445050    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:26:29.445154 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.445089    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:26:29.445154 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.445104    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:26:29.446582 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.446569    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:26:29.446683 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.446569    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 19:26:29.446683 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.446596    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 19:26:29.446683 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.446612    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:26:29.447314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.447299    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:26:29.447404 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.447327    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:26:29.447404 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.447341    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:26:29.447719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.447707    2576 policy_none.go:49] "None policy: Start"
Sep 11 19:26:29.447763 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.447723    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 19:26:29.447763 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.447733    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 19:26:29.448859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.448848    2576 policy_none.go:47] "Start"
Sep 11 19:26:29.496935 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.496922    2576 manager.go:337] "Starting Device Plugin manager"
Sep 11 19:26:29.497037 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.496956    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 19:26:29.497037 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.496966    2576 server.go:87] "Starting device plugin registration server"
Sep 11 19:26:29.497262 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.497248    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 19:26:29.497338 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.497263    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 19:26:29.497426 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.497363    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 19:26:29.497474 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.497460    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 19:26:29.497474 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.497472    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 19:26:29.497934 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.497911    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 19:26:29.498016 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.497957    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:29.545459 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.545432    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 19:26:29.546798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.546779    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 19:26:29.546874 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.546825    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 19:26:29.546913 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.546900    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 19:26:29.546959 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.546946    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 19:26:29.548713 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.548696    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:26:29.598007 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.597945    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:26:29.599569 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.599554    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:26:29.599633 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.599585    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:26:29.599633 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.599598    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:26:29.599692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.599645    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.607496 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.607481    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.607537 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.607503    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-171.ec2.internal\": node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:29.623953 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.623935    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:29.647858 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.647835    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"]
Sep 11 19:26:29.647916 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.647906    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:26:29.649150 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.649136    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:26:29.649216 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.649159    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:26:29.649216 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.649168    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:26:29.650623 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.650612    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:26:29.651268 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.651315 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651282    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:26:29.651348 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651330    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:26:29.651404 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651361    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:26:29.651404 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651374    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:26:29.651944 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651931    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:26:29.652002 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651960    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:26:29.652002 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.651972    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:26:29.652629 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.652614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.652705 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.652643    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:26:29.653273 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.653259    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:26:29.653357 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.653287    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:26:29.653357 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.653301    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:26:29.670909 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.670890    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-171.ec2.internal\" not found" node="ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.674338 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.674324    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-171.ec2.internal\" not found" node="ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.724448 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.724430    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:29.725574 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.725559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ceff470fa45d7b25f385cf2ead3e540-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"9ceff470fa45d7b25f385cf2ead3e540\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.725618 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.725583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ceff470fa45d7b25f385cf2ead3e540-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"9ceff470fa45d7b25f385cf2ead3e540\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.725618 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.725600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d1cc5de24426008e9a26b41d0d1c2bf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-171.ec2.internal\" (UID: \"2d1cc5de24426008e9a26b41d0d1c2bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.824560 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.824539    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:29.825680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.825661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ceff470fa45d7b25f385cf2ead3e540-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"9ceff470fa45d7b25f385cf2ead3e540\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.825810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.825698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ceff470fa45d7b25f385cf2ead3e540-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"9ceff470fa45d7b25f385cf2ead3e540\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.825810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.825709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ceff470fa45d7b25f385cf2ead3e540-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"9ceff470fa45d7b25f385cf2ead3e540\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.825810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.825737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d1cc5de24426008e9a26b41d0d1c2bf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-171.ec2.internal\" (UID: \"2d1cc5de24426008e9a26b41d0d1c2bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.825810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.825756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ceff470fa45d7b25f385cf2ead3e540-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal\" (UID: \"9ceff470fa45d7b25f385cf2ead3e540\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.825810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.825790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d1cc5de24426008e9a26b41d0d1c2bf-config\") pod \"kube-apiserver-proxy-ip-10-0-130-171.ec2.internal\" (UID: \"2d1cc5de24426008e9a26b41d0d1c2bf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.925378 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:29.925315    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:29.973592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.973551    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:29.978252 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:29.978236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:30.026197 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.026174    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:30.126661 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.126641    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:30.227236 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.227184    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:30.327658 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.327638    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:30.360887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:30.360864    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 19:26:30.361307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:30.361027    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 19:26:30.428199 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.428171    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:30.429297 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:30.429249    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 19:21:30 +0000 UTC" deadline="2028-03-04 08:55:39.074918433 +0000 UTC"
Sep 11 19:26:30.429297 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:30.429297    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12949h29m8.645624994s"
Sep 11 19:26:30.498679 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:30.498649    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ceff470fa45d7b25f385cf2ead3e540.slice/crio-8b371acd88240bf238cc2c7df58c3f57ad8d67b450dc2fe09f4c949f0f31ccfa WatchSource:0}: Error finding container 8b371acd88240bf238cc2c7df58c3f57ad8d67b450dc2fe09f4c949f0f31ccfa: Status 404 returned error can't find the container with id 8b371acd88240bf238cc2c7df58c3f57ad8d67b450dc2fe09f4c949f0f31ccfa
Sep 11 19:26:30.501928 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:30.501909    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:26:30.528697 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.528673    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:30.549915 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:30.549876    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" event={"ID":"9ceff470fa45d7b25f385cf2ead3e540","Type":"ContainerStarted","Data":"8b371acd88240bf238cc2c7df58c3f57ad8d67b450dc2fe09f4c949f0f31ccfa"}
Sep 11 19:26:30.551015 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:30.550997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal" event={"ID":"2d1cc5de24426008e9a26b41d0d1c2bf","Type":"ContainerStarted","Data":"6fab9f827b2fde9c0e46f3ba9519dd68287ff67a8fbd5a94d2864f52fe5a7870"}
Sep 11 19:26:30.629465 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.629441    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:30.730018 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:30.729994    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:32.003148 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.003120    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-171.ec2.internal\" not found"
Sep 11 19:26:32.019254 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.019233    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:26:32.093636 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.093611    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:32.105691 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.105656    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:26:32.107281 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.107256    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal"
Sep 11 19:26:32.117691 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.117666    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:26:32.140476 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.140453    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:26:32.159187 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.159164    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:26:32.574359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.574320    2576 apiserver.go:52] "Watching apiserver"
Sep 11 19:26:32.579577 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.579554    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 19:26:32.580902 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.580872    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22","openshift-cluster-node-tuning-operator/tuned-g27h4","openshift-image-registry/node-ca-jjd5t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal","openshift-multus/multus-additional-cni-plugins-qfsp6","openshift-multus/multus-cwsxc","kube-system/konnectivity-agent-k6nq5","openshift-dns/node-resolver-czz7j","openshift-multus/network-metrics-daemon-wpt8b","openshift-network-diagnostics/network-check-target-mvxqr","openshift-network-operator/iptables-alerter-48w4d","openshift-ovn-kubernetes/ovnkube-node-kfmp2","kube-system/global-pull-secret-syncer-rjmgv"]
Sep 11 19:26:32.582728 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.582700    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.584049 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.584006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:32.584161 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.584134    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:32.585227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.585206    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 19:26:32.585551 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.585530    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 19:26:32.585692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.585668    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 19:26:32.585774 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.585757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfkst\""
Sep 11 19:26:32.585958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.585942    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 19:26:32.586031 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.585947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.587048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.586950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.588325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.588304    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:26:32.588463 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.588439    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 19:26:32.588616 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.588584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7kkw4\""
Sep 11 19:26:32.588850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.588835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.588942 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.588915    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:32.589848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.589321    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 19:26:32.589848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.589380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.589848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.589515    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pfbwm\""
Sep 11 19:26:32.589848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.589587    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 19:26:32.590168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.590099    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 19:26:32.591723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.591090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.592591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.592180    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 19:26:32.592591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.592305    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 19:26:32.592591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.592372    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 19:26:32.592591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.592475    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mtlf7\""
Sep 11 19:26:32.593155 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.593137    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5cl97\""
Sep 11 19:26:32.593259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.593240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.597232 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.596850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.597756 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.597520    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 19:26:32.597756 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.597585    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 19:26:32.597897 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.597823    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 19:26:32.598116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.598098    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 19:26:32.598372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.598355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:32.598451 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.598422    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:32.599841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.599821    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 19:26:32.599931 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.599842    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sc9kv\""
Sep 11 19:26:32.599931 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.599890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 19:26:32.600064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.599820    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 19:26:32.600228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.600182    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 19:26:32.600507 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.600488    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.600946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.600926    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 19:26:32.601062 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.600973    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8q9lb\""
Sep 11 19:26:32.601287 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.601199    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 19:26:32.601287 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.601247    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 19:26:32.602049 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.602016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.602874 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.602735    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 19:26:32.603017 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.603001    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9kmr9\""
Sep 11 19:26:32.603154 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.603134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 19:26:32.604692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.604006    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 19:26:32.604692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.604108    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 19:26:32.604692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.604317    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:26:32.604692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.604448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rm699\""
Sep 11 19:26:32.604692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.604675    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:26:32.607073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.606939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.607073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-device-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.607231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:32.607231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-host\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.607231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-env-overrides\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.607231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.607231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-var-lib-kubelet\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.607231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.607231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-dbus\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-socket-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-modprobe-d\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-sys\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-slash\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-run-netns\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-netns\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-run\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a621433-1bd4-4fc3-892b-9709524f22bf-host\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-sys-fs\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-cnibin\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.607575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q5s\" (UniqueName: \"kubernetes.io/projected/8a621433-1bd4-4fc3-892b-9709524f22bf-kube-api-access-24q5s\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-daemon-config\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca50fd9e-a2ac-47e9-a849-aa17a5371603-tmp\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-var-lib-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-multus-certs\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-etc-kubernetes\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-kubernetes\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysctl-conf\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569c4\" (UniqueName: \"kubernetes.io/projected/ca50fd9e-a2ac-47e9-a849-aa17a5371603-kube-api-access-569c4\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-kubelet\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-etc-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-node-log\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-hostroot\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbn2z\" (UniqueName: \"kubernetes.io/projected/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-kube-api-access-zbn2z\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysctl-d\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.607980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-systemd\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-system-cni-dir\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.608244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a594268e-a505-4a0b-8562-bb85340323ae-hosts-file\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-systemd\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-ovn\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czct\" (UniqueName: \"kubernetes.io/projected/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-kube-api-access-6czct\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-kubelet-config\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-registration-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-cni-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-cni-bin\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovn-node-metrics-cert\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovnkube-script-lib\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94z42\" (UniqueName: \"kubernetes.io/projected/a594268e-a505-4a0b-8562-bb85340323ae-kube-api-access-94z42\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-system-cni-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-etc-selinux\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-kubelet\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-lib-modules\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.608841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-tuned\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a621433-1bd4-4fc3-892b-9709524f22bf-serviceca\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clrd4\" (UniqueName: \"kubernetes.io/projected/0b537687-3b52-4c31-9278-5499456b7586-kube-api-access-clrd4\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-cnibin\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysconfig\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a594268e-a505-4a0b-8562-bb85340323ae-tmp-dir\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-cni-binary-copy\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-cni-bin\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-cni-multus\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp9r6\" (UniqueName: \"kubernetes.io/projected/8d4e7114-d158-457f-a5d5-26398234d6dc-kube-api-access-vp9r6\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-systemd-units\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-log-socket\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-cni-netd\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl8rs\" (UniqueName: \"kubernetes.io/projected/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-kube-api-access-fl8rs\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:32.609472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-k8s-cni-cncf-io\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.610008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-conf-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.610008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.610008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovnkube-config\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.610008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.608808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-socket-dir-parent\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.623419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.623367    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxmpv"
Sep 11 19:26:32.632878 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.632862    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xxmpv"
Sep 11 19:26:32.697628 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.697606    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 19:26:32.709761 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94z42\" (UniqueName: \"kubernetes.io/projected/a594268e-a505-4a0b-8562-bb85340323ae-kube-api-access-94z42\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.709868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgmtp\" (UniqueName: \"kubernetes.io/projected/ea307096-388c-44ff-969a-28828190dcde-kube-api-access-qgmtp\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.709868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-system-cni-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.709868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-etc-selinux\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-kubelet\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-lib-modules\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-tuned\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a621433-1bd4-4fc3-892b-9709524f22bf-serviceca\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-kubelet\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.709976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-system-cni-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clrd4\" (UniqueName: \"kubernetes.io/projected/0b537687-3b52-4c31-9278-5499456b7586-kube-api-access-clrd4\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.710048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-etc-selinux\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-cnibin\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysconfig\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a594268e-a505-4a0b-8562-bb85340323ae-tmp-dir\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710165    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-lib-modules\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-cni-binary-copy\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-cni-bin\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-cni-multus\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-cnibin\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp9r6\" (UniqueName: \"kubernetes.io/projected/8d4e7114-d158-457f-a5d5-26398234d6dc-kube-api-access-vp9r6\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-systemd-units\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-log-socket\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.710394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-cni-netd\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8rs\" (UniqueName: \"kubernetes.io/projected/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-kube-api-access-fl8rs\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710618    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-cni-bin\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysconfig\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8a621433-1bd4-4fc3-892b-9709524f22bf-serviceca\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-systemd-units\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-var-lib-cni-multus\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a594268e-a505-4a0b-8562-bb85340323ae-tmp-dir\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-cni-netd\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.710963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-log-socket\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.710643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-cni-binary-copy\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-k8s-cni-cncf-io\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-conf-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovnkube-config\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-k8s-cni-cncf-io\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-conf-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711137    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-socket-dir-parent\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-device-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-host\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.711372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-socket-dir-parent\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-device-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711312    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-host\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.711349    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-env-overrides\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea307096-388c-44ff-969a-28828190dcde-host-slash\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.711424    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:26:33.211403965 +0000 UTC m=+2.960659537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-var-lib-kubelet\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovnkube-config\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-dbus\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-var-lib-kubelet\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.711609    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-socket-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-dbus\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.711654    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret podName:e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9 nodeName:}" failed. No retries permitted until 2026-09-11 19:26:33.211638739 +0000 UTC m=+2.960894304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret") pod "global-pull-secret-syncer-rjmgv" (UID: "e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:32.712202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-modprobe-d\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-sys\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-socket-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-slash\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-slash\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-modprobe-d\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-sys\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-run-netns\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-env-overrides\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-run-netns\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-netns\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-run\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a621433-1bd4-4fc3-892b-9709524f22bf-host\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-netns\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.712979 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-sys-fs\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-cnibin\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-run\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.711973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712020    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-sys-fs\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q5s\" (UniqueName: \"kubernetes.io/projected/8a621433-1bd4-4fc3-892b-9709524f22bf-kube-api-access-24q5s\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-daemon-config\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca50fd9e-a2ac-47e9-a849-aa17a5371603-tmp\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-var-lib-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-run-ovn-kubernetes\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea307096-388c-44ff-969a-28828190dcde-iptables-alerter-script\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-multus-certs\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-cnibin\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-etc-kubernetes\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-kubernetes\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-var-lib-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.713859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysctl-conf\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-569c4\" (UniqueName: \"kubernetes.io/projected/ca50fd9e-a2ac-47e9-a849-aa17a5371603-kube-api-access-569c4\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-kubelet\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-etc-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712406    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysctl-conf\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-node-log\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-hostroot\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-node-log\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbn2z\" (UniqueName: \"kubernetes.io/projected/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-kube-api-access-zbn2z\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysctl-d\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-host-run-multus-certs\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-systemd\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-system-cni-dir\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-etc-openvswitch\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a594268e-a505-4a0b-8562-bb85340323ae-hosts-file\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-systemd\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-ovn\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a621433-1bd4-4fc3-892b-9709524f22bf-host\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.714630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czct\" (UniqueName: \"kubernetes.io/projected/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-kube-api-access-6czct\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-kubelet-config\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a594268e-a505-4a0b-8562-bb85340323ae-hosts-file\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-registration-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfc5fb4c-40c3-4843-a610-920a66c8b08f-konnectivity-ca\") pod \"konnectivity-agent-k6nq5\" (UID: \"dfc5fb4c-40c3-4843-a610-920a66c8b08f\") " pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712655    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-systemd\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-kubelet\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-cni-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-etc-kubernetes\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-cni-bin\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovn-node-metrics-cert\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovnkube-script-lib\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-cni-dir\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-kubernetes\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-hostroot\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b537687-3b52-4c31-9278-5499456b7586-registration-dir\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.715534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d4e7114-d158-457f-a5d5-26398234d6dc-system-cni-dir\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfc5fb4c-40c3-4843-a610-920a66c8b08f-agent-certs\") pod \"konnectivity-agent-k6nq5\" (UID: \"dfc5fb4c-40c3-4843-a610-920a66c8b08f\") " pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-systemd\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-kubelet-config\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-run-ovn\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-host-cni-bin\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.712879    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-sysctl-d\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.713571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovnkube-script-lib\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.714656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-multus-daemon-config\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.715090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca50fd9e-a2ac-47e9-a849-aa17a5371603-tmp\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.715122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca50fd9e-a2ac-47e9-a849-aa17a5371603-etc-tuned\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.716392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.715525    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d4e7114-d158-457f-a5d5-26398234d6dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.719697 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.719673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-ovn-node-metrics-cert\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.721474 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.721450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp9r6\" (UniqueName: \"kubernetes.io/projected/8d4e7114-d158-457f-a5d5-26398234d6dc-kube-api-access-vp9r6\") pod \"multus-additional-cni-plugins-qfsp6\" (UID: \"8d4e7114-d158-457f-a5d5-26398234d6dc\") " pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.722342 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.721971    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:26:32.722342 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.722023    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:26:32.722342 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.722038    2576 projected.go:196] Error preparing data for projected volume kube-api-access-pppd2 for pod openshift-network-diagnostics/network-check-target-mvxqr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:32.722342 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:32.722090    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2 podName:169dacc8-9e17-4cb5-885d-6e82566de2dc nodeName:}" failed. No retries permitted until 2026-09-11 19:26:33.22207274 +0000 UTC m=+2.971328306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pppd2" (UniqueName: "kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2") pod "network-check-target-mvxqr" (UID: "169dacc8-9e17-4cb5-885d-6e82566de2dc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:32.725537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.723485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-569c4\" (UniqueName: \"kubernetes.io/projected/ca50fd9e-a2ac-47e9-a849-aa17a5371603-kube-api-access-569c4\") pod \"tuned-g27h4\" (UID: \"ca50fd9e-a2ac-47e9-a849-aa17a5371603\") " pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.725537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.724107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94z42\" (UniqueName: \"kubernetes.io/projected/a594268e-a505-4a0b-8562-bb85340323ae-kube-api-access-94z42\") pod \"node-resolver-czz7j\" (UID: \"a594268e-a505-4a0b-8562-bb85340323ae\") " pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.725537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.725203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q5s\" (UniqueName: \"kubernetes.io/projected/8a621433-1bd4-4fc3-892b-9709524f22bf-kube-api-access-24q5s\") pod \"node-ca-jjd5t\" (UID: \"8a621433-1bd4-4fc3-892b-9709524f22bf\") " pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.725537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.725292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbn2z\" (UniqueName: \"kubernetes.io/projected/7803e2e9-a8d7-4ad1-8885-55b3efbd1a65-kube-api-access-zbn2z\") pod \"multus-cwsxc\" (UID: \"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65\") " pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.725705 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.725624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clrd4\" (UniqueName: \"kubernetes.io/projected/0b537687-3b52-4c31-9278-5499456b7586-kube-api-access-clrd4\") pod \"aws-ebs-csi-driver-node-mgq22\" (UID: \"0b537687-3b52-4c31-9278-5499456b7586\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.726007 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.725893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czct\" (UniqueName: \"kubernetes.io/projected/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-kube-api-access-6czct\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:32.727053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.727032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl8rs\" (UniqueName: \"kubernetes.io/projected/474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79-kube-api-access-fl8rs\") pod \"ovnkube-node-kfmp2\" (UID: \"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79\") " pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.813563 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.813530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea307096-388c-44ff-969a-28828190dcde-host-slash\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.813750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.813595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea307096-388c-44ff-969a-28828190dcde-iptables-alerter-script\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.813750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.813635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfc5fb4c-40c3-4843-a610-920a66c8b08f-konnectivity-ca\") pod \"konnectivity-agent-k6nq5\" (UID: \"dfc5fb4c-40c3-4843-a610-920a66c8b08f\") " pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.813750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.813635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea307096-388c-44ff-969a-28828190dcde-host-slash\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.813750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.813660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfc5fb4c-40c3-4843-a610-920a66c8b08f-agent-certs\") pod \"konnectivity-agent-k6nq5\" (UID: \"dfc5fb4c-40c3-4843-a610-920a66c8b08f\") " pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.813750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.813692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmtp\" (UniqueName: \"kubernetes.io/projected/ea307096-388c-44ff-969a-28828190dcde-kube-api-access-qgmtp\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.814297 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.814266    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea307096-388c-44ff-969a-28828190dcde-iptables-alerter-script\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.814365 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.814273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfc5fb4c-40c3-4843-a610-920a66c8b08f-konnectivity-ca\") pod \"konnectivity-agent-k6nq5\" (UID: \"dfc5fb4c-40c3-4843-a610-920a66c8b08f\") " pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.816300 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.816277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfc5fb4c-40c3-4843-a610-920a66c8b08f-agent-certs\") pod \"konnectivity-agent-k6nq5\" (UID: \"dfc5fb4c-40c3-4843-a610-920a66c8b08f\") " pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.821348 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.821325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgmtp\" (UniqueName: \"kubernetes.io/projected/ea307096-388c-44ff-969a-28828190dcde-kube-api-access-qgmtp\") pod \"iptables-alerter-48w4d\" (UID: \"ea307096-388c-44ff-969a-28828190dcde\") " pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:32.897355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.897298    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cwsxc"
Sep 11 19:26:32.904105 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.904083    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g27h4"
Sep 11 19:26:32.915725 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.915701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjd5t"
Sep 11 19:26:32.919640 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.919622    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qfsp6"
Sep 11 19:26:32.925688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.925663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-czz7j"
Sep 11 19:26:32.932115 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.932096    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:32.938692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.938674    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:26:32.938773 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.938692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22"
Sep 11 19:26:32.945412 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.945396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:32.950913 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:32.950896    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-48w4d"
Sep 11 19:26:33.216086 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.216011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:33.216086 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.216052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:33.216249 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.216162    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:33.216249 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.216173    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:33.216249 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.216224    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret podName:e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9 nodeName:}" failed. No retries permitted until 2026-09-11 19:26:34.216211387 +0000 UTC m=+3.965466959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret") pod "global-pull-secret-syncer-rjmgv" (UID: "e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:33.216249 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.216239    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:26:34.216231929 +0000 UTC m=+3.965487481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:33.316907 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.316869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:33.317091 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.317069    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:26:33.317091 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.317091    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:26:33.317176 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.317101    2576 projected.go:196] Error preparing data for projected volume kube-api-access-pppd2 for pod openshift-network-diagnostics/network-check-target-mvxqr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:33.317176 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.317155    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2 podName:169dacc8-9e17-4cb5-885d-6e82566de2dc nodeName:}" failed. No retries permitted until 2026-09-11 19:26:34.317139645 +0000 UTC m=+4.066395211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pppd2" (UniqueName: "kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2") pod "network-check-target-mvxqr" (UID: "169dacc8-9e17-4cb5-885d-6e82566de2dc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:33.598066 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:33.598033    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b537687_3b52_4c31_9278_5499456b7586.slice/crio-c1506e6cd512317f64bb9e8d0acf022ec1f3093b945bc34f008f9284cd14c694 WatchSource:0}: Error finding container c1506e6cd512317f64bb9e8d0acf022ec1f3093b945bc34f008f9284cd14c694: Status 404 returned error can't find the container with id c1506e6cd512317f64bb9e8d0acf022ec1f3093b945bc34f008f9284cd14c694
Sep 11 19:26:33.600048 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:33.599979    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea307096_388c_44ff_969a_28828190dcde.slice/crio-25e09216066d28de29de5192ca2fd524f2dff82f070d7e92353b8099794528e1 WatchSource:0}: Error finding container 25e09216066d28de29de5192ca2fd524f2dff82f070d7e92353b8099794528e1: Status 404 returned error can't find the container with id 25e09216066d28de29de5192ca2fd524f2dff82f070d7e92353b8099794528e1
Sep 11 19:26:33.600838 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:33.600793    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca50fd9e_a2ac_47e9_a849_aa17a5371603.slice/crio-3194772e0ee7e03f7506a271b2592b289c211da56f2196df6d0dc8ca3b5e2153 WatchSource:0}: Error finding container 3194772e0ee7e03f7506a271b2592b289c211da56f2196df6d0dc8ca3b5e2153: Status 404 returned error can't find the container with id 3194772e0ee7e03f7506a271b2592b289c211da56f2196df6d0dc8ca3b5e2153
Sep 11 19:26:33.602328 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:33.601938    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc5fb4c_40c3_4843_a610_920a66c8b08f.slice/crio-d091746a413e1dc9b075faa41cc15349f09c7548d6d5eb2491b90ec2789a318c WatchSource:0}: Error finding container d091746a413e1dc9b075faa41cc15349f09c7548d6d5eb2491b90ec2789a318c: Status 404 returned error can't find the container with id d091746a413e1dc9b075faa41cc15349f09c7548d6d5eb2491b90ec2789a318c
Sep 11 19:26:33.602328 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:33.602248    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474f2d2f_c3d6_4ecd_a0ba_bd8e16344b79.slice/crio-802c4ecbd86c4636cbe4ba1ce139a98666a2361c0c709bf5ff0247d28975b0d3 WatchSource:0}: Error finding container 802c4ecbd86c4636cbe4ba1ce139a98666a2361c0c709bf5ff0247d28975b0d3: Status 404 returned error can't find the container with id 802c4ecbd86c4636cbe4ba1ce139a98666a2361c0c709bf5ff0247d28975b0d3
Sep 11 19:26:33.609357 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:33.609025    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4e7114_d158_457f_a5d5_26398234d6dc.slice/crio-7917ed4d015000649d0763f195eb5eeee01c4abb1399a594728f57d86505c227 WatchSource:0}: Error finding container 7917ed4d015000649d0763f195eb5eeee01c4abb1399a594728f57d86505c227: Status 404 returned error can't find the container with id 7917ed4d015000649d0763f195eb5eeee01c4abb1399a594728f57d86505c227
Sep 11 19:26:33.609357 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:26:33.609286    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda594268e_a505_4a0b_8562_bb85340323ae.slice/crio-06345321e5d87127826c2334f4876b604dab98ae9442fbbcf4fb6284414fbd07 WatchSource:0}: Error finding container 06345321e5d87127826c2334f4876b604dab98ae9442fbbcf4fb6284414fbd07: Status 404 returned error can't find the container with id 06345321e5d87127826c2334f4876b604dab98ae9442fbbcf4fb6284414fbd07
Sep 11 19:26:33.634854 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.634830    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:21:32 +0000 UTC" deadline="2028-04-24 07:25:15.401575483 +0000 UTC"
Sep 11 19:26:33.634854 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.634853    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14171h58m41.766725837s"
Sep 11 19:26:33.720139 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.719828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:33.720139 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:33.719942    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:33.738099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.738000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjd5t" event={"ID":"8a621433-1bd4-4fc3-892b-9709524f22bf","Type":"ContainerStarted","Data":"db5cc6d5e86212bdfe0ab7a7a93040b530b202596cd2ab4ff230100de291f63d"}
Sep 11 19:26:33.747540 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.747514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g27h4" event={"ID":"ca50fd9e-a2ac-47e9-a849-aa17a5371603","Type":"ContainerStarted","Data":"3194772e0ee7e03f7506a271b2592b289c211da56f2196df6d0dc8ca3b5e2153"}
Sep 11 19:26:33.749098 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.749067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-48w4d" event={"ID":"ea307096-388c-44ff-969a-28828190dcde","Type":"ContainerStarted","Data":"25e09216066d28de29de5192ca2fd524f2dff82f070d7e92353b8099794528e1"}
Sep 11 19:26:33.750204 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.750175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22" event={"ID":"0b537687-3b52-4c31-9278-5499456b7586","Type":"ContainerStarted","Data":"c1506e6cd512317f64bb9e8d0acf022ec1f3093b945bc34f008f9284cd14c694"}
Sep 11 19:26:33.752391 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.752369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal" event={"ID":"2d1cc5de24426008e9a26b41d0d1c2bf","Type":"ContainerStarted","Data":"3a41b922582599d0b96bb907c0c8536357e5cc37124217440089f96d503fd1e4"}
Sep 11 19:26:33.753650 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.753628    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-czz7j" event={"ID":"a594268e-a505-4a0b-8562-bb85340323ae","Type":"ContainerStarted","Data":"06345321e5d87127826c2334f4876b604dab98ae9442fbbcf4fb6284414fbd07"}
Sep 11 19:26:33.754758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.754738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cwsxc" event={"ID":"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65","Type":"ContainerStarted","Data":"2ca4aeefedfe458c9649b77d4fd5b679bc66f85b0c183f93948554345c5587e1"}
Sep 11 19:26:33.755978 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.755956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"802c4ecbd86c4636cbe4ba1ce139a98666a2361c0c709bf5ff0247d28975b0d3"}
Sep 11 19:26:33.757304 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.757284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6nq5" event={"ID":"dfc5fb4c-40c3-4843-a610-920a66c8b08f","Type":"ContainerStarted","Data":"d091746a413e1dc9b075faa41cc15349f09c7548d6d5eb2491b90ec2789a318c"}
Sep 11 19:26:33.758336 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.758316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerStarted","Data":"7917ed4d015000649d0763f195eb5eeee01c4abb1399a594728f57d86505c227"}
Sep 11 19:26:33.765342 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:33.765302    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-171.ec2.internal" podStartSLOduration=1.765291198 podStartE2EDuration="1.765291198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:33.765175719 +0000 UTC m=+3.514431311" watchObservedRunningTime="2026-09-11 19:26:33.765291198 +0000 UTC m=+3.514546771"
Sep 11 19:26:34.222783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.222699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:34.222783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.222753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:34.223036 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.222893    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:34.223036 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.222952    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret podName:e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9 nodeName:}" failed. No retries permitted until 2026-09-11 19:26:36.222935132 +0000 UTC m=+5.972190698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret") pod "global-pull-secret-syncer-rjmgv" (UID: "e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:34.223375 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.223356    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:34.223436 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.223413    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:26:36.223397865 +0000 UTC m=+5.972653421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:34.324081 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.324047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:34.324289 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.324269    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:26:34.324361 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.324296    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:26:34.324361 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.324309    2576 projected.go:196] Error preparing data for projected volume kube-api-access-pppd2 for pod openshift-network-diagnostics/network-check-target-mvxqr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:34.324463 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.324419    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2 podName:169dacc8-9e17-4cb5-885d-6e82566de2dc nodeName:}" failed. No retries permitted until 2026-09-11 19:26:36.324349845 +0000 UTC m=+6.073605398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pppd2" (UniqueName: "kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2") pod "network-check-target-mvxqr" (UID: "169dacc8-9e17-4cb5-885d-6e82566de2dc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:34.635823 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.635610    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:21:32 +0000 UTC" deadline="2028-05-06 01:03:45.766726985 +0000 UTC"
Sep 11 19:26:34.635823 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.635670    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14453h37m11.131061014s"
Sep 11 19:26:34.723168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.722473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:34.723168 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.722598    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:34.723168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.722973    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:34.723168 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:34.723096    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:34.791489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.791454    2576 generic.go:356] "Generic (PLEG): container finished" podID="9ceff470fa45d7b25f385cf2ead3e540" containerID="9b671142a3ff702deab6179baf86a34bee8cc971d77d4eebdf26d123bc6ad8cb" exitCode=0
Sep 11 19:26:34.792393 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:34.792366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" event={"ID":"9ceff470fa45d7b25f385cf2ead3e540","Type":"ContainerDied","Data":"9b671142a3ff702deab6179baf86a34bee8cc971d77d4eebdf26d123bc6ad8cb"}
Sep 11 19:26:35.720774 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:35.720276    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:35.720774 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:35.720400    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:35.837923 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:35.837880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" event={"ID":"9ceff470fa45d7b25f385cf2ead3e540","Type":"ContainerStarted","Data":"b40425d2b360bd10f5617d34033a61932f73210782e95ff7e4add7e861d178cc"}
Sep 11 19:26:35.853491 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:35.852853    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-171.ec2.internal" podStartSLOduration=3.852834317 podStartE2EDuration="3.852834317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:35.852223665 +0000 UTC m=+5.601479264" watchObservedRunningTime="2026-09-11 19:26:35.852834317 +0000 UTC m=+5.602089891"
Sep 11 19:26:36.241393 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:36.241131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:36.241566 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:36.241406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:36.241645 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.241566    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:36.241645 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.241628    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret podName:e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9 nodeName:}" failed. No retries permitted until 2026-09-11 19:26:40.241610938 +0000 UTC m=+9.990866504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret") pod "global-pull-secret-syncer-rjmgv" (UID: "e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:36.242142 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.242051    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:36.242142 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.242109    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:26:40.242091932 +0000 UTC m=+9.991347497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:36.343013 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:36.342386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:36.343013 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.342556    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:26:36.343013 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.342574    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:26:36.343013 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.342585    2576 projected.go:196] Error preparing data for projected volume kube-api-access-pppd2 for pod openshift-network-diagnostics/network-check-target-mvxqr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:36.343013 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.342643    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2 podName:169dacc8-9e17-4cb5-885d-6e82566de2dc nodeName:}" failed. No retries permitted until 2026-09-11 19:26:40.342625269 +0000 UTC m=+10.091880846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pppd2" (UniqueName: "kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2") pod "network-check-target-mvxqr" (UID: "169dacc8-9e17-4cb5-885d-6e82566de2dc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:36.720054 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:36.719969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:36.720243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:36.720124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:36.720243 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.720148    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:36.720243 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:36.720220    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:37.720400 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:37.720369    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:37.720845 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:37.720493    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:38.722140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:38.722107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:38.722140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:38.722145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:38.722649 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:38.722238    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:38.722649 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:38.722416    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:39.720285 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:39.720198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:39.720424 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:39.720332    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:40.278977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:40.278940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:40.279437 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:40.279010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:40.279437 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.279111    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:40.279437 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.279154    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:40.279437 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.279184    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:26:48.279163978 +0000 UTC m=+18.028419537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:40.279437 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.279213    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret podName:e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9 nodeName:}" failed. No retries permitted until 2026-09-11 19:26:48.279198279 +0000 UTC m=+18.028453851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret") pod "global-pull-secret-syncer-rjmgv" (UID: "e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:40.379834 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:40.379787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:40.380025 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.379977    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:26:40.380025 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.380018    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:26:40.380155 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.380031    2576 projected.go:196] Error preparing data for projected volume kube-api-access-pppd2 for pod openshift-network-diagnostics/network-check-target-mvxqr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:40.380155 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.380090    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2 podName:169dacc8-9e17-4cb5-885d-6e82566de2dc nodeName:}" failed. No retries permitted until 2026-09-11 19:26:48.380072055 +0000 UTC m=+18.129327621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pppd2" (UniqueName: "kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2") pod "network-check-target-mvxqr" (UID: "169dacc8-9e17-4cb5-885d-6e82566de2dc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:40.720802 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:40.720701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:40.720979 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.720814    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:40.721196 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:40.721176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:40.721296 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:40.721274    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:41.720705 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:41.720677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:41.721198 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:41.720790    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:42.719955 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:42.719923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:42.720152 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:42.720079    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:42.720398 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:42.720380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:42.720524 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:42.720502    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:43.720673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:43.720634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:43.721162 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:43.720761    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:44.720544 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:44.720505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:44.720730 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:44.720514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:44.720730 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:44.720645    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:44.720730 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:44.720714    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:45.720166 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:45.720136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:45.720339 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:45.720244    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:46.720664 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:46.720625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:46.721148 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:46.720680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:46.721148 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:46.720771    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:46.721148 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:46.720910    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:47.720203 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:47.720166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:47.720358 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:47.720282    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:48.340489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:48.340454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:48.340489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:48.340497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:48.341012 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.340593    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:48.341012 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.340671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:27:04.340649011 +0000 UTC m=+34.089904569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:26:48.341012 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.340593    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:48.341012 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.340756    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret podName:e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:04.340735855 +0000 UTC m=+34.089991425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret") pod "global-pull-secret-syncer-rjmgv" (UID: "e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:26:48.441207 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:48.441177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:48.441363 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.441345    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:26:48.441414 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.441369    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:26:48.441414 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.441382    2576 projected.go:196] Error preparing data for projected volume kube-api-access-pppd2 for pod openshift-network-diagnostics/network-check-target-mvxqr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:48.441501 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.441441    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2 podName:169dacc8-9e17-4cb5-885d-6e82566de2dc nodeName:}" failed. No retries permitted until 2026-09-11 19:27:04.441422834 +0000 UTC m=+34.190678387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pppd2" (UniqueName: "kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2") pod "network-check-target-mvxqr" (UID: "169dacc8-9e17-4cb5-885d-6e82566de2dc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:26:48.720731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:48.720608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:48.720887 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.720725    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:48.720887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:48.720789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:48.721012 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:48.720906    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:49.720681 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:49.720647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:49.721104 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:49.720770    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:50.720553 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:50.720521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:50.720706 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:50.720613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:50.720706 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:50.720642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:50.721065 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:50.720728    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:51.720707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.720683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:51.721068 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:51.720768    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:51.872343 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.872095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cwsxc" event={"ID":"7803e2e9-a8d7-4ad1-8885-55b3efbd1a65","Type":"ContainerStarted","Data":"55914c4a7f441bde42be4f3112a773df6eb672a374ed1f57bd7f5016bdae1cba"}
Sep 11 19:26:51.874483 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.874462    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:26:51.874830 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.874808    2576 generic.go:356] "Generic (PLEG): container finished" podID="474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79" containerID="b7b7080c91de80683e95f51e72f3504d6225ccca1def0f2a5fa9a6582c7fe0c1" exitCode=1
Sep 11 19:26:51.874914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.874880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"69579f2812111aa0932658bfc0a00d7d898921c66701688306a2c68d8606dee1"}
Sep 11 19:26:51.875051 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.874977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerDied","Data":"b7b7080c91de80683e95f51e72f3504d6225ccca1def0f2a5fa9a6582c7fe0c1"}
Sep 11 19:26:51.875130 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.875063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"8e30daa6fdbc7c8db3b3f48e23c06ecdea5183c6ec73b197c5773f2efe539251"}
Sep 11 19:26:51.876549 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.876522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k6nq5" event={"ID":"dfc5fb4c-40c3-4843-a610-920a66c8b08f","Type":"ContainerStarted","Data":"3d07c4c2bf917d6f51473b62fd32cb390b80aa17d13d5d0a62bb5671eacd6168"}
Sep 11 19:26:51.878154 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.878134    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4e7114-d158-457f-a5d5-26398234d6dc" containerID="d747b37d8c6db8ef82410eb7566a487a83dd968e5957bab366d2ad68881189a6" exitCode=0
Sep 11 19:26:51.878235 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.878207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerDied","Data":"d747b37d8c6db8ef82410eb7566a487a83dd968e5957bab366d2ad68881189a6"}
Sep 11 19:26:51.879910 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.879872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjd5t" event={"ID":"8a621433-1bd4-4fc3-892b-9709524f22bf","Type":"ContainerStarted","Data":"44ce8d0c651fd11a10ea861219b97f368579274d43d0352917687c98e18d4dac"}
Sep 11 19:26:51.881576 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.881558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g27h4" event={"ID":"ca50fd9e-a2ac-47e9-a849-aa17a5371603","Type":"ContainerStarted","Data":"af87818a96c57620fb6e46d380b9ede90fe3a8eaaa1280c8ef977ad7432f7d88"}
Sep 11 19:26:51.883075 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.883055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22" event={"ID":"0b537687-3b52-4c31-9278-5499456b7586","Type":"ContainerStarted","Data":"7216fc74ba11a9513d50b94c7def627041aed6d239611cab9abda9be30323e6a"}
Sep 11 19:26:51.884705 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.884686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-czz7j" event={"ID":"a594268e-a505-4a0b-8562-bb85340323ae","Type":"ContainerStarted","Data":"828546bf0b52c96924611302c01ca38c9380dc29e38337ccb0effacc8becf049"}
Sep 11 19:26:51.889168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.889133    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cwsxc" podStartSLOduration=4.155535359 podStartE2EDuration="21.889121118s" totalImagesPullingTime="17.733585759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:51.888789378 +0000 UTC m=+21.638044971" watchObservedRunningTime="2026-09-11 19:26:51.889121118 +0000 UTC m=+21.638376692"
Sep 11 19:26:51.921960 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.921909    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jjd5t" podStartSLOduration=4.260684611 podStartE2EDuration="21.921889707s" totalImagesPullingTime="17.661205096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:51.902484602 +0000 UTC m=+21.651740195" watchObservedRunningTime="2026-09-11 19:26:51.921889707 +0000 UTC m=+21.671145281"
Sep 11 19:26:51.942975 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.942596    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-czz7j" podStartSLOduration=4.28584731 podStartE2EDuration="21.942575103s" totalImagesPullingTime="17.656727793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:51.942315588 +0000 UTC m=+21.691571181" watchObservedRunningTime="2026-09-11 19:26:51.942575103 +0000 UTC m=+21.691830680"
Sep 11 19:26:51.960276 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.960232    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g27h4" podStartSLOduration=4.297047404 podStartE2EDuration="21.960215812s" totalImagesPullingTime="17.663168408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:51.959818405 +0000 UTC m=+21.709073979" watchObservedRunningTime="2026-09-11 19:26:51.960215812 +0000 UTC m=+21.709471383"
Sep 11 19:26:51.973787 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.973739    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k6nq5" podStartSLOduration=11.683248298 podStartE2EDuration="21.973724731s" totalImagesPullingTime="10.290476433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:51.973636466 +0000 UTC m=+21.722892059" watchObservedRunningTime="2026-09-11 19:26:51.973724731 +0000 UTC m=+21.722980301"
Sep 11 19:26:51.999103 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:51.999077    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:52.063131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.063108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:52.720316 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.720277    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:52.720499 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.720286    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:52.720499 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:52.720383    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:52.720499 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:52.720479    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:52.889907 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.889883    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:26:52.890650 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.890385    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"986358d097adbfd89e5b3f6f4ee1dc16f7fab82005fdf1f8df8ab7ba667a3538"}
Sep 11 19:26:52.890650 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.890456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"59831b1ce8c1cccc7c95018d8ac0e59e121b6fa582469f8b53190d38715806c9"}
Sep 11 19:26:52.890650 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.890501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"590173cf365dbaff6c5d5384cae9490f54b54ba2819ad55bef872feea337f5a4"}
Sep 11 19:26:52.892069 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.892041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-48w4d" event={"ID":"ea307096-388c-44ff-969a-28828190dcde","Type":"ContainerStarted","Data":"40bcafcbb69a51dcd550b37e8c943b3129278ce924065c19fe7e42d21c2579f9"}
Sep 11 19:26:52.906733 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:52.906502    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-48w4d" podStartSLOduration=5.242157931 podStartE2EDuration="22.906483617s" totalImagesPullingTime="17.664325686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:52.906141631 +0000 UTC m=+22.655397232" watchObservedRunningTime="2026-09-11 19:26:52.906483617 +0000 UTC m=+22.655739191"
Sep 11 19:26:53.006319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.006298    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 19:26:53.024096 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.024070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:53.124393 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.124315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:53.404048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.403968    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:53.404643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.404616    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:53.681090 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.680938    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T19:26:53.006313771Z","UUID":"bd621239-1b60-4008-bcf9-b66f3b4048af","Handler":null,"Name":"","Endpoint":""}
Sep 11 19:26:53.682953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.682934    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 19:26:53.682953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.682962    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 19:26:53.719923 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.719897    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:53.720052 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:53.720033    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:53.896709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.896677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22" event={"ID":"0b537687-3b52-4c31-9278-5499456b7586","Type":"ContainerStarted","Data":"92c4ae5d98a61aaba4e3603f0905310734ef3f2bdd76504210eb02a2b08029c7"}
Sep 11 19:26:53.897195 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.897001    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:53.897440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.897423    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k6nq5"
Sep 11 19:26:53.959001 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:53.958919    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:54.720659 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:54.720577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:54.720817 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:54.720706    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:54.720817 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:54.720752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:54.720916 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:54.720846    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:54.902773 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:54.902743    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:26:54.903266 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:54.903239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"b0d949844c020b7c002e82de8a7d4e536c9ea8064fd20788f1b75efc393fdab8"}
Sep 11 19:26:54.905757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:54.905729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22" event={"ID":"0b537687-3b52-4c31-9278-5499456b7586","Type":"ContainerStarted","Data":"79542c33b3989e7b0e09b53bf9dbb771d872a1b27f7180c1efd4ac57867757ee"}
Sep 11 19:26:54.924128 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:54.924085    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mgq22" podStartSLOduration=5.013763363 podStartE2EDuration="24.924072029s" totalImagesPullingTime="19.910308666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:54.923831615 +0000 UTC m=+24.673087191" watchObservedRunningTime="2026-09-11 19:26:54.924072029 +0000 UTC m=+24.673327614"
Sep 11 19:26:55.340656 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:55.340619    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:55.437048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:55.437013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:55.719905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:55.719826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:55.720084 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:55.719930    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:56.720856 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.720643    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:56.721222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.720644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:56.721222 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:56.720890    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:56.721222 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:56.720964    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:56.911950 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.911920    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4e7114-d158-457f-a5d5-26398234d6dc" containerID="8b6d5696e81421a0f4cede6da59cef5bf6d12c9af49b6a97359c82bea0de9f4a" exitCode=0
Sep 11 19:26:56.912098 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.912011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerDied","Data":"8b6d5696e81421a0f4cede6da59cef5bf6d12c9af49b6a97359c82bea0de9f4a"}
Sep 11 19:26:56.916102 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.916083    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:26:56.916886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.916449    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"4c4d6cdbbc6095fd66ace1acfeea6efed60454ecb5cb5b22219768a73bba4afd"}
Sep 11 19:26:56.916886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.916722    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:56.916886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.916793    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:56.916886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.916852    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:56.916886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.916869    2576 scope.go:117] "RemoveContainer" containerID="b7b7080c91de80683e95f51e72f3504d6225ccca1def0f2a5fa9a6582c7fe0c1"
Sep 11 19:26:56.933389 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.933366    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:56.934232 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:56.934214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:26:57.720451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:57.719981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:57.720451 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:57.720137    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:57.922179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:57.922157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:26:57.922763 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:57.922576    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" event={"ID":"474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79","Type":"ContainerStarted","Data":"8b3c88b333e527d4e3e2169134c88bff67b3169a75063efa8a7f24a8a5dbc607"}
Sep 11 19:26:57.924723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:57.924703    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4e7114-d158-457f-a5d5-26398234d6dc" containerID="48e1b06b8d1f46b0780c50ecee3a49b10720bda1a543792e566ca7c153a8ac38" exitCode=0
Sep 11 19:26:57.924807 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:57.924747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerDied","Data":"48e1b06b8d1f46b0780c50ecee3a49b10720bda1a543792e566ca7c153a8ac38"}
Sep 11 19:26:57.951608 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:57.951568    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2" podStartSLOduration=10.246214787 podStartE2EDuration="27.951553583s" totalImagesPullingTime="17.705338796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:57.951246874 +0000 UTC m=+27.700502461" watchObservedRunningTime="2026-09-11 19:26:57.951553583 +0000 UTC m=+27.700809187"
Sep 11 19:26:58.319512 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.319481    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjmgv"]
Sep 11 19:26:58.319678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.319605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:58.319806 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:58.319690    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:58.322117 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.322092    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvxqr"]
Sep 11 19:26:58.322227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.322203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:58.322731 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:58.322700    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:58.326646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.326145    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wpt8b"]
Sep 11 19:26:58.326646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.326302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:58.326646 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:58.326449    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:26:58.856668 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.856495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:58.929802 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.929717    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4e7114-d158-457f-a5d5-26398234d6dc" containerID="3a1a6e03254516e955c094e1de1e8bd226fd6fe5a1ebecea24e2f0df20667f1e" exitCode=0
Sep 11 19:26:58.930222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:58.929804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerDied","Data":"3a1a6e03254516e955c094e1de1e8bd226fd6fe5a1ebecea24e2f0df20667f1e"}
Sep 11 19:26:59.006303 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:59.006280    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:26:59.720625 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:59.720599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:26:59.720813 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:59.720599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:26:59.720813 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:59.720696    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:26:59.720813 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:26:59.720738    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:26:59.720972 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:59.720823    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:26:59.720972 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:26:59.720919    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:27:01.720220 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:01.720187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:01.720220 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:01.720217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:27:01.720708 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:01.720220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:27:01.720708 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:01.720295    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:27:01.720708 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:01.720397    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:27:01.720708 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:01.720477    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:27:02.356134 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:02.356089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:02.460066 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:02.459952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:03.720468 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:03.720447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:27:03.720885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:03.720451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:27:03.720885 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:03.720574    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:27:03.720885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:03.720460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:03.720885 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:03.720620    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjmgv" podUID="e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9"
Sep 11 19:27:03.720885 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:03.720695    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mvxqr" podUID="169dacc8-9e17-4cb5-885d-6e82566de2dc"
Sep 11 19:27:03.944000 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:03.943953    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4e7114-d158-457f-a5d5-26398234d6dc" containerID="fcaffaeff28f10062870b4f7d0f62d386d026cd9e0644857682fb7dd43b11e31" exitCode=0
Sep 11 19:27:03.944114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:03.944018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerDied","Data":"fcaffaeff28f10062870b4f7d0f62d386d026cd9e0644857682fb7dd43b11e31"}
Sep 11 19:27:04.360242 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.360177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:27:04.360242 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.360210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:27:04.360380 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.360307    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:27:04.360380 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.360308    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:27:04.360380 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.360357    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret podName:e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:36.360341142 +0000 UTC m=+66.109596718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret") pod "global-pull-secret-syncer-rjmgv" (UID: "e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:27:04.360380 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.360372    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:27:36.360365479 +0000 UTC m=+66.109621031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:27:04.460799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.460777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:04.460892 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.460880    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:27:04.460927 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.460894    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:27:04.460927 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.460902    2576 projected.go:196] Error preparing data for projected volume kube-api-access-pppd2 for pod openshift-network-diagnostics/network-check-target-mvxqr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:27:04.461017 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.460938    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2 podName:169dacc8-9e17-4cb5-885d-6e82566de2dc nodeName:}" failed. No retries permitted until 2026-09-11 19:27:36.460927776 +0000 UTC m=+66.210183327 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pppd2" (UniqueName: "kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2") pod "network-check-target-mvxqr" (UID: "169dacc8-9e17-4cb5-885d-6e82566de2dc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:27:04.486751 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.486731    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-171.ec2.internal" event="NodeReady"
Sep 11 19:27:04.486830 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.486814    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 19:27:04.533313 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.533292    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zndxh"]
Sep 11 19:27:04.535759 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.535745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.538618 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.538588    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 19:27:04.538747 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.538594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x76hz\""
Sep 11 19:27:04.539276 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.539252    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hjlkc"]
Sep 11 19:27:04.539380 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.539298    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 19:27:04.541835 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.541817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.544212 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.544191    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kxtl7\""
Sep 11 19:27:04.544313 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.544196    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 19:27:04.544313 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.544230    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 19:27:04.544405 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.544378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 19:27:04.547503 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.547486    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zndxh"]
Sep 11 19:27:04.552711 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.552692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjlkc"]
Sep 11 19:27:04.658289 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.658238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:04.661725 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.661706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eaf5989-9a58-448b-80da-7f117fd2ea11-tmp-dir\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.661820 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.661737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5gbm\" (UniqueName: \"kubernetes.io/projected/4a318048-1f31-4d7a-888f-5fb7f72d5300-kube-api-access-q5gbm\") pod \"ingress-canary-hjlkc\" (UID: \"4a318048-1f31-4d7a-888f-5fb7f72d5300\") " pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.661820 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.661778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eaf5989-9a58-448b-80da-7f117fd2ea11-config-volume\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.661820 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.661806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.661922 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.661826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gvzb\" (UniqueName: \"kubernetes.io/projected/6eaf5989-9a58-448b-80da-7f117fd2ea11-kube-api-access-2gvzb\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.661922 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.661848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a318048-1f31-4d7a-888f-5fb7f72d5300-cert\") pod \"ingress-canary-hjlkc\" (UID: \"4a318048-1f31-4d7a-888f-5fb7f72d5300\") " pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.714982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.714954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:04.762590 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.762573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a318048-1f31-4d7a-888f-5fb7f72d5300-cert\") pod \"ingress-canary-hjlkc\" (UID: \"4a318048-1f31-4d7a-888f-5fb7f72d5300\") " pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.762872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.762600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eaf5989-9a58-448b-80da-7f117fd2ea11-tmp-dir\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.762872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.762621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gbm\" (UniqueName: \"kubernetes.io/projected/4a318048-1f31-4d7a-888f-5fb7f72d5300-kube-api-access-q5gbm\") pod \"ingress-canary-hjlkc\" (UID: \"4a318048-1f31-4d7a-888f-5fb7f72d5300\") " pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.762872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.762834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eaf5989-9a58-448b-80da-7f117fd2ea11-config-volume\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.763019 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.762875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.763019 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.762899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gvzb\" (UniqueName: \"kubernetes.io/projected/6eaf5989-9a58-448b-80da-7f117fd2ea11-kube-api-access-2gvzb\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.763019 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.762944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eaf5989-9a58-448b-80da-7f117fd2ea11-tmp-dir\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.763019 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.762950    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:27:04.763206 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:04.763062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:05.263040836 +0000 UTC m=+35.012296402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:27:04.763357 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.763341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eaf5989-9a58-448b-80da-7f117fd2ea11-config-volume\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.767479 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.767363    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a318048-1f31-4d7a-888f-5fb7f72d5300-cert\") pod \"ingress-canary-hjlkc\" (UID: \"4a318048-1f31-4d7a-888f-5fb7f72d5300\") " pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.771367 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.771348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5gbm\" (UniqueName: \"kubernetes.io/projected/4a318048-1f31-4d7a-888f-5fb7f72d5300-kube-api-access-q5gbm\") pod \"ingress-canary-hjlkc\" (UID: \"4a318048-1f31-4d7a-888f-5fb7f72d5300\") " pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.771895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.771875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gvzb\" (UniqueName: \"kubernetes.io/projected/6eaf5989-9a58-448b-80da-7f117fd2ea11-kube-api-access-2gvzb\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:04.852076 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.852053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjlkc"
Sep 11 19:27:04.949303 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.949279    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d4e7114-d158-457f-a5d5-26398234d6dc" containerID="295ad7451e075514aa540ad158a1d1dc8768899f502a9c3689ae92518c00cf9a" exitCode=0
Sep 11 19:27:04.949415 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:04.949320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerDied","Data":"295ad7451e075514aa540ad158a1d1dc8768899f502a9c3689ae92518c00cf9a"}
Sep 11 19:27:05.126855 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.126826    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjlkc"]
Sep 11 19:27:05.129664 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:27:05.129645    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a318048_1f31_4d7a_888f_5fb7f72d5300.slice/crio-85f63ea72438cb1bb8491dbd8af0e343a5fb440abf079ef02cd321b70fe6b5d3 WatchSource:0}: Error finding container 85f63ea72438cb1bb8491dbd8af0e343a5fb440abf079ef02cd321b70fe6b5d3: Status 404 returned error can't find the container with id 85f63ea72438cb1bb8491dbd8af0e343a5fb440abf079ef02cd321b70fe6b5d3
Sep 11 19:27:05.265941 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.265884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:05.266057 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:05.266038    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:27:05.266110 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:05.266100    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:06.266081522 +0000 UTC m=+36.015337088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:27:05.720570 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.720503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:27:05.720694 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.720509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:27:05.720694 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.720638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:05.724064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.723475    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:27:05.724064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.723616    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:27:05.724064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.723783    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k4fsc\""
Sep 11 19:27:05.724064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.723864    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:27:05.724064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.723949    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:27:05.724798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.724779    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f99f\""
Sep 11 19:27:05.955900 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.955864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" event={"ID":"8d4e7114-d158-457f-a5d5-26398234d6dc","Type":"ContainerStarted","Data":"b86f278b74f5d8566eba0ffafae7ec52eeb7c0b661fd0f6cd6678a61d281157a"}
Sep 11 19:27:05.957649 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.957610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjlkc" event={"ID":"4a318048-1f31-4d7a-888f-5fb7f72d5300","Type":"ContainerStarted","Data":"85f63ea72438cb1bb8491dbd8af0e343a5fb440abf079ef02cd321b70fe6b5d3"}
Sep 11 19:27:05.976380 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:05.976300    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qfsp6" podStartSLOduration=8.074224096 podStartE2EDuration="35.976281471s" totalImagesPullingTime="27.902057375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:27:05.975116713 +0000 UTC m=+35.724372312" watchObservedRunningTime="2026-09-11 19:27:05.976281471 +0000 UTC m=+35.725537047"
Sep 11 19:27:06.098811 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:06.098778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:06.153873 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:06.153846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:06.274099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:06.274008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:06.274241 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:06.274125    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:27:06.274241 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:06.274183    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:08.274168341 +0000 UTC m=+38.023423900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:27:06.299851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:06.299824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:06.357128 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:06.357057    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:07.963847 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:07.963683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjlkc" event={"ID":"4a318048-1f31-4d7a-888f-5fb7f72d5300","Type":"ContainerStarted","Data":"01adacf322fad68ccd7e813d294cd6402edc1f47624772d35c0b4acb1b8f8f14"}
Sep 11 19:27:07.979381 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:07.979334    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hjlkc" podStartSLOduration=1.5195726920000001 podStartE2EDuration="3.979317417s" totalImagesPullingTime="2.459744725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:27:07.97888367 +0000 UTC m=+37.728139272" watchObservedRunningTime="2026-09-11 19:27:07.979317417 +0000 UTC m=+37.728572992"
Sep 11 19:27:08.289354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:08.289272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:08.289508 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:08.289436    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:27:08.289566 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:08.289511    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:12.289490614 +0000 UTC m=+42.038746168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:27:08.566520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:08.566423    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:08.666835 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:08.666795    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:09.378080 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:09.378029    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:09.429217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:09.429183    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:12.316538 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:12.316494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:12.316904 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:12.316610    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:27:12.316904 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:12.316661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:20.316647423 +0000 UTC m=+50.065902975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:27:20.363809 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:20.363764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:20.364420 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:20.363901    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:27:20.364420 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:20.363971    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:27:36.36395463 +0000 UTC m=+66.113210181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:27:24.244599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:24.244557    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:24.296260 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:24.296235    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:28.942515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:28.942477    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kfmp2"
Sep 11 19:27:29.077306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:29.077272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:29.133359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:29.133330    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:27:36.366175 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.366137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:27:36.366175 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.366173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:27:36.366604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.366202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:27:36.366604 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:36.366300    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:27:36.366604 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:36.366365    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:28:08.366347164 +0000 UTC m=+98.115602729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:27:36.368857 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.368836    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:27:36.368968 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.368859    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:27:36.377051 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:36.377033    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 19:27:36.377137 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:27:36.377098    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:28:40.377083608 +0000 UTC m=+130.126339159 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : secret "metrics-daemon-secret" not found
Sep 11 19:27:36.380325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.380300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9-original-pull-secret\") pod \"global-pull-secret-syncer-rjmgv\" (UID: \"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9\") " pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:27:36.466852 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.466831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:36.469319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.469305    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:27:36.479416 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.479394    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:27:36.490702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.490673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pppd2\" (UniqueName: \"kubernetes.io/projected/169dacc8-9e17-4cb5-885d-6e82566de2dc-kube-api-access-pppd2\") pod \"network-check-target-mvxqr\" (UID: \"169dacc8-9e17-4cb5-885d-6e82566de2dc\") " pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:36.634635 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.634580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjmgv"
Sep 11 19:27:36.650569 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.650553    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f99f\""
Sep 11 19:27:36.658549 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.658534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:36.931871 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.931723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjmgv"]
Sep 11 19:27:36.935143 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:27:36.935118    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode788a1c7_253d_4e32_a0d2_f5e50a7bbcb9.slice/crio-b8c71aab24d4e11f6f6297791c752ea6a8eb26f7353042894d6a4f6b5e788436 WatchSource:0}: Error finding container b8c71aab24d4e11f6f6297791c752ea6a8eb26f7353042894d6a4f6b5e788436: Status 404 returned error can't find the container with id b8c71aab24d4e11f6f6297791c752ea6a8eb26f7353042894d6a4f6b5e788436
Sep 11 19:27:36.958862 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:36.958839    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mvxqr"]
Sep 11 19:27:36.961712 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:27:36.961690    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169dacc8_9e17_4cb5_885d_6e82566de2dc.slice/crio-50effafb333dc7a8cd6349807ee55b28416738a67d6b2fb3f76c1635d55d2db1 WatchSource:0}: Error finding container 50effafb333dc7a8cd6349807ee55b28416738a67d6b2fb3f76c1635d55d2db1: Status 404 returned error can't find the container with id 50effafb333dc7a8cd6349807ee55b28416738a67d6b2fb3f76c1635d55d2db1
Sep 11 19:27:37.029295 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:37.029263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjmgv" event={"ID":"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9","Type":"ContainerStarted","Data":"b8c71aab24d4e11f6f6297791c752ea6a8eb26f7353042894d6a4f6b5e788436"}
Sep 11 19:27:37.033385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:37.033359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvxqr" event={"ID":"169dacc8-9e17-4cb5-885d-6e82566de2dc","Type":"ContainerStarted","Data":"50effafb333dc7a8cd6349807ee55b28416738a67d6b2fb3f76c1635d55d2db1"}
Sep 11 19:27:43.052339 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:43.052294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mvxqr" event={"ID":"169dacc8-9e17-4cb5-885d-6e82566de2dc","Type":"ContainerStarted","Data":"9523a0e6aec13ebc3913fb47f5fa153a78d5389ee86c3ae844e4e8f4536dffa6"}
Sep 11 19:27:43.052832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:43.052514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:27:43.054342 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:43.054306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjmgv" event={"ID":"e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9","Type":"ContainerStarted","Data":"09da1da6acb61fcb009c94521bad3dffa226788c525fb5f82dace41e8ae13f34"}
Sep 11 19:27:43.068324 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:43.068275    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mvxqr" podStartSLOduration=68.050545002 podStartE2EDuration="1m13.068259118s" totalImagesPullingTime="5.017714116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:27:43.067649604 +0000 UTC m=+72.816905195" watchObservedRunningTime="2026-09-11 19:27:43.068259118 +0000 UTC m=+72.817514691"
Sep 11 19:27:43.081678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:27:43.081620    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rjmgv" podStartSLOduration=68.037068853 podStartE2EDuration="1m13.081605107s" totalImagesPullingTime="5.044536254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:27:43.080745096 +0000 UTC m=+72.830000692" watchObservedRunningTime="2026-09-11 19:27:43.081605107 +0000 UTC m=+72.830860680"
Sep 11 19:28:05.260114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:28:05.259929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:28:05.316555 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:28:05.316493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:28:08.454169 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:28:08.454123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:28:08.454674 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:28:08.454286    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:28:08.454674 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:28:08.454377    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:29:12.454354763 +0000 UTC m=+162.203610320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:28:14.059516 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:28:14.059478    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mvxqr"
Sep 11 19:28:40.460078 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:28:40.460038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:28:40.460669 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:28:40.460189    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 19:28:40.460669 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:28:40.460271    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:30:42.460250653 +0000 UTC m=+252.209506206 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : secret "metrics-daemon-secret" not found
Sep 11 19:29:07.545489 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:29:07.545451    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zndxh" podUID="6eaf5989-9a58-448b-80da-7f117fd2ea11"
Sep 11 19:29:08.259328 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:29:08.259299    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zndxh"
Sep 11 19:29:08.740946 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:29:08.740908    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:29:12.461007 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:29:12.460964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:29:12.461418 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:29:12.461113    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:29:12.461418 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:29:12.461184    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls podName:6eaf5989-9a58-448b-80da-7f117fd2ea11 nodeName:}" failed. No retries permitted until 2026-09-11 19:31:14.461165292 +0000 UTC m=+284.210420844 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls") pod "dns-default-zndxh" (UID: "6eaf5989-9a58-448b-80da-7f117fd2ea11") : secret "dns-default-metrics-tls" not found
Sep 11 19:29:23.720371 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:29:23.720279    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:30:28.604368 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.604326    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"]
Sep 11 19:30:28.606170 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.606143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.607670 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.607635    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"]
Sep 11 19:30:28.608463 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.608437    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 19:30:28.608663 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.608640    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 19:30:28.608842 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.608796    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 19:30:28.609433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.609178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jxgmf\""
Sep 11 19:30:28.609571 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.609550    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:30:28.609648 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.609629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.609704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.609560    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f55c6dfc6-v8gfx"]
Sep 11 19:30:28.611566 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.611544    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-qxbdv"]
Sep 11 19:30:28.611702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.611678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.613323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.613295    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 19:30:28.613447 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.613327    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 19:30:28.613447 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.613348    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 19:30:28.613447 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.613306    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 19:30:28.613447 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.613404    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"]
Sep 11 19:30:28.613646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.613470    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9vcq\""
Sep 11 19:30:28.613646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.613607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.616472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.616454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.618958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.618926    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 19:30:28.619139 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.618938    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 19:30:28.619222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.619134    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 19:30:28.619222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.618944    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 19:30:28.619222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.619139    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 19:30:28.619222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.619212    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 19:30:28.619883 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.619702    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 19:30:28.619883 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.619767    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 19:30:28.620280 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620258    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 19:30:28.620554 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620532    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:30:28.620770 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620742    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 19:30:28.620897 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620789    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nfll6\""
Sep 11 19:30:28.620897 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620829    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sj6d6\""
Sep 11 19:30:28.620897 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620885    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"]
Sep 11 19:30:28.621183 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620664    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:30:28.621183 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620559    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 19:30:28.621183 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.620979    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-299kh\""
Sep 11 19:30:28.621637 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.621614    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 19:30:28.622851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.622830    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"]
Sep 11 19:30:28.627060 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.627034    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 19:30:28.630096 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.630075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-qxbdv"]
Sep 11 19:30:28.630820 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.630797    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"]
Sep 11 19:30:28.640916 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.640894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f55c6dfc6-v8gfx"]
Sep 11 19:30:28.699747 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.699727    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"]
Sep 11 19:30:28.701536 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.701522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:28.703171 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.703153    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-gz58s"]
Sep 11 19:30:28.703813 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.703795    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 19:30:28.704288 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.704273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wvb6b\""
Sep 11 19:30:28.704470 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.704458    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 19:30:28.704747 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.704729    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.704799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.704758    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:30:28.707105 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.707087    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 19:30:28.707211 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.707088    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 19:30:28.707423 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.707405    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 19:30:28.707527 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.707424    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 19:30:28.707631 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.707616    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g4bbn\""
Sep 11 19:30:28.713395 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.713368    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"]
Sep 11 19:30:28.714108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.714085    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 19:30:28.723487 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.723468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-gz58s"]
Sep 11 19:30:28.744812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.744794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d7df0e3-b8f6-4608-8262-1638fef4208b-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.744914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.744819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.744914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.744846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42e2eaa2-172d-4671-b904-26b952b07c56-serving-cert\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.744914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.744872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dgh\" (UniqueName: \"kubernetes.io/projected/42e2eaa2-172d-4671-b904-26b952b07c56-kube-api-access-q7dgh\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.744914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.744897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4hc2\" (UniqueName: \"kubernetes.io/projected/43851385-292b-4977-9cb0-8c3e2570086a-kube-api-access-r4hc2\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.745100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.744934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttgxj\" (UniqueName: \"kubernetes.io/projected/0d7df0e3-b8f6-4608-8262-1638fef4208b-kube-api-access-ttgxj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.745100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42e2eaa2-172d-4671-b904-26b952b07c56-config\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.745100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-default-certificate\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.745100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a692649b-8756-4044-9d49-021af267ef5b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.745100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56nbm\" (UniqueName: \"kubernetes.io/projected/a692649b-8756-4044-9d49-021af267ef5b-kube-api-access-56nbm\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.745100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43851385-292b-4977-9cb0-8c3e2570086a-trusted-ca\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.745358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-stats-auth\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.745358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7df0e3-b8f6-4608-8262-1638fef4208b-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.745358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.745358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.745358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxv5z\" (UniqueName: \"kubernetes.io/projected/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-kube-api-access-gxv5z\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.745358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43851385-292b-4977-9cb0-8c3e2570086a-config\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.745358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.745308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43851385-292b-4977-9cb0-8c3e2570086a-serving-cert\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.804231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.804208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:28.845881 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.845855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.845973 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.845901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.845973 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.845924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxv5z\" (UniqueName: \"kubernetes.io/projected/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-kube-api-access-gxv5z\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.846099 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:28.846034    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:30:28.846099 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:28.846043    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:29.346027217 +0000 UTC m=+239.095282785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : configmap references non-existent config key: service-ca.crt
Sep 11 19:30:28.846099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-snapshots\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.846224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42e2eaa2-172d-4671-b904-26b952b07c56-serving-cert\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.846224 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:28.846138    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:29.346116731 +0000 UTC m=+239.095372296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : secret "router-metrics-certs-default" not found
Sep 11 19:30:28.846224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7df0e3-b8f6-4608-8262-1638fef4208b-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.846385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4hc2\" (UniqueName: \"kubernetes.io/projected/43851385-292b-4977-9cb0-8c3e2570086a-kube-api-access-r4hc2\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.846385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56nbm\" (UniqueName: \"kubernetes.io/projected/a692649b-8756-4044-9d49-021af267ef5b-kube-api-access-56nbm\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.846385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttgxj\" (UniqueName: \"kubernetes.io/projected/0d7df0e3-b8f6-4608-8262-1638fef4208b-kube-api-access-ttgxj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.846385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42e2eaa2-172d-4671-b904-26b952b07c56-config\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.846580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-default-certificate\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.846580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-tmp\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.846580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-stats-auth\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.846580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-service-ca-bundle\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.846714 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d7df0e3-b8f6-4608-8262-1638fef4208b-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.846775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-trusted-ca-bundle\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.846828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43851385-292b-4977-9cb0-8c3e2570086a-serving-cert\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.846828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42e2eaa2-172d-4671-b904-26b952b07c56-config\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.846932 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.846932 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43851385-292b-4977-9cb0-8c3e2570086a-config\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.846932 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h2bs\" (UniqueName: \"kubernetes.io/projected/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-kube-api-access-5h2bs\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.847108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:28.847108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.846972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a692649b-8756-4044-9d49-021af267ef5b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.847108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.847025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dgh\" (UniqueName: \"kubernetes.io/projected/42e2eaa2-172d-4671-b904-26b952b07c56-kube-api-access-q7dgh\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.847108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.847050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cjr9\" (UniqueName: \"kubernetes.io/projected/94586551-72fe-440e-a9a0-0be7657db693-kube-api-access-2cjr9\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:28.847108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.847075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-serving-cert\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.847108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.847100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43851385-292b-4977-9cb0-8c3e2570086a-trusted-ca\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.847437 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.847165    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d7df0e3-b8f6-4608-8262-1638fef4208b-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.847437 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:28.847321    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:28.847437 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:28.847395    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls podName:a692649b-8756-4044-9d49-021af267ef5b nodeName:}" failed. No retries permitted until 2026-09-11 19:30:29.34737921 +0000 UTC m=+239.096634761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fwxt7" (UID: "a692649b-8756-4044-9d49-021af267ef5b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:28.848044 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.848023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43851385-292b-4977-9cb0-8c3e2570086a-trusted-ca\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.848249 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.848224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43851385-292b-4977-9cb0-8c3e2570086a-config\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.848585 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.848565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a692649b-8756-4044-9d49-021af267ef5b-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.849317 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.849256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42e2eaa2-172d-4671-b904-26b952b07c56-serving-cert\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.849507 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.849485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d7df0e3-b8f6-4608-8262-1638fef4208b-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.849575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.849504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-default-certificate\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.849575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.849543    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43851385-292b-4977-9cb0-8c3e2570086a-serving-cert\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.849575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.849569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-stats-auth\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.857149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.857047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4hc2\" (UniqueName: \"kubernetes.io/projected/43851385-292b-4977-9cb0-8c3e2570086a-kube-api-access-r4hc2\") pod \"console-operator-696884fb9c-qxbdv\" (UID: \"43851385-292b-4977-9cb0-8c3e2570086a\") " pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.857149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.857066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttgxj\" (UniqueName: \"kubernetes.io/projected/0d7df0e3-b8f6-4608-8262-1638fef4208b-kube-api-access-ttgxj\") pod \"kube-storage-version-migrator-operator-6c8f84f897-djk59\" (UID: \"0d7df0e3-b8f6-4608-8262-1638fef4208b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.857448 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.857430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dgh\" (UniqueName: \"kubernetes.io/projected/42e2eaa2-172d-4671-b904-26b952b07c56-kube-api-access-q7dgh\") pod \"service-ca-operator-cf7c776b7-fpsgr\" (UID: \"42e2eaa2-172d-4671-b904-26b952b07c56\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.857530 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.857509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56nbm\" (UniqueName: \"kubernetes.io/projected/a692649b-8756-4044-9d49-021af267ef5b-kube-api-access-56nbm\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:28.857655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.857638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxv5z\" (UniqueName: \"kubernetes.io/projected/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-kube-api-access-gxv5z\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:28.891311 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.891286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:28.919184 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.919166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"
Sep 11 19:30:28.942075 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.942054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:28.946841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.946818    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"
Sep 11 19:30:28.948114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-tmp\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.948204 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-service-ca-bundle\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.948204 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-trusted-ca-bundle\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.948314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h2bs\" (UniqueName: \"kubernetes.io/projected/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-kube-api-access-5h2bs\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.948314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:28.948314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cjr9\" (UniqueName: \"kubernetes.io/projected/94586551-72fe-440e-a9a0-0be7657db693-kube-api-access-2cjr9\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:28.948314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-serving-cert\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.948509 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-snapshots\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.948595 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:28.948580    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:30:28.948673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-tmp\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.948673 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:28.948642    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls podName:94586551-72fe-440e-a9a0-0be7657db693 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:29.448616714 +0000 UTC m=+239.197872268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-snj8b" (UID: "94586551-72fe-440e-a9a0-0be7657db693") : secret "samples-operator-tls" not found
Sep 11 19:30:28.949110 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.948935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-snapshots\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.949358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.949338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-service-ca-bundle\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.949462 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.949424    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-trusted-ca-bundle\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.951070 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.951050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-serving-cert\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.959356 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.959334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h2bs\" (UniqueName: \"kubernetes.io/projected/dec7f412-9871-4a8b-81d9-ce4ac13dc84d-kube-api-access-5h2bs\") pod \"insights-operator-5844b856db-gz58s\" (UID: \"dec7f412-9871-4a8b-81d9-ce4ac13dc84d\") " pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:28.959830 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:28.959792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cjr9\" (UniqueName: \"kubernetes.io/projected/94586551-72fe-440e-a9a0-0be7657db693-kube-api-access-2cjr9\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:29.021298 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.021273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-gz58s"
Sep 11 19:30:29.190674 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.190610    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59"]
Sep 11 19:30:29.193913 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:30:29.193887    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7df0e3_b8f6_4608_8262_1638fef4208b.slice/crio-446698ee4d18fd3bf74476d1cbd0266737581906397b9ce1f2bb01dd39cbe7e6 WatchSource:0}: Error finding container 446698ee4d18fd3bf74476d1cbd0266737581906397b9ce1f2bb01dd39cbe7e6: Status 404 returned error can't find the container with id 446698ee4d18fd3bf74476d1cbd0266737581906397b9ce1f2bb01dd39cbe7e6
Sep 11 19:30:29.214980 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.214921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-qxbdv"]
Sep 11 19:30:29.217972 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:30:29.217949    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43851385_292b_4977_9cb0_8c3e2570086a.slice/crio-518204f933e6ab076f975d03a3a26806feb341824bc1759b5687b8f48f9dc20b WatchSource:0}: Error finding container 518204f933e6ab076f975d03a3a26806feb341824bc1759b5687b8f48f9dc20b: Status 404 returned error can't find the container with id 518204f933e6ab076f975d03a3a26806feb341824bc1759b5687b8f48f9dc20b
Sep 11 19:30:29.225265 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.225247    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr"]
Sep 11 19:30:29.227521 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:30:29.227500    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e2eaa2_172d_4671_b904_26b952b07c56.slice/crio-6e32a3e3576079a6dae83700b7dbdaddc3dd01d45d6ecfae8ebc6d2f0468f260 WatchSource:0}: Error finding container 6e32a3e3576079a6dae83700b7dbdaddc3dd01d45d6ecfae8ebc6d2f0468f260: Status 404 returned error can't find the container with id 6e32a3e3576079a6dae83700b7dbdaddc3dd01d45d6ecfae8ebc6d2f0468f260
Sep 11 19:30:29.288067 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.288045    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-gz58s"]
Sep 11 19:30:29.290404 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:30:29.290381    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec7f412_9871_4a8b_81d9_ce4ac13dc84d.slice/crio-dc5859c3383d22bc4d0b35e59aed84dab38c0ac0d2a4c0b271e8a341d9874c9e WatchSource:0}: Error finding container dc5859c3383d22bc4d0b35e59aed84dab38c0ac0d2a4c0b271e8a341d9874c9e: Status 404 returned error can't find the container with id dc5859c3383d22bc4d0b35e59aed84dab38c0ac0d2a4c0b271e8a341d9874c9e
Sep 11 19:30:29.350466 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.350445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:29.350546 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.350481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:29.350546 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.350516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:29.350628 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:29.350609    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:30.350588029 +0000 UTC m=+240.099843600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : configmap references non-existent config key: service-ca.crt
Sep 11 19:30:29.350628 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:29.350618    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:29.350692 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:29.350612    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:30:29.350692 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:29.350670    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls podName:a692649b-8756-4044-9d49-021af267ef5b nodeName:}" failed. No retries permitted until 2026-09-11 19:30:30.350654098 +0000 UTC m=+240.099909671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fwxt7" (UID: "a692649b-8756-4044-9d49-021af267ef5b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:29.350757 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:29.350694    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:30.350682299 +0000 UTC m=+240.099937851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : secret "router-metrics-certs-default" not found
Sep 11 19:30:29.451030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.450957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:29.451120 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:29.451088    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:30:29.451173 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:29.451137    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls podName:94586551-72fe-440e-a9a0-0be7657db693 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:30.451124451 +0000 UTC m=+240.200380006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-snj8b" (UID: "94586551-72fe-440e-a9a0-0be7657db693") : secret "samples-operator-tls" not found
Sep 11 19:30:29.453109 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.453083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-gz58s" event={"ID":"dec7f412-9871-4a8b-81d9-ce4ac13dc84d","Type":"ContainerStarted","Data":"dc5859c3383d22bc4d0b35e59aed84dab38c0ac0d2a4c0b271e8a341d9874c9e"}
Sep 11 19:30:29.454036 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.454010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" event={"ID":"43851385-292b-4977-9cb0-8c3e2570086a","Type":"ContainerStarted","Data":"518204f933e6ab076f975d03a3a26806feb341824bc1759b5687b8f48f9dc20b"}
Sep 11 19:30:29.455038 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.455016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59" event={"ID":"0d7df0e3-b8f6-4608-8262-1638fef4208b","Type":"ContainerStarted","Data":"446698ee4d18fd3bf74476d1cbd0266737581906397b9ce1f2bb01dd39cbe7e6"}
Sep 11 19:30:29.456146 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:29.456128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr" event={"ID":"42e2eaa2-172d-4671-b904-26b952b07c56","Type":"ContainerStarted","Data":"6e32a3e3576079a6dae83700b7dbdaddc3dd01d45d6ecfae8ebc6d2f0468f260"}
Sep 11 19:30:30.359509 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:30.359220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:30.359509 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:30.359309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:30.359509 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:30.359348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:30.359509 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:30.359417    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:30.359509 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:30.359462    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:30:30.359509 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:30.359493    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls podName:a692649b-8756-4044-9d49-021af267ef5b nodeName:}" failed. No retries permitted until 2026-09-11 19:30:32.359473043 +0000 UTC m=+242.108728602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fwxt7" (UID: "a692649b-8756-4044-9d49-021af267ef5b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:30.359509 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:30.359513    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:32.359503298 +0000 UTC m=+242.108758854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : configmap references non-existent config key: service-ca.crt
Sep 11 19:30:30.360294 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:30.359528    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:32.35951927 +0000 UTC m=+242.108774827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : secret "router-metrics-certs-default" not found
Sep 11 19:30:30.460446 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:30.460413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:30.460608 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:30.460582    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:30:30.460694 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:30.460642    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls podName:94586551-72fe-440e-a9a0-0be7657db693 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:32.460625943 +0000 UTC m=+242.209881501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-snj8b" (UID: "94586551-72fe-440e-a9a0-0be7657db693") : secret "samples-operator-tls" not found
Sep 11 19:30:31.797571 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:31.797533    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:32.376009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:32.375947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:32.376178 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:32.376035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:32.376178 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:32.376103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:32.376178 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:32.376127    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:36.376108596 +0000 UTC m=+246.125364152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : configmap references non-existent config key: service-ca.crt
Sep 11 19:30:32.376178 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:32.376163    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:30:32.376178 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:32.376175    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:32.376436 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:32.376230    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:36.376211925 +0000 UTC m=+246.125467478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : secret "router-metrics-certs-default" not found
Sep 11 19:30:32.376436 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:32.376250    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls podName:a692649b-8756-4044-9d49-021af267ef5b nodeName:}" failed. No retries permitted until 2026-09-11 19:30:36.376240711 +0000 UTC m=+246.125496269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fwxt7" (UID: "a692649b-8756-4044-9d49-021af267ef5b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:32.477224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:32.477191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:32.477396 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:32.477323    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:30:32.477396 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:32.477381    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls podName:94586551-72fe-440e-a9a0-0be7657db693 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:36.477364545 +0000 UTC m=+246.226620097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-snj8b" (UID: "94586551-72fe-440e-a9a0-0be7657db693") : secret "samples-operator-tls" not found
Sep 11 19:30:32.974851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:32.974808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:33.472155 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.472120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59" event={"ID":"0d7df0e3-b8f6-4608-8262-1638fef4208b","Type":"ContainerStarted","Data":"f7a7f55020123d9c26b5c8c01b900d0cb1845e74ca4642cf483fb3e2e14fcd89"}
Sep 11 19:30:33.473785 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.473761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr" event={"ID":"42e2eaa2-172d-4671-b904-26b952b07c56","Type":"ContainerStarted","Data":"03a1e94b454e364b878328edf280498c6dd107e56ca55ed96b6a086c8bbc5189"}
Sep 11 19:30:33.475451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.475421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-gz58s" event={"ID":"dec7f412-9871-4a8b-81d9-ce4ac13dc84d","Type":"ContainerStarted","Data":"d6da3b6c28c748701968fe80630d2bfb5d369bd1267c6e17c4871957aa843e55"}
Sep 11 19:30:33.477334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.477314    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/0.log"
Sep 11 19:30:33.477429 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.477355    2576 generic.go:356] "Generic (PLEG): container finished" podID="43851385-292b-4977-9cb0-8c3e2570086a" containerID="750b2761e4a242a5440be8a1e4330efe3e2c58549ab8f16f627d579cb314f5a1" exitCode=255
Sep 11 19:30:33.477429 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.477382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" event={"ID":"43851385-292b-4977-9cb0-8c3e2570086a","Type":"ContainerDied","Data":"750b2761e4a242a5440be8a1e4330efe3e2c58549ab8f16f627d579cb314f5a1"}
Sep 11 19:30:33.477629 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.477612    2576 scope.go:117] "RemoveContainer" containerID="750b2761e4a242a5440be8a1e4330efe3e2c58549ab8f16f627d579cb314f5a1"
Sep 11 19:30:33.494432 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.490280    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59" podStartSLOduration=1.914490878 podStartE2EDuration="5.49026137s" totalImagesPullingTime="3.575770492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:33.487340452 +0000 UTC m=+243.236596042" watchObservedRunningTime="2026-09-11 19:30:33.49026137 +0000 UTC m=+243.239516940"
Sep 11 19:30:33.526511 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.526462    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr" podStartSLOduration=1.988691188 podStartE2EDuration="5.526447033s" totalImagesPullingTime="3.537755845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:33.525000896 +0000 UTC m=+243.274256488" watchObservedRunningTime="2026-09-11 19:30:33.526447033 +0000 UTC m=+243.275702609"
Sep 11 19:30:33.540207 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:33.540164    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-gz58s" podStartSLOduration=2.06323941 podStartE2EDuration="5.540145722s" totalImagesPullingTime="3.476906312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:33.540071497 +0000 UTC m=+243.289327090" watchObservedRunningTime="2026-09-11 19:30:33.540145722 +0000 UTC m=+243.289401297"
Sep 11 19:30:34.057045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.057008    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bg6nc"]
Sep 11 19:30:34.059581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.059561    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.062292 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.062273    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 19:30:34.062399 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.062366    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 19:30:34.063260 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.063241    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s6r98\""
Sep 11 19:30:34.067376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.067083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:34.071613 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.071592    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bg6nc"]
Sep 11 19:30:34.093097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.093076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.093310 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.093286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zp9\" (UniqueName: \"kubernetes.io/projected/73abe7bf-a266-452a-9116-3af582379090-kube-api-access-f2zp9\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.093548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.093522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73abe7bf-a266-452a-9116-3af582379090-data-volume\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.093648 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.093563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73abe7bf-a266-452a-9116-3af582379090-crio-socket\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.093712 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.093660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.134282 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.134256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:34.194503 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.194483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.194611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.194525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.194611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.194546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zp9\" (UniqueName: \"kubernetes.io/projected/73abe7bf-a266-452a-9116-3af582379090-kube-api-access-f2zp9\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.194718 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.194661    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:34.194718 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.194718    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:34.694700793 +0000 UTC m=+244.443956348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:34.194803 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.194758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73abe7bf-a266-452a-9116-3af582379090-data-volume\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.194803 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.194777    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:30:34.194803 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.194791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73abe7bf-a266-452a-9116-3af582379090-crio-socket\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.194943 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.194828    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:34.694811696 +0000 UTC m=+244.444067262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : configmap "kube-rbac-proxy" not found
Sep 11 19:30:34.194943 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.194874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73abe7bf-a266-452a-9116-3af582379090-crio-socket\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.195189 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.195162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73abe7bf-a266-452a-9116-3af582379090-data-volume\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.205526 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.205482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zp9\" (UniqueName: \"kubernetes.io/projected/73abe7bf-a266-452a-9116-3af582379090-kube-api-access-f2zp9\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.353018 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.352942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:34.453762 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.453728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:34.481710 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.481687    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/1.log"
Sep 11 19:30:34.482124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.482110    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/0.log"
Sep 11 19:30:34.482197 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.482142    2576 generic.go:356] "Generic (PLEG): container finished" podID="43851385-292b-4977-9cb0-8c3e2570086a" containerID="efddf357076146cffc78e28e2cff48cc300047cefd7bc7dee6fc1644dcf265a8" exitCode=255
Sep 11 19:30:34.482307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.482247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" event={"ID":"43851385-292b-4977-9cb0-8c3e2570086a","Type":"ContainerDied","Data":"efddf357076146cffc78e28e2cff48cc300047cefd7bc7dee6fc1644dcf265a8"}
Sep 11 19:30:34.482360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.482303    2576 scope.go:117] "RemoveContainer" containerID="750b2761e4a242a5440be8a1e4330efe3e2c58549ab8f16f627d579cb314f5a1"
Sep 11 19:30:34.482430 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.482414    2576 scope.go:117] "RemoveContainer" containerID="efddf357076146cffc78e28e2cff48cc300047cefd7bc7dee6fc1644dcf265a8"
Sep 11 19:30:34.482640 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.482612    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-qxbdv_openshift-console-operator(43851385-292b-4977-9cb0-8c3e2570086a)\"" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" podUID="43851385-292b-4977-9cb0-8c3e2570086a"
Sep 11 19:30:34.589522 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.589495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:34.652599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.652533    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:34.697956 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.697936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.698065 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:34.698035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:34.698065 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.698043    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:30:34.698184 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.698100    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:34.698184 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.698103    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:35.698086302 +0000 UTC m=+245.447341854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : configmap "kube-rbac-proxy" not found
Sep 11 19:30:34.698184 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:34.698152    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:35.698141049 +0000 UTC m=+245.447396602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:35.063430 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.063402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:35.132388 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.132364    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"]
Sep 11 19:30:35.135029 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.135011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"
Sep 11 19:30:35.137277 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.137260    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 19:30:35.138261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.138243    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 19:30:35.138344 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.138243    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-46jqv\""
Sep 11 19:30:35.145445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.145428    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"]
Sep 11 19:30:35.155369 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.155336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:35.202086 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.202062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsb5r\" (UniqueName: \"kubernetes.io/projected/d2c7db81-e05b-4081-8b41-f60deb4730de-kube-api-access-bsb5r\") pod \"migrator-8b4d697c5-7n48p\" (UID: \"d2c7db81-e05b-4081-8b41-f60deb4730de\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"
Sep 11 19:30:35.210621 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.210598    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:35.303405 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.303382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsb5r\" (UniqueName: \"kubernetes.io/projected/d2c7db81-e05b-4081-8b41-f60deb4730de-kube-api-access-bsb5r\") pod \"migrator-8b4d697c5-7n48p\" (UID: \"d2c7db81-e05b-4081-8b41-f60deb4730de\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"
Sep 11 19:30:35.311319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.311293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsb5r\" (UniqueName: \"kubernetes.io/projected/d2c7db81-e05b-4081-8b41-f60deb4730de-kube-api-access-bsb5r\") pod \"migrator-8b4d697c5-7n48p\" (UID: \"d2c7db81-e05b-4081-8b41-f60deb4730de\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"
Sep 11 19:30:35.444085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.444030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"
Sep 11 19:30:35.494854 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.494752    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/1.log"
Sep 11 19:30:35.495442 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.495192    2576 scope.go:117] "RemoveContainer" containerID="efddf357076146cffc78e28e2cff48cc300047cefd7bc7dee6fc1644dcf265a8"
Sep 11 19:30:35.495442 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:35.495401    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-qxbdv_openshift-console-operator(43851385-292b-4977-9cb0-8c3e2570086a)\"" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" podUID="43851385-292b-4977-9cb0-8c3e2570086a"
Sep 11 19:30:35.706567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.706505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:35.706567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.706550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:35.706752 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:35.706641    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:35.706752 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:35.706666    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:30:35.706752 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:35.706717    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:37.706699529 +0000 UTC m=+247.455955087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:35.706752 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:35.706735    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:37.706726008 +0000 UTC m=+247.455981564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : configmap "kube-rbac-proxy" not found
Sep 11 19:30:35.710835 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:35.710810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p"]
Sep 11 19:30:35.714064 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:30:35.714039    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c7db81_e05b_4081_8b41_f60deb4730de.slice/crio-fd2a2d1688246c49c88ebc06cf4644d2783943750c6f78dac3c1dfcf30765cd1 WatchSource:0}: Error finding container fd2a2d1688246c49c88ebc06cf4644d2783943750c6f78dac3c1dfcf30765cd1: Status 404 returned error can't find the container with id fd2a2d1688246c49c88ebc06cf4644d2783943750c6f78dac3c1dfcf30765cd1
Sep 11 19:30:36.009791 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.009771    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-czz7j_a594268e-a505-4a0b-8562-bb85340323ae/dns-node-resolver/0.log"
Sep 11 19:30:36.410899 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.410826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:36.410899 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.410873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:36.411395 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.410929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:36.411395 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:36.411032    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:44.411009618 +0000 UTC m=+254.160265170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : configmap references non-existent config key: service-ca.crt
Sep 11 19:30:36.411395 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:36.411068    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:36.411395 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:36.411080    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:30:36.411395 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:36.411119    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls podName:a692649b-8756-4044-9d49-021af267ef5b nodeName:}" failed. No retries permitted until 2026-09-11 19:30:44.411102855 +0000 UTC m=+254.160358406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fwxt7" (UID: "a692649b-8756-4044-9d49-021af267ef5b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:36.411395 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:36.411144    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:30:44.411126152 +0000 UTC m=+254.160381706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : secret "router-metrics-certs-default" not found
Sep 11 19:30:36.499766 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.499733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p" event={"ID":"d2c7db81-e05b-4081-8b41-f60deb4730de","Type":"ContainerStarted","Data":"fd2a2d1688246c49c88ebc06cf4644d2783943750c6f78dac3c1dfcf30765cd1"}
Sep 11 19:30:36.512280 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.512245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:36.512430 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:36.512376    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:30:36.512497 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:36.512451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls podName:94586551-72fe-440e-a9a0-0be7657db693 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:44.512433354 +0000 UTC m=+254.261688908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-snj8b" (UID: "94586551-72fe-440e-a9a0-0be7657db693") : secret "samples-operator-tls" not found
Sep 11 19:30:36.651388 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.651360    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bm4jg"]
Sep 11 19:30:36.653550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.653525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.655895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.655868    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 19:30:36.655895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.655879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 19:30:36.656849 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.656816    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 19:30:36.656849 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.656828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tlnfp\""
Sep 11 19:30:36.657016 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.656859    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 19:30:36.662473 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.662410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bm4jg"]
Sep 11 19:30:36.687753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.687719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:36.714854 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.714830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/50f76a4b-03e2-4923-8ccd-b67c28d021e1-signing-cabundle\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.714952 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.714863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c47nk\" (UniqueName: \"kubernetes.io/projected/50f76a4b-03e2-4923-8ccd-b67c28d021e1-kube-api-access-c47nk\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.715052 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.715034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/50f76a4b-03e2-4923-8ccd-b67c28d021e1-signing-key\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.741585 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.741556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:36.816147 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.816123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/50f76a4b-03e2-4923-8ccd-b67c28d021e1-signing-key\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.816274 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.816195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/50f76a4b-03e2-4923-8ccd-b67c28d021e1-signing-cabundle\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.816377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.816356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47nk\" (UniqueName: \"kubernetes.io/projected/50f76a4b-03e2-4923-8ccd-b67c28d021e1-kube-api-access-c47nk\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.816939 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.816877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/50f76a4b-03e2-4923-8ccd-b67c28d021e1-signing-cabundle\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.819253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.819229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/50f76a4b-03e2-4923-8ccd-b67c28d021e1-signing-key\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.826230 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.826208    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c47nk\" (UniqueName: \"kubernetes.io/projected/50f76a4b-03e2-4923-8ccd-b67c28d021e1-kube-api-access-c47nk\") pod \"service-ca-568869fdc5-bm4jg\" (UID: \"50f76a4b-03e2-4923-8ccd-b67c28d021e1\") " pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:36.964644 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:36.964624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bm4jg"
Sep 11 19:30:37.009061 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.009034    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjd5t_8a621433-1bd4-4fc3-892b-9709524f22bf/node-ca/0.log"
Sep 11 19:30:37.233284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.233252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bm4jg"]
Sep 11 19:30:37.236703 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:30:37.236683    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f76a4b_03e2_4923_8ccd_b67c28d021e1.slice/crio-322fc7d6bda7bcaab4d4f76c302a169cd5fda954b1a68e819dc6af20b2e58a91 WatchSource:0}: Error finding container 322fc7d6bda7bcaab4d4f76c302a169cd5fda954b1a68e819dc6af20b2e58a91: Status 404 returned error can't find the container with id 322fc7d6bda7bcaab4d4f76c302a169cd5fda954b1a68e819dc6af20b2e58a91
Sep 11 19:30:37.504905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.504834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p" event={"ID":"d2c7db81-e05b-4081-8b41-f60deb4730de","Type":"ContainerStarted","Data":"35661ffe75806653e7279578f342258fc648b626d82e19bc394b860f36e44df0"}
Sep 11 19:30:37.504905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.504891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p" event={"ID":"d2c7db81-e05b-4081-8b41-f60deb4730de","Type":"ContainerStarted","Data":"7c4cc5e33feed599cb4f9474174b40bfeadd66789434be9fb3681730fec3b3e3"}
Sep 11 19:30:37.506373 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.506338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bm4jg" event={"ID":"50f76a4b-03e2-4923-8ccd-b67c28d021e1","Type":"ContainerStarted","Data":"a01ca7eff98de891dbcf71444ce2d127572ea92b90f5096a73466abffdcc1a8a"}
Sep 11 19:30:37.506475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.506387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bm4jg" event={"ID":"50f76a4b-03e2-4923-8ccd-b67c28d021e1","Type":"ContainerStarted","Data":"322fc7d6bda7bcaab4d4f76c302a169cd5fda954b1a68e819dc6af20b2e58a91"}
Sep 11 19:30:37.521152 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.521115    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-7n48p" podStartSLOduration=1.366326469 podStartE2EDuration="2.521099994s" totalImagesPullingTime="1.154773525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:37.520552292 +0000 UTC m=+247.269807878" watchObservedRunningTime="2026-09-11 19:30:37.521099994 +0000 UTC m=+247.270355568"
Sep 11 19:30:37.538439 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.538406    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-bm4jg" podStartSLOduration=1.5383919179999999 podStartE2EDuration="1.538391918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:37.537841329 +0000 UTC m=+247.287096924" watchObservedRunningTime="2026-09-11 19:30:37.538391918 +0000 UTC m=+247.287647492"
Sep 11 19:30:37.558920 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.558887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:37.610420 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.610389    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjlkc_4a318048-1f31-4d7a-888f-5fb7f72d5300/serve-healthcheck-canary/0.log"
Sep 11 19:30:37.723104 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.723078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:37.723195 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:37.723123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:37.723195 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:37.723185    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:30:37.723274 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:37.723216    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:37.723274 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:37.723229    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:41.723215858 +0000 UTC m=+251.472471410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : configmap "kube-rbac-proxy" not found
Sep 11 19:30:37.723274 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:37.723273    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:41.723257251 +0000 UTC m=+251.472512807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:38.942360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:38.942287    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:38.942360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:38.942354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:38.942853 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:38.942689    2576 scope.go:117] "RemoveContainer" containerID="efddf357076146cffc78e28e2cff48cc300047cefd7bc7dee6fc1644dcf265a8"
Sep 11 19:30:38.942853 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:38.942838    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-qxbdv_openshift-console-operator(43851385-292b-4977-9cb0-8c3e2570086a)\"" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" podUID="43851385-292b-4977-9cb0-8c3e2570086a"
Sep 11 19:30:39.073063 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.073025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:39.249433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.249389    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:39.351120 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.351094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:39.449893 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.449864    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:39.559699 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.559619    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:39.655700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.655678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:39.756228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.756202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:39.856781 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:39.856728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:40.138697 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:40.138604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:40.341336 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:40.341305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:40.443001 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:40.442922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:40.773156 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:40.773125    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:41.374958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:41.374929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:41.758723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:41.758696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:41.758853 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:41.758743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:41.758853 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:41.758846    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:41.758930 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:41.758900    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls podName:73abe7bf-a266-452a-9116-3af582379090 nodeName:}" failed. No retries permitted until 2026-09-11 19:30:49.758886363 +0000 UTC m=+259.508141914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bg6nc" (UID: "73abe7bf-a266-452a-9116-3af582379090") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:30:41.759251 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:41.759235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73abe7bf-a266-452a-9116-3af582379090-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:41.978101 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:41.978074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:42.182424 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:42.182347    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:42.376264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:42.376242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:42.463758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:42.463710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:30:42.463884 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:42.463865    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 19:30:42.463951 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:42.463940    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs podName:1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e nodeName:}" failed. No retries permitted until 2026-09-11 19:32:44.463918219 +0000 UTC m=+374.213173788 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs") pod "network-metrics-daemon-wpt8b" (UID: "1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e") : secret "metrics-daemon-secret" not found
Sep 11 19:30:42.568103 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:42.568073    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:42.966893 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:42.966854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:43.087688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:43.087658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:43.577227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:43.577203    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:43.971186 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:43.971157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:44.170226 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.170199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:44.372616 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.372561    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:44.477930 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.477907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:30:44.478045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.477966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:44.478089 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:44.478065    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:44.478134 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:44.478105    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle podName:aa8815e5-5a2d-44bf-b753-b5ddd918f91d nodeName:}" failed. No retries permitted until 2026-09-11 19:31:00.478090168 +0000 UTC m=+270.227345721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle") pod "router-default-5f55c6dfc6-v8gfx" (UID: "aa8815e5-5a2d-44bf-b753-b5ddd918f91d") : configmap references non-existent config key: service-ca.crt
Sep 11 19:30:44.478134 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:44.478129    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls podName:a692649b-8756-4044-9d49-021af267ef5b nodeName:}" failed. No retries permitted until 2026-09-11 19:31:00.478120016 +0000 UTC m=+270.227375567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-fwxt7" (UID: "a692649b-8756-4044-9d49-021af267ef5b") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:30:44.478218 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.478171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:44.480576 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.480560    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-metrics-certs\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:30:44.579377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.579353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:44.581695 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.581677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/94586551-72fe-440e-a9a0-0be7657db693-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-snj8b\" (UID: \"94586551-72fe-440e-a9a0-0be7657db693\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:44.617019 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.616981    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wvb6b\""
Sep 11 19:30:44.624804 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.624770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"
Sep 11 19:30:44.773441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.773410    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:44.894598 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:44.894543    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b"]
Sep 11 19:30:45.533442 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:45.533411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b" event={"ID":"94586551-72fe-440e-a9a0-0be7657db693","Type":"ContainerStarted","Data":"9d8cd71cee895601101862e8d2dec1d1eb8a7471fbeb61d96270d26dc89794ce"}
Sep 11 19:30:45.554157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:45.554127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:45.655257 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:45.655227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:45.763972 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:45.763943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:46.174301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:46.174267    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:46.376750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:46.376712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:46.539516 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:46.539483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b" event={"ID":"94586551-72fe-440e-a9a0-0be7657db693","Type":"ContainerStarted","Data":"b05cb705c5f5242e7f50fca7df4454bcf72b07711f6d04723d9486cee0d36f20"}
Sep 11 19:30:46.968510 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:46.968477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:47.372704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:47.372623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:47.548682 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:47.548647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b" event={"ID":"94586551-72fe-440e-a9a0-0be7657db693","Type":"ContainerStarted","Data":"f0df7db29bcfe1770661f0d2e3dbad5df2fc26de2aa6d0abf816e4233c19ccd3"}
Sep 11 19:30:47.564161 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:47.564115    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-snj8b" podStartSLOduration=18.098681769 podStartE2EDuration="19.564100944s" totalImagesPullingTime="1.465419175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:47.563558958 +0000 UTC m=+257.312814542" watchObservedRunningTime="2026-09-11 19:30:47.564100944 +0000 UTC m=+257.313356557"
Sep 11 19:30:47.778657 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:47.778623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:48.168701 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:48.168599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:48.373624 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:48.373599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:48.783358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:48.783322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:49.373876 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:49.373844    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:49.538244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:49.538210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:49.590068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:49.590047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:49.774189 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:49.774151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:49.821259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:49.821229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:49.823827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:49.823808    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73abe7bf-a266-452a-9116-3af582379090-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bg6nc\" (UID: \"73abe7bf-a266-452a-9116-3af582379090\") " pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:49.970087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:49.970064    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bg6nc"
Sep 11 19:30:50.245191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:50.245161    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bg6nc"]
Sep 11 19:30:50.248586 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:30:50.248553    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73abe7bf_a266_452a_9116_3af582379090.slice/crio-28cba92444b6c90686a7bd57fc2a03ed2b7e277c1f6c9c11acc96b5684978b91 WatchSource:0}: Error finding container 28cba92444b6c90686a7bd57fc2a03ed2b7e277c1f6c9c11acc96b5684978b91: Status 404 returned error can't find the container with id 28cba92444b6c90686a7bd57fc2a03ed2b7e277c1f6c9c11acc96b5684978b91
Sep 11 19:30:50.560305 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:50.560229    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bg6nc" event={"ID":"73abe7bf-a266-452a-9116-3af582379090","Type":"ContainerStarted","Data":"54064f68b59b0bfc1a6a398b3d1688ea709172c75ca395a483a50a593d04cd3a"}
Sep 11 19:30:50.560305 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:50.560291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bg6nc" event={"ID":"73abe7bf-a266-452a-9116-3af582379090","Type":"ContainerStarted","Data":"28cba92444b6c90686a7bd57fc2a03ed2b7e277c1f6c9c11acc96b5684978b91"}
Sep 11 19:30:50.721383 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:50.721359    2576 scope.go:117] "RemoveContainer" containerID="efddf357076146cffc78e28e2cff48cc300047cefd7bc7dee6fc1644dcf265a8"
Sep 11 19:30:51.566324 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:51.566293    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:30:51.566826 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:51.566794    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/1.log"
Sep 11 19:30:51.566964 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:51.566842    2576 generic.go:356] "Generic (PLEG): container finished" podID="43851385-292b-4977-9cb0-8c3e2570086a" containerID="3e31d0e2153e21ab06ad43058798016ef366d359a67b278ddb654042c34c8584" exitCode=255
Sep 11 19:30:51.566964 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:51.566933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" event={"ID":"43851385-292b-4977-9cb0-8c3e2570086a","Type":"ContainerDied","Data":"3e31d0e2153e21ab06ad43058798016ef366d359a67b278ddb654042c34c8584"}
Sep 11 19:30:51.567083 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:51.567048    2576 scope.go:117] "RemoveContainer" containerID="efddf357076146cffc78e28e2cff48cc300047cefd7bc7dee6fc1644dcf265a8"
Sep 11 19:30:51.567394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:51.567375    2576 scope.go:117] "RemoveContainer" containerID="3e31d0e2153e21ab06ad43058798016ef366d359a67b278ddb654042c34c8584"
Sep 11 19:30:51.567607 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:51.567585    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-qxbdv_openshift-console-operator(43851385-292b-4977-9cb0-8c3e2570086a)\"" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" podUID="43851385-292b-4977-9cb0-8c3e2570086a"
Sep 11 19:30:51.569533 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:51.569507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bg6nc" event={"ID":"73abe7bf-a266-452a-9116-3af582379090","Type":"ContainerStarted","Data":"682a0c1ba672d98f5d66e8c795f9a9b2e76b47b08c089de0eb1d900ea4b23223"}
Sep 11 19:30:52.578303 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:52.578279    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:30:52.580402 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:52.580379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bg6nc" event={"ID":"73abe7bf-a266-452a-9116-3af582379090","Type":"ContainerStarted","Data":"cae1c2d1e183440f03b689211d4f2d037f64fa1c7b8ffbd92dd5bc1edf2f73c4"}
Sep 11 19:30:52.599500 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:52.599459    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bg6nc" podStartSLOduration=16.456342317 podStartE2EDuration="18.599441565s" totalImagesPullingTime="2.143099248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:30:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:52.599055571 +0000 UTC m=+262.348311164" watchObservedRunningTime="2026-09-11 19:30:52.599441565 +0000 UTC m=+262.348697139"
Sep 11 19:30:54.999553 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:54.999510    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:55.097835 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:55.097797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:55.346397 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:55.346298    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:55.446922 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:55.446890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:57.278364 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:57.278323    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:57.337530 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:57.337507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:58.520152 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:58.520109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:30:58.942388 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:58.942313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:58.942388 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:58.942355    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:30:58.942626 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:30:58.942614    2576 scope.go:117] "RemoveContainer" containerID="3e31d0e2153e21ab06ad43058798016ef366d359a67b278ddb654042c34c8584"
Sep 11 19:30:58.942773 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:30:58.942756    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-qxbdv_openshift-console-operator(43851385-292b-4977-9cb0-8c3e2570086a)\"" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" podUID="43851385-292b-4977-9cb0-8c3e2570086a"
Sep 11 19:31:00.499350 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.499315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:31:00.499710 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.499375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:31:00.499913 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.499891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa8815e5-5a2d-44bf-b753-b5ddd918f91d-service-ca-bundle\") pod \"router-default-5f55c6dfc6-v8gfx\" (UID: \"aa8815e5-5a2d-44bf-b753-b5ddd918f91d\") " pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:31:00.501897 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.501878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a692649b-8756-4044-9d49-021af267ef5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-fwxt7\" (UID: \"a692649b-8756-4044-9d49-021af267ef5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:31:00.728765 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.728730    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9vcq\""
Sep 11 19:31:00.736363 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.736341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"
Sep 11 19:31:00.737602 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.737586    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nfll6\""
Sep 11 19:31:00.745775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:00.745696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:31:01.007018 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.006923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7"]
Sep 11 19:31:01.009680 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:01.009652    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda692649b_8756_4044_9d49_021af267ef5b.slice/crio-e9139dd1998a3e98d538e7175563e5d50ad0452c05a5af5e5df184aea6d776a8 WatchSource:0}: Error finding container e9139dd1998a3e98d538e7175563e5d50ad0452c05a5af5e5df184aea6d776a8: Status 404 returned error can't find the container with id e9139dd1998a3e98d538e7175563e5d50ad0452c05a5af5e5df184aea6d776a8
Sep 11 19:31:01.024667 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.024637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f55c6dfc6-v8gfx"]
Sep 11 19:31:01.027309 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:01.027285    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8815e5_5a2d_44bf_b753_b5ddd918f91d.slice/crio-202fed9ff72e08b3bef5475c5e1fb6f730db247f1c0d19f349da0c06cca79775 WatchSource:0}: Error finding container 202fed9ff72e08b3bef5475c5e1fb6f730db247f1c0d19f349da0c06cca79775: Status 404 returned error can't find the container with id 202fed9ff72e08b3bef5475c5e1fb6f730db247f1c0d19f349da0c06cca79775
Sep 11 19:31:01.609492 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.609455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx" event={"ID":"aa8815e5-5a2d-44bf-b753-b5ddd918f91d","Type":"ContainerStarted","Data":"0bbfaf45ebf7d6cd8b4d43a850d55208b9795e1ca01f756b96ff9577caa515ec"}
Sep 11 19:31:01.609931 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.609505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx" event={"ID":"aa8815e5-5a2d-44bf-b753-b5ddd918f91d","Type":"ContainerStarted","Data":"202fed9ff72e08b3bef5475c5e1fb6f730db247f1c0d19f349da0c06cca79775"}
Sep 11 19:31:01.610623 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.610603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7" event={"ID":"a692649b-8756-4044-9d49-021af267ef5b","Type":"ContainerStarted","Data":"e9139dd1998a3e98d538e7175563e5d50ad0452c05a5af5e5df184aea6d776a8"}
Sep 11 19:31:01.627537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.627487    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx" podStartSLOduration=33.627469547 podStartE2EDuration="33.627469547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:01.627220269 +0000 UTC m=+271.376475844" watchObservedRunningTime="2026-09-11 19:31:01.627469547 +0000 UTC m=+271.376725121"
Sep 11 19:31:01.746936 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.746910    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:31:01.750121 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:01.750094    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:31:02.614143 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:02.614112    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:31:02.615463 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:02.615441    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f55c6dfc6-v8gfx"
Sep 11 19:31:03.336553 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:03.336432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:03.501762 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:03.501732    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:03.619592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:03.619492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7" event={"ID":"a692649b-8756-4044-9d49-021af267ef5b","Type":"ContainerStarted","Data":"21548e3614c953dd30784c85eeb7dd869950f3f858a9820f1238d84aa0d3d454"}
Sep 11 19:31:03.639285 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:03.639230    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-fwxt7" podStartSLOduration=33.641430188 podStartE2EDuration="35.639208531s" totalImagesPullingTime="1.997778343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:03.638600818 +0000 UTC m=+273.387856394" watchObservedRunningTime="2026-09-11 19:31:03.639208531 +0000 UTC m=+273.388464108"
Sep 11 19:31:03.848155 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:03.848113    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:07.527565 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:07.527528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:07.625306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:07.625260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:07.766924 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:07.766889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:09.867331 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:09.867287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:09.960906 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:09.960867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:10.061612 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:10.061592    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:10.724346 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:10.724324    2576 scope.go:117] "RemoveContainer" containerID="3e31d0e2153e21ab06ad43058798016ef366d359a67b278ddb654042c34c8584"
Sep 11 19:31:10.724539 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:31:10.724471    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-qxbdv_openshift-console-operator(43851385-292b-4977-9cb0-8c3e2570086a)\"" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" podUID="43851385-292b-4977-9cb0-8c3e2570086a"
Sep 11 19:31:11.259728 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:31:11.259689    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zndxh" podUID="6eaf5989-9a58-448b-80da-7f117fd2ea11"
Sep 11 19:31:11.647617 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.647531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zndxh"
Sep 11 19:31:11.647963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.647934    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:11.855563 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.855527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:11.899767 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.899710    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9kt8d"]
Sep 11 19:31:11.902997 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.902966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.905501 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.905477    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 19:31:11.905677 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.905565    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 19:31:11.905677 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.905600    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 19:31:11.905911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.905896    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 19:31:11.906429 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.906415    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nfn9q\""
Sep 11 19:31:11.908483 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.908464    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"]
Sep 11 19:31:11.911322 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.911308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:11.915185 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.915149    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 19:31:11.915321 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.915276    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 19:31:11.915929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.915913    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 19:31:11.917391 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.917370    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r9785\""
Sep 11 19:31:11.954334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.954306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"]
Sep 11 19:31:11.974325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.974302    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:11.976744 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/0b575b52-4e73-425c-8c58-a719ce9be1df-kube-api-access-qwcg2\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.976848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-root\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.976848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-sys\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.976848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-wtmp\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.976967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-tls\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.976967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.976967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b575b52-4e73-425c-8c58-a719ce9be1df-metrics-client-ca\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.976967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:11.977110 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:11.976974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-textfile\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.051646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.051616    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:12.077757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/0b575b52-4e73-425c-8c58-a719ce9be1df-kube-api-access-qwcg2\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.077843 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-root\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.077843 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscv4\" (UniqueName: \"kubernetes.io/projected/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-api-access-bscv4\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.077843 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-sys\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.077843 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-wtmp\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-root\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.078045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077898    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-sys\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077957    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-wtmp\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.077960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-tls\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47767f27-22a1-4c37-a2b9-c6136229b15d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.078272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078086    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b575b52-4e73-425c-8c58-a719ce9be1df-metrics-client-ca\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.078272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-textfile\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47767f27-22a1-4c37-a2b9-c6136229b15d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.078555 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.078638 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b575b52-4e73-425c-8c58-a719ce9be1df-metrics-client-ca\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.078960 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.078899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-textfile\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.080391 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.080364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-tls\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.080586 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.080568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b575b52-4e73-425c-8c58-a719ce9be1df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.086330 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.086307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwcg2\" (UniqueName: \"kubernetes.io/projected/0b575b52-4e73-425c-8c58-a719ce9be1df-kube-api-access-qwcg2\") pod \"node-exporter-9kt8d\" (UID: \"0b575b52-4e73-425c-8c58-a719ce9be1df\") " pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.152182 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.152122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:12.179590 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.179568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47767f27-22a1-4c37-a2b9-c6136229b15d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.179687 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.179608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.179796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.179775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47767f27-22a1-4c37-a2b9-c6136229b15d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.179848 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.179813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.179899 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.179849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscv4\" (UniqueName: \"kubernetes.io/projected/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-api-access-bscv4\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.180031 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.180012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.180212 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.180192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47767f27-22a1-4c37-a2b9-c6136229b15d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.180354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.180332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.180421 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.180344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47767f27-22a1-4c37-a2b9-c6136229b15d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.182509 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.182482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.182592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.182531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.187468 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.187442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscv4\" (UniqueName: \"kubernetes.io/projected/47767f27-22a1-4c37-a2b9-c6136229b15d-kube-api-access-bscv4\") pod \"kube-state-metrics-59fbdd77d-88pnf\" (UID: \"47767f27-22a1-4c37-a2b9-c6136229b15d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.208218 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.208180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:12.212965 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.212946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kt8d"
Sep 11 19:31:12.221482 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.221352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"
Sep 11 19:31:12.224574 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:12.224554    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b575b52_4e73_425c_8c58_a719ce9be1df.slice/crio-bd047722c85abf3d7fabbb7afa93a2cd9902e4fd70690c46f882d5489030b1fa WatchSource:0}: Error finding container bd047722c85abf3d7fabbb7afa93a2cd9902e4fd70690c46f882d5489030b1fa: Status 404 returned error can't find the container with id bd047722c85abf3d7fabbb7afa93a2cd9902e4fd70690c46f882d5489030b1fa
Sep 11 19:31:12.265599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.265529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:12.372522 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.372495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:12.492619 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.492598    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf"]
Sep 11 19:31:12.494799 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:12.494773    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47767f27_22a1_4c37_a2b9_c6136229b15d.slice/crio-3b2f3d93edbe939c7395574598cfef3db9c01879d7c575ac0daa14e7e13d1822 WatchSource:0}: Error finding container 3b2f3d93edbe939c7395574598cfef3db9c01879d7c575ac0daa14e7e13d1822: Status 404 returned error can't find the container with id 3b2f3d93edbe939c7395574598cfef3db9c01879d7c575ac0daa14e7e13d1822
Sep 11 19:31:12.651974 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.651948    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf" event={"ID":"47767f27-22a1-4c37-a2b9-c6136229b15d","Type":"ContainerStarted","Data":"3b2f3d93edbe939c7395574598cfef3db9c01879d7c575ac0daa14e7e13d1822"}
Sep 11 19:31:12.653301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.653268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt8d" event={"ID":"0b575b52-4e73-425c-8c58-a719ce9be1df","Type":"ContainerStarted","Data":"bd047722c85abf3d7fabbb7afa93a2cd9902e4fd70690c46f882d5489030b1fa"}
Sep 11 19:31:12.888602 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.888509    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:12.979489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:12.979457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:13.190792 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:13.190671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:13.390570 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:13.390544    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:13.489625 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:13.489594    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:13.659763 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:13.659683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt8d" event={"ID":"0b575b52-4e73-425c-8c58-a719ce9be1df","Type":"ContainerStarted","Data":"964f29f3f72120b7cb846cd0930cf6f4e956aba19b1d67f0e3721dc5275d6aa6"}
Sep 11 19:31:14.499913 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.499873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:31:14.502443 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.502419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaf5989-9a58-448b-80da-7f117fd2ea11-metrics-tls\") pod \"dns-default-zndxh\" (UID: \"6eaf5989-9a58-448b-80da-7f117fd2ea11\") " pod="openshift-dns/dns-default-zndxh"
Sep 11 19:31:14.650398 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.650366    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x76hz\""
Sep 11 19:31:14.659124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.659100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zndxh"
Sep 11 19:31:14.669009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.668913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:14.670228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.670197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf" event={"ID":"47767f27-22a1-4c37-a2b9-c6136229b15d","Type":"ContainerStarted","Data":"64e211c42395ff3cdeaac6a291c6aa5957c5c0979e30ac1856bd017c66241637"}
Sep 11 19:31:14.670346 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.670300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf" event={"ID":"47767f27-22a1-4c37-a2b9-c6136229b15d","Type":"ContainerStarted","Data":"7d758e9feb142da62f70e9ec7d31c1deeb9f9187477dee0012d444eaea12082b"}
Sep 11 19:31:14.670346 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.670331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf" event={"ID":"47767f27-22a1-4c37-a2b9-c6136229b15d","Type":"ContainerStarted","Data":"1ac3985f4e7cc8a8a8d5686e13fde81aceaba958dc35db1b52d48c5c630353c6"}
Sep 11 19:31:14.671755 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.671734    2576 generic.go:356] "Generic (PLEG): container finished" podID="0b575b52-4e73-425c-8c58-a719ce9be1df" containerID="964f29f3f72120b7cb846cd0930cf6f4e956aba19b1d67f0e3721dc5275d6aa6" exitCode=0
Sep 11 19:31:14.671833 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.671801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt8d" event={"ID":"0b575b52-4e73-425c-8c58-a719ce9be1df","Type":"ContainerDied","Data":"964f29f3f72120b7cb846cd0930cf6f4e956aba19b1d67f0e3721dc5275d6aa6"}
Sep 11 19:31:14.687866 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.687821    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-88pnf" podStartSLOduration=2.411449487 podStartE2EDuration="3.687806078s" totalImagesPullingTime="1.276356591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:14.686605925 +0000 UTC m=+284.435861524" watchObservedRunningTime="2026-09-11 19:31:14.687806078 +0000 UTC m=+284.437061652"
Sep 11 19:31:14.766053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.766030    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:14.862783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.862746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:14.889950 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.889926    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67d687f68b-h9d5x"]
Sep 11 19:31:14.892710 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.892693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:14.895841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.895708    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 19:31:14.895841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.895737    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wqcq9\""
Sep 11 19:31:14.895841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.895707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 19:31:14.895841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.895795    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 19:31:14.895841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.895708    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-aqqoab1drfqd8\""
Sep 11 19:31:14.895841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.895793    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 19:31:14.896200 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.895707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 19:31:14.907733 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.907714    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67d687f68b-h9d5x"]
Sep 11 19:31:14.937342 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.937318    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zndxh"]
Sep 11 19:31:14.940103 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:14.940081    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eaf5989_9a58_448b_80da_7f117fd2ea11.slice/crio-55e70e178fdba6f463af960d984b126aa3ead9dc5425ddc90e9e78f8c52e528a WatchSource:0}: Error finding container 55e70e178fdba6f463af960d984b126aa3ead9dc5425ddc90e9e78f8c52e528a: Status 404 returned error can't find the container with id 55e70e178fdba6f463af960d984b126aa3ead9dc5425ddc90e9e78f8c52e528a
Sep 11 19:31:14.962061 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:14.962037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:15.004724 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.004724 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-tls\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.004885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.004885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.004885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-grpc-tls\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.004885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxdm\" (UniqueName: \"kubernetes.io/projected/742cb590-8d1d-4556-a4a5-afc267ecb277-kube-api-access-lpxdm\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.005022 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.005022 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.004920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/742cb590-8d1d-4556-a4a5-afc267ecb277-metrics-client-ca\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.062318 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.062285    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:15.105463 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.105603 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-tls\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.105603 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.105603 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.105603 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-grpc-tls\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.105795 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxdm\" (UniqueName: \"kubernetes.io/projected/742cb590-8d1d-4556-a4a5-afc267ecb277-kube-api-access-lpxdm\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.105795 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.105886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.105802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/742cb590-8d1d-4556-a4a5-afc267ecb277-metrics-client-ca\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.106840 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.106811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/742cb590-8d1d-4556-a4a5-afc267ecb277-metrics-client-ca\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.108514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.108482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.108622 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.108601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.108664 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.108640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-grpc-tls\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.108714 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.108675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-tls\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.108827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.108810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.108925 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.108909    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/742cb590-8d1d-4556-a4a5-afc267ecb277-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.121331 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.121311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxdm\" (UniqueName: \"kubernetes.io/projected/742cb590-8d1d-4556-a4a5-afc267ecb277-kube-api-access-lpxdm\") pod \"thanos-querier-67d687f68b-h9d5x\" (UID: \"742cb590-8d1d-4556-a4a5-afc267ecb277\") " pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.162856 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.162814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:15.202796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.202767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:15.480791 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.480699    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67d687f68b-h9d5x"]
Sep 11 19:31:15.485405 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:15.485375    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742cb590_8d1d_4556_a4a5_afc267ecb277.slice/crio-b38065dec24826d42b31995ce5ace037add967e9d336640632266426cee46f16 WatchSource:0}: Error finding container b38065dec24826d42b31995ce5ace037add967e9d336640632266426cee46f16: Status 404 returned error can't find the container with id b38065dec24826d42b31995ce5ace037add967e9d336640632266426cee46f16
Sep 11 19:31:15.679375 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.679335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt8d" event={"ID":"0b575b52-4e73-425c-8c58-a719ce9be1df","Type":"ContainerStarted","Data":"63e05200aff5c3386fe43432bc4a9742b333604063395876ca4bd37bf60ef707"}
Sep 11 19:31:15.679797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.679407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kt8d" event={"ID":"0b575b52-4e73-425c-8c58-a719ce9be1df","Type":"ContainerStarted","Data":"f4194795b0314b6680a684d46e02f5e5e09e99b852245843fc6df2899d62bae0"}
Sep 11 19:31:15.680725 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.680700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" event={"ID":"742cb590-8d1d-4556-a4a5-afc267ecb277","Type":"ContainerStarted","Data":"b38065dec24826d42b31995ce5ace037add967e9d336640632266426cee46f16"}
Sep 11 19:31:15.681956 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.681927    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zndxh" event={"ID":"6eaf5989-9a58-448b-80da-7f117fd2ea11","Type":"ContainerStarted","Data":"55e70e178fdba6f463af960d984b126aa3ead9dc5425ddc90e9e78f8c52e528a"}
Sep 11 19:31:15.700558 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:15.700497    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9kt8d" podStartSLOduration=3.502763144 podStartE2EDuration="4.700479896s" totalImagesPullingTime="1.121323497s" totalInitContainerRuntime="76.393255ms" isStatefulPod=true podCreationTimestamp="2026-09-11 19:31:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:15.699234115 +0000 UTC m=+285.448489714" watchObservedRunningTime="2026-09-11 19:31:15.700479896 +0000 UTC m=+285.449735513"
Sep 11 19:31:16.197096 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.197047    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68c57ff97b-6jkhd"]
Sep 11 19:31:16.199599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.199573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.202214 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.202190    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 19:31:16.202542 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.202519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2glhs\""
Sep 11 19:31:16.203224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.203205    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 19:31:16.203699 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.203502    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fllr391hqg207\""
Sep 11 19:31:16.203699 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.203542    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 19:31:16.203699 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.203585    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 19:31:16.210103 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.210080    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68c57ff97b-6jkhd"]
Sep 11 19:31:16.318487 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.318453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-secret-metrics-server-client-certs\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.318666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.318500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9z86\" (UniqueName: \"kubernetes.io/projected/833b9478-3436-4733-a2c6-040fe3d04fd4-kube-api-access-g9z86\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.318666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.318528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/833b9478-3436-4733-a2c6-040fe3d04fd4-audit-log\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.318666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.318605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-client-ca-bundle\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.318666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.318660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/833b9478-3436-4733-a2c6-040fe3d04fd4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.318887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.318711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/833b9478-3436-4733-a2c6-040fe3d04fd4-metrics-server-audit-profiles\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.318887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.318757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-secret-metrics-server-tls\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.419954 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.419844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-secret-metrics-server-client-certs\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.419954 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.419899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9z86\" (UniqueName: \"kubernetes.io/projected/833b9478-3436-4733-a2c6-040fe3d04fd4-kube-api-access-g9z86\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.419954 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.419936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/833b9478-3436-4733-a2c6-040fe3d04fd4-audit-log\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.420228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.419979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-client-ca-bundle\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.420228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.420048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/833b9478-3436-4733-a2c6-040fe3d04fd4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.420228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.420081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/833b9478-3436-4733-a2c6-040fe3d04fd4-metrics-server-audit-profiles\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.420228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.420106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-secret-metrics-server-tls\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.420968 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.420936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/833b9478-3436-4733-a2c6-040fe3d04fd4-audit-log\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.421294 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.421239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/833b9478-3436-4733-a2c6-040fe3d04fd4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.421963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.421915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/833b9478-3436-4733-a2c6-040fe3d04fd4-metrics-server-audit-profiles\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.423881 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.423860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-client-ca-bundle\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.424038 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.424013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-secret-metrics-server-client-certs\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.424647 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.424626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/833b9478-3436-4733-a2c6-040fe3d04fd4-secret-metrics-server-tls\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.428977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.428952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9z86\" (UniqueName: \"kubernetes.io/projected/833b9478-3436-4733-a2c6-040fe3d04fd4-kube-api-access-g9z86\") pod \"metrics-server-68c57ff97b-6jkhd\" (UID: \"833b9478-3436-4733-a2c6-040fe3d04fd4\") " pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.513712 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.513674    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:16.656709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.656671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:16.913058 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.911700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:16.990671 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.990458    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68c57ff97b-6jkhd"]
Sep 11 19:31:16.994695 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:16.994602    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:16.996702 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:16.996662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833b9478_3436_4733_a2c6_040fe3d04fd4.slice/crio-f5598b3501fb54a1f59224a571ffe01cfed818942ddd61bc1f3ce8070f45f0af WatchSource:0}: Error finding container f5598b3501fb54a1f59224a571ffe01cfed818942ddd61bc1f3ce8070f45f0af: Status 404 returned error can't find the container with id f5598b3501fb54a1f59224a571ffe01cfed818942ddd61bc1f3ce8070f45f0af
Sep 11 19:31:17.107700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.107565    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:17.207851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.207805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:17.595260 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.595213    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:17.694707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.694678    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd" event={"ID":"833b9478-3436-4733-a2c6-040fe3d04fd4","Type":"ContainerStarted","Data":"f5598b3501fb54a1f59224a571ffe01cfed818942ddd61bc1f3ce8070f45f0af"}
Sep 11 19:31:17.696859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.696837    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" event={"ID":"742cb590-8d1d-4556-a4a5-afc267ecb277","Type":"ContainerStarted","Data":"8a9d60ef24abcbfb0c75cbef0286eb78a45820b185c11908691a1dcae4a81ec7"}
Sep 11 19:31:17.697044 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.697025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" event={"ID":"742cb590-8d1d-4556-a4a5-afc267ecb277","Type":"ContainerStarted","Data":"9fe8ac0257b52f7aaee33e8862b40e0882842cd2e1bba4db99bcb9edffc99e8b"}
Sep 11 19:31:17.698945 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.698913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zndxh" event={"ID":"6eaf5989-9a58-448b-80da-7f117fd2ea11","Type":"ContainerStarted","Data":"0d3107947700857ec3cc025162a0dd363b6c91067f5781f4bbf8b1dbf59c6117"}
Sep 11 19:31:17.699068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.698965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zndxh" event={"ID":"6eaf5989-9a58-448b-80da-7f117fd2ea11","Type":"ContainerStarted","Data":"75c81f3f3fdd82a4000caeaae6fe5a33e34a09151d78cf5d76091b633440a0f8"}
Sep 11 19:31:17.699240 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.699220    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zndxh"
Sep 11 19:31:17.718865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.718827    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zndxh" podStartSLOduration=251.931817833 podStartE2EDuration="4m13.718814031s" totalImagesPullingTime="1.786996198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:17.717487085 +0000 UTC m=+287.466742679" watchObservedRunningTime="2026-09-11 19:31:17.718814031 +0000 UTC m=+287.468069605"
Sep 11 19:31:17.744713 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.744689    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:17.846969 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.846881    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:17.945339 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:17.945307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:18.135367 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:18.135287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:18.707024 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:18.706969    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" event={"ID":"742cb590-8d1d-4556-a4a5-afc267ecb277","Type":"ContainerStarted","Data":"bdc74141ff4185264de0dccddd68d68cbacc4edf6a2e2c2bad606686781d7d67"}
Sep 11 19:31:18.921235 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:18.921200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:19.022256 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.022229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:19.714100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.714060    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd" event={"ID":"833b9478-3436-4733-a2c6-040fe3d04fd4","Type":"ContainerStarted","Data":"fbea817fc416d6021e04d11786d1eebedc8ccf2d9a1ebda461ad6b1a8024474c"}
Sep 11 19:31:19.717653 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.717626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" event={"ID":"742cb590-8d1d-4556-a4a5-afc267ecb277","Type":"ContainerStarted","Data":"391ad3fa4eff928f5f8be8c5e0c271d6bdba2294909fcccab1b3d19e098f69d8"}
Sep 11 19:31:19.717790 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.717704    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:19.717790 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.717756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" event={"ID":"742cb590-8d1d-4556-a4a5-afc267ecb277","Type":"ContainerStarted","Data":"d8275d65b1b6ea1e58af5b0452d55a824e1ddecb0db8da05fd112b7e26716e61"}
Sep 11 19:31:19.717790 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.717788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" event={"ID":"742cb590-8d1d-4556-a4a5-afc267ecb277","Type":"ContainerStarted","Data":"3f02592bd54cdc6cb51ad7e495a8c5587f185a36d0ca33b2b1bd61b3e7c04100"}
Sep 11 19:31:19.731776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.731732    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd" podStartSLOduration=1.978581287 podStartE2EDuration="3.731717777s" totalImagesPullingTime="1.75313649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:19.731194131 +0000 UTC m=+289.480449721" watchObservedRunningTime="2026-09-11 19:31:19.731717777 +0000 UTC m=+289.480973350"
Sep 11 19:31:19.751189 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:19.751148    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x" podStartSLOduration=2.660722486 podStartE2EDuration="5.751134587s" totalImagesPullingTime="3.090412101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:19.749936154 +0000 UTC m=+289.499191740" watchObservedRunningTime="2026-09-11 19:31:19.751134587 +0000 UTC m=+289.500390161"
Sep 11 19:31:24.720835 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:24.720804    2576 scope.go:117] "RemoveContainer" containerID="3e31d0e2153e21ab06ad43058798016ef366d359a67b278ddb654042c34c8584"
Sep 11 19:31:25.317300 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.317265    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-z678f"]
Sep 11 19:31:25.321373 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.321357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-z678f"
Sep 11 19:31:25.323982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.323959    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 19:31:25.324124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.324115    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zjpp2\""
Sep 11 19:31:25.324180 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.324115    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 19:31:25.329107 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.329084    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-z678f"]
Sep 11 19:31:25.343503 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.343474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:25.390443 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.390408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jn8b\" (UniqueName: \"kubernetes.io/projected/cb7194b0-a279-4a4e-b262-dc00a2170895-kube-api-access-5jn8b\") pod \"downloads-76f99584f4-z678f\" (UID: \"cb7194b0-a279-4a4e-b262-dc00a2170895\") " pod="openshift-console/downloads-76f99584f4-z678f"
Sep 11 19:31:25.403266 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.403233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:25.490941 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.490913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jn8b\" (UniqueName: \"kubernetes.io/projected/cb7194b0-a279-4a4e-b262-dc00a2170895-kube-api-access-5jn8b\") pod \"downloads-76f99584f4-z678f\" (UID: \"cb7194b0-a279-4a4e-b262-dc00a2170895\") " pod="openshift-console/downloads-76f99584f4-z678f"
Sep 11 19:31:25.499212 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.499187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jn8b\" (UniqueName: \"kubernetes.io/projected/cb7194b0-a279-4a4e-b262-dc00a2170895-kube-api-access-5jn8b\") pod \"downloads-76f99584f4-z678f\" (UID: \"cb7194b0-a279-4a4e-b262-dc00a2170895\") " pod="openshift-console/downloads-76f99584f4-z678f"
Sep 11 19:31:25.504006 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.503958    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:25.628683 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.628602    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:25.631409 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.631391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-z678f"
Sep 11 19:31:25.728865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.728839    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67d687f68b-h9d5x"
Sep 11 19:31:25.743431 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.743410    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:31:25.743529 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.743464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" event={"ID":"43851385-292b-4977-9cb0-8c3e2570086a","Type":"ContainerStarted","Data":"a2da9acd49ce2ddfa9bf8be076e7c7b1a52843fef0a28f01eb873fbdcf81968a"}
Sep 11 19:31:25.743722 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.743707    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:31:25.748040 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.748020    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv"
Sep 11 19:31:25.902724 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.902631    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-qxbdv" podStartSLOduration=54.34916172 podStartE2EDuration="57.902609184s" totalImagesPullingTime="3.553447464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:25.774155437 +0000 UTC m=+295.523411014" watchObservedRunningTime="2026-09-11 19:31:25.902609184 +0000 UTC m=+295.651864758"
Sep 11 19:31:25.903803 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:25.903784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-z678f"]
Sep 11 19:31:25.906244 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:25.906217    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7194b0_a279_4a4e_b262_dc00a2170895.slice/crio-4edc444dcb7178b02838728ccb58a3044a7e2ca7e83fb49423cb27e9a1af17fc WatchSource:0}: Error finding container 4edc444dcb7178b02838728ccb58a3044a7e2ca7e83fb49423cb27e9a1af17fc: Status 404 returned error can't find the container with id 4edc444dcb7178b02838728ccb58a3044a7e2ca7e83fb49423cb27e9a1af17fc
Sep 11 19:31:26.007850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:26.007821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:26.111082 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:26.111056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:26.419549 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:26.419508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:26.521293 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:26.521263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:26.721083 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:31:26.721046    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wpt8b" podUID="1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e"
Sep 11 19:31:26.749522 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:26.749490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-z678f" event={"ID":"cb7194b0-a279-4a4e-b262-dc00a2170895","Type":"ContainerStarted","Data":"4edc444dcb7178b02838728ccb58a3044a7e2ca7e83fb49423cb27e9a1af17fc"}
Sep 11 19:31:26.815284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:26.815253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:27.010775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:27.010700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:27.384055 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:27.383945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:27.622218 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:27.622167    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:27.676872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:27.676789    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:27.709485 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:27.709464    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zndxh"
Sep 11 19:31:30.624141 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:30.624113    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:31:30.624508 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:30.624289    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:31:30.634516 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:30.634489    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:31:30.635053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:30.635032    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:31:30.639537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:30.639518    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 19:31:30.974816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:30.974787    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:31.075773 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:31.075743    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:32.122946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:32.122910    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:32.181272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:32.181232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:34.027409 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.027361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:34.128478 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.128441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:34.619184 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.619152    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b9d4c6dcb-j9t8f"]
Sep 11 19:31:34.622654 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.622634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.625926 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.625897    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vtmk8\""
Sep 11 19:31:34.625926 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.625908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 19:31:34.625926 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.625908    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 19:31:34.626165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.625948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 19:31:34.626165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.625946    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 19:31:34.626165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.625907    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 19:31:34.634518 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.634496    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b9d4c6dcb-j9t8f"]
Sep 11 19:31:34.664828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.664797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-oauth-serving-cert\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.664970 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.664881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-console-config\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.664970 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.664921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-oauth-config\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.664970 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.664947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsq9s\" (UniqueName: \"kubernetes.io/projected/6121e05f-973a-4b37-81eb-be3189e29ff3-kube-api-access-fsq9s\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.665134 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.664980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-serving-cert\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.665134 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.665082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-service-ca\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.765678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.765639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-service-ca\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.765865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.765718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-oauth-serving-cert\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.765865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.765777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-console-config\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.765865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.765811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-oauth-config\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.765865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.765833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsq9s\" (UniqueName: \"kubernetes.io/projected/6121e05f-973a-4b37-81eb-be3189e29ff3-kube-api-access-fsq9s\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.765865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.765856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-serving-cert\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.766519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.766493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-console-config\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.766797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.766491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-service-ca\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.766797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.766541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-oauth-serving-cert\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.768676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.768655    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-serving-cert\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.768820 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.768802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-oauth-config\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.774105 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.774081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsq9s\" (UniqueName: \"kubernetes.io/projected/6121e05f-973a-4b37-81eb-be3189e29ff3-kube-api-access-fsq9s\") pod \"console-7b9d4c6dcb-j9t8f\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") " pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:34.934273 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:34.934135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:35.212242 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:35.212213    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b9d4c6dcb-j9t8f"]
Sep 11 19:31:35.215181 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:35.215151    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6121e05f_973a_4b37_81eb_be3189e29ff3.slice/crio-4dd58e7d8ed48c71b66bd7bd5ad43aface7c53da3d6c3f2fa06f925739aa2fbc WatchSource:0}: Error finding container 4dd58e7d8ed48c71b66bd7bd5ad43aface7c53da3d6c3f2fa06f925739aa2fbc: Status 404 returned error can't find the container with id 4dd58e7d8ed48c71b66bd7bd5ad43aface7c53da3d6c3f2fa06f925739aa2fbc
Sep 11 19:31:35.217776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:35.217755    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:31:35.790196 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:35.790157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9d4c6dcb-j9t8f" event={"ID":"6121e05f-973a-4b37-81eb-be3189e29ff3","Type":"ContainerStarted","Data":"4dd58e7d8ed48c71b66bd7bd5ad43aface7c53da3d6c3f2fa06f925739aa2fbc"}
Sep 11 19:31:36.514089 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:36.514045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:36.514557 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:36.514111    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:38.630692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:38.630660    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:38.719954 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:38.719924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:31:40.008206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:40.008170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:40.062548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:40.062507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:40.339040 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:40.338937    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:40.439182 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:40.439097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:41.641656 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.641621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:41.822633 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.822598    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdd68d9f4-2jf5t"]
Sep 11 19:31:41.826062 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.826038    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:41.834174 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.834055    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 19:31:41.835373 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.835353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdd68d9f4-2jf5t"]
Sep 11 19:31:41.933180 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.933107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-serving-cert\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:41.933180 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.933146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-oauth-config\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:41.933411 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.933185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-oauth-serving-cert\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:41.933411 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.933212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccg98\" (UniqueName: \"kubernetes.io/projected/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-kube-api-access-ccg98\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:41.933411 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.933253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-trusted-ca-bundle\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:41.933411 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.933305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-config\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:41.933411 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:41.933349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-service-ca\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.034574 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.034540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-service-ca\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.034748 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.034646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-serving-cert\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.034748 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.034671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-oauth-config\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.034748 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.034692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-oauth-serving-cert\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.034748 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.034710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccg98\" (UniqueName: \"kubernetes.io/projected/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-kube-api-access-ccg98\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.034748 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.034739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-trusted-ca-bundle\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.035040 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.034777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-config\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.035488 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.035326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-service-ca\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.035488 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.035416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-config\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.036073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.036051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-trusted-ca-bundle\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.036073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.036067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-oauth-serving-cert\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.037609 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.037590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-oauth-config\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.037823 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.037798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-serving-cert\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.043246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.043221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccg98\" (UniqueName: \"kubernetes.io/projected/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-kube-api-access-ccg98\") pod \"console-fdd68d9f4-2jf5t\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") " pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:42.137841 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:42.137807    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:43.227921 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:43.227878    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:43.283302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:43.283264    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:44.830808 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:44.830761    2576 generic.go:356] "Generic (PLEG): container finished" podID="0d7df0e3-b8f6-4608-8262-1638fef4208b" containerID="f7a7f55020123d9c26b5c8c01b900d0cb1845e74ca4642cf483fb3e2e14fcd89" exitCode=0
Sep 11 19:31:44.831309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:44.830840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59" event={"ID":"0d7df0e3-b8f6-4608-8262-1638fef4208b","Type":"ContainerDied","Data":"f7a7f55020123d9c26b5c8c01b900d0cb1845e74ca4642cf483fb3e2e14fcd89"}
Sep 11 19:31:44.831309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:44.831239    2576 scope.go:117] "RemoveContainer" containerID="f7a7f55020123d9c26b5c8c01b900d0cb1845e74ca4642cf483fb3e2e14fcd89"
Sep 11 19:31:45.442922 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.442888    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdd68d9f4-2jf5t"]
Sep 11 19:31:45.445778 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:31:45.445751    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b3ef8e_547b_4f5a_8ed2_8ff03b9381e1.slice/crio-c48c180924cf2d6b175c1e5640b634088cae28185540f1295ecf2bfc1adf3d67 WatchSource:0}: Error finding container c48c180924cf2d6b175c1e5640b634088cae28185540f1295ecf2bfc1adf3d67: Status 404 returned error can't find the container with id c48c180924cf2d6b175c1e5640b634088cae28185540f1295ecf2bfc1adf3d67
Sep 11 19:31:45.838970 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.838929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd68d9f4-2jf5t" event={"ID":"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1","Type":"ContainerStarted","Data":"9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177"}
Sep 11 19:31:45.839420 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.839021    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd68d9f4-2jf5t" event={"ID":"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1","Type":"ContainerStarted","Data":"c48c180924cf2d6b175c1e5640b634088cae28185540f1295ecf2bfc1adf3d67"}
Sep 11 19:31:45.841625 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.841592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-djk59" event={"ID":"0d7df0e3-b8f6-4608-8262-1638fef4208b","Type":"ContainerStarted","Data":"c9b0ba57e80a2a6a45135d5cc8733813a04a57ceeaba218aa8ae6ca449b93da2"}
Sep 11 19:31:45.843611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.843585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9d4c6dcb-j9t8f" event={"ID":"6121e05f-973a-4b37-81eb-be3189e29ff3","Type":"ContainerStarted","Data":"e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da"}
Sep 11 19:31:45.845411 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.845387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-z678f" event={"ID":"cb7194b0-a279-4a4e-b262-dc00a2170895","Type":"ContainerStarted","Data":"cdda7baf7a4f84000059babd62b7bab2c53fc9ff6c0adfa729486283e0a0fcfd"}
Sep 11 19:31:45.845611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.845584    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-z678f"
Sep 11 19:31:45.855887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.855832    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdd68d9f4-2jf5t" podStartSLOduration=4.855813392 podStartE2EDuration="4.855813392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:45.854895785 +0000 UTC m=+315.604151370" watchObservedRunningTime="2026-09-11 19:31:45.855813392 +0000 UTC m=+315.605068968"
Sep 11 19:31:45.863678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.863655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-z678f"
Sep 11 19:31:45.871716 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.871678    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b9d4c6dcb-j9t8f" podStartSLOduration=1.911952012 podStartE2EDuration="11.871663491s" totalImagesPullingTime="9.959711479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:45.869950418 +0000 UTC m=+315.619206006" watchObservedRunningTime="2026-09-11 19:31:45.871663491 +0000 UTC m=+315.620919064"
Sep 11 19:31:45.885972 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:45.885921    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-z678f" podStartSLOduration=1.565545945 podStartE2EDuration="20.885905725s" totalImagesPullingTime="19.32035978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:45.884427887 +0000 UTC m=+315.633683486" watchObservedRunningTime="2026-09-11 19:31:45.885905725 +0000 UTC m=+315.635161299"
Sep 11 19:31:48.861461 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:48.861424    2576 generic.go:356] "Generic (PLEG): container finished" podID="42e2eaa2-172d-4671-b904-26b952b07c56" containerID="03a1e94b454e364b878328edf280498c6dd107e56ca55ed96b6a086c8bbc5189" exitCode=0
Sep 11 19:31:48.861864 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:48.861503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr" event={"ID":"42e2eaa2-172d-4671-b904-26b952b07c56","Type":"ContainerDied","Data":"03a1e94b454e364b878328edf280498c6dd107e56ca55ed96b6a086c8bbc5189"}
Sep 11 19:31:48.861931 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:48.861877    2576 scope.go:117] "RemoveContainer" containerID="03a1e94b454e364b878328edf280498c6dd107e56ca55ed96b6a086c8bbc5189"
Sep 11 19:31:49.868595 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:49.868559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-fpsgr" event={"ID":"42e2eaa2-172d-4671-b904-26b952b07c56","Type":"ContainerStarted","Data":"405ea2267c8b59aa7c31216aba4a8eae693edeb69aa38d1d9db84da2f1f46dd3"}
Sep 11 19:31:51.864344 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:51.864294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:51.920398 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:51.920362    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:52.138685 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:52.138605    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:52.138843 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:52.138719    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:52.144248 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:52.144224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:52.893245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:52.893211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:31:52.941868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:52.941832    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b9d4c6dcb-j9t8f"]
Sep 11 19:31:53.037063 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:53.037012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:53.095133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:53.095096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:53.150164 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:53.150085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:53.896942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:53.895349    2576 generic.go:356] "Generic (PLEG): container finished" podID="dec7f412-9871-4a8b-81d9-ce4ac13dc84d" containerID="d6da3b6c28c748701968fe80630d2bfb5d369bd1267c6e17c4871957aa843e55" exitCode=0
Sep 11 19:31:53.896942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:53.896063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-gz58s" event={"ID":"dec7f412-9871-4a8b-81d9-ce4ac13dc84d","Type":"ContainerDied","Data":"d6da3b6c28c748701968fe80630d2bfb5d369bd1267c6e17c4871957aa843e55"}
Sep 11 19:31:53.896942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:53.896390    2576 scope.go:117] "RemoveContainer" containerID="d6da3b6c28c748701968fe80630d2bfb5d369bd1267c6e17c4871957aa843e55"
Sep 11 19:31:53.958558 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:53.958457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:54.060204 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:54.060164    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:54.901048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:54.901015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-gz58s" event={"ID":"dec7f412-9871-4a8b-81d9-ce4ac13dc84d","Type":"ContainerStarted","Data":"80f5d2fbc3395fb790f0027423c9b6f3a17f1cc5156b0244ed34c652b6828d75"}
Sep 11 19:31:54.934438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:54.934391    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:31:55.343308 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:55.343261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:55.402261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:55.402206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:31:56.519407 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:56.519378    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:31:56.523416 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:31:56.523395    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68c57ff97b-6jkhd"
Sep 11 19:32:10.340621 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:10.340583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:10.441828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:10.441796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:17.971813 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:17.971773    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b9d4c6dcb-j9t8f" podUID="6121e05f-973a-4b37-81eb-be3189e29ff3" containerName="console" containerID="cri-o://e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da" gracePeriod=15
Sep 11 19:32:18.242537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.242484    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:32:18.352846 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.352817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-oauth-serving-cert\") pod \"6121e05f-973a-4b37-81eb-be3189e29ff3\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") "
Sep 11 19:32:18.352973 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.352874    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-console-config\") pod \"6121e05f-973a-4b37-81eb-be3189e29ff3\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") "
Sep 11 19:32:18.352973 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.352912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-service-ca\") pod \"6121e05f-973a-4b37-81eb-be3189e29ff3\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") "
Sep 11 19:32:18.352973 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.352953    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-oauth-config\") pod \"6121e05f-973a-4b37-81eb-be3189e29ff3\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") "
Sep 11 19:32:18.353165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.353007    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-serving-cert\") pod \"6121e05f-973a-4b37-81eb-be3189e29ff3\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") "
Sep 11 19:32:18.353165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.353038    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsq9s\" (UniqueName: \"kubernetes.io/projected/6121e05f-973a-4b37-81eb-be3189e29ff3-kube-api-access-fsq9s\") pod \"6121e05f-973a-4b37-81eb-be3189e29ff3\" (UID: \"6121e05f-973a-4b37-81eb-be3189e29ff3\") "
Sep 11 19:32:18.353289 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.353260    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6121e05f-973a-4b37-81eb-be3189e29ff3" (UID: "6121e05f-973a-4b37-81eb-be3189e29ff3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:18.353345 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.353330    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-console-config" (OuterVolumeSpecName: "console-config") pod "6121e05f-973a-4b37-81eb-be3189e29ff3" (UID: "6121e05f-973a-4b37-81eb-be3189e29ff3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:18.353392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.353345    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-service-ca" (OuterVolumeSpecName: "service-ca") pod "6121e05f-973a-4b37-81eb-be3189e29ff3" (UID: "6121e05f-973a-4b37-81eb-be3189e29ff3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:18.355353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.355331    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6121e05f-973a-4b37-81eb-be3189e29ff3" (UID: "6121e05f-973a-4b37-81eb-be3189e29ff3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:32:18.355716 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.355692    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6121e05f-973a-4b37-81eb-be3189e29ff3" (UID: "6121e05f-973a-4b37-81eb-be3189e29ff3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:32:18.355783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.355719    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6121e05f-973a-4b37-81eb-be3189e29ff3-kube-api-access-fsq9s" (OuterVolumeSpecName: "kube-api-access-fsq9s") pod "6121e05f-973a-4b37-81eb-be3189e29ff3" (UID: "6121e05f-973a-4b37-81eb-be3189e29ff3"). InnerVolumeSpecName "kube-api-access-fsq9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:18.453976 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.453952    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:32:18.454095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.453974    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsq9s\" (UniqueName: \"kubernetes.io/projected/6121e05f-973a-4b37-81eb-be3189e29ff3-kube-api-access-fsq9s\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:32:18.454095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.454009    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-oauth-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:32:18.454095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.454018    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-console-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:32:18.454095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.454026    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6121e05f-973a-4b37-81eb-be3189e29ff3-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:32:18.454095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.454033    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6121e05f-973a-4b37-81eb-be3189e29ff3-console-oauth-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:32:18.999695 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.999631    2576 generic.go:356] "Generic (PLEG): container finished" podID="6121e05f-973a-4b37-81eb-be3189e29ff3" containerID="e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da" exitCode=0
Sep 11 19:32:18.999695 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.999684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9d4c6dcb-j9t8f" event={"ID":"6121e05f-973a-4b37-81eb-be3189e29ff3","Type":"ContainerDied","Data":"e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da"}
Sep 11 19:32:19.000161 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.999716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b9d4c6dcb-j9t8f" event={"ID":"6121e05f-973a-4b37-81eb-be3189e29ff3","Type":"ContainerDied","Data":"4dd58e7d8ed48c71b66bd7bd5ad43aface7c53da3d6c3f2fa06f925739aa2fbc"}
Sep 11 19:32:19.000161 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.999734    2576 scope.go:117] "RemoveContainer" containerID="e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da"
Sep 11 19:32:19.000161 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:18.999684    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b9d4c6dcb-j9t8f"
Sep 11 19:32:19.010253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:19.010232    2576 scope.go:117] "RemoveContainer" containerID="e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da"
Sep 11 19:32:19.010512 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:32:19.010492    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da\": container with ID starting with e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da not found: ID does not exist" containerID="e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da"
Sep 11 19:32:19.010566 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:19.010521    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da"} err="failed to get container status \"e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da\": rpc error: code = NotFound desc = could not find container \"e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da\": container with ID starting with e430f5e4d390f29835ed87efbdbc2699c6173cbc37cf97f2bc6d7307dfd419da not found: ID does not exist"
Sep 11 19:32:19.016430 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:19.016408    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b9d4c6dcb-j9t8f"]
Sep 11 19:32:19.020356 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:19.020335    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b9d4c6dcb-j9t8f"]
Sep 11 19:32:20.725520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:20.725487    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6121e05f-973a-4b37-81eb-be3189e29ff3" path="/var/lib/kubelet/pods/6121e05f-973a-4b37-81eb-be3189e29ff3/volumes"
Sep 11 19:32:23.602165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:23.602068    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:23.657006 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:23.656965    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:31.102003 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:31.101948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:31.214935 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:31.214902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:39.669519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.669490    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c4b48bd9b-slp8d"]
Sep 11 19:32:39.669872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.669833    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6121e05f-973a-4b37-81eb-be3189e29ff3" containerName="console"
Sep 11 19:32:39.669872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.669845    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6121e05f-973a-4b37-81eb-be3189e29ff3" containerName="console"
Sep 11 19:32:39.669941 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.669915    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6121e05f-973a-4b37-81eb-be3189e29ff3" containerName="console"
Sep 11 19:32:39.671921 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.671897    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.684275 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.684247    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4b48bd9b-slp8d"]
Sep 11 19:32:39.713662 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.713633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-oauth-serving-cert\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.713794 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.713666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-trusted-ca-bundle\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.713794 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.713687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-console-config\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.713880 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.713797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pjx8\" (UniqueName: \"kubernetes.io/projected/23699064-e254-46a4-ae6d-44fd00abcc15-kube-api-access-8pjx8\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.713880 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.713837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-service-ca\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.713880 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.713874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-serving-cert\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.714027 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.713913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-oauth-config\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.714600 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.714572    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:39.767167 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.767134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:39.815245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-service-ca\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.815332 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-serving-cert\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.815332 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-oauth-config\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.815460 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-oauth-serving-cert\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.815523 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-trusted-ca-bundle\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.815523 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-console-config\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.815636 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pjx8\" (UniqueName: \"kubernetes.io/projected/23699064-e254-46a4-ae6d-44fd00abcc15-kube-api-access-8pjx8\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.815967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.815930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-service-ca\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.816249 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.816147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-oauth-serving-cert\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.816492 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.816462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-trusted-ca-bundle\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.816672 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.816650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-console-config\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.818113 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.818096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-oauth-config\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.818456 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.818435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-serving-cert\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.824011 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.823963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pjx8\" (UniqueName: \"kubernetes.io/projected/23699064-e254-46a4-ae6d-44fd00abcc15-kube-api-access-8pjx8\") pod \"console-6c4b48bd9b-slp8d\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") " pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:39.983727 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:39.983704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:40.253824 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:40.253737    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4b48bd9b-slp8d"]
Sep 11 19:32:40.257678 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:32:40.257642    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23699064_e254_46a4_ae6d_44fd00abcc15.slice/crio-c5c428e9f309466fb50a4970a5afca06255aefe2c2f4a6cea7348fdf7051c9a9 WatchSource:0}: Error finding container c5c428e9f309466fb50a4970a5afca06255aefe2c2f4a6cea7348fdf7051c9a9: Status 404 returned error can't find the container with id c5c428e9f309466fb50a4970a5afca06255aefe2c2f4a6cea7348fdf7051c9a9
Sep 11 19:32:40.319797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:40.319769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:40.421997 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:40.421945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:41.090067 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:41.090030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4b48bd9b-slp8d" event={"ID":"23699064-e254-46a4-ae6d-44fd00abcc15","Type":"ContainerStarted","Data":"c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa"}
Sep 11 19:32:41.090492 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:41.090084    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4b48bd9b-slp8d" event={"ID":"23699064-e254-46a4-ae6d-44fd00abcc15","Type":"ContainerStarted","Data":"c5c428e9f309466fb50a4970a5afca06255aefe2c2f4a6cea7348fdf7051c9a9"}
Sep 11 19:32:41.107885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:41.107835    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c4b48bd9b-slp8d" podStartSLOduration=2.107818945 podStartE2EDuration="2.107818945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:41.106842021 +0000 UTC m=+370.856097611" watchObservedRunningTime="2026-09-11 19:32:41.107818945 +0000 UTC m=+370.857074518"
Sep 11 19:32:44.549323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:44.549280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:32:44.552090 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:44.552065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e-metrics-certs\") pod \"network-metrics-daemon-wpt8b\" (UID: \"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e\") " pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:32:44.724153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:44.724125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k4fsc\""
Sep 11 19:32:44.731554 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:44.731533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wpt8b"
Sep 11 19:32:45.013441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:45.013411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wpt8b"]
Sep 11 19:32:45.017094 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:32:45.017069    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcf4f3c_3b2d_40f6_89e9_bb59dae2077e.slice/crio-608eb6e7a765718c7766bba9019b99dc5944a6061ae7e61d08751b00e08f0e33 WatchSource:0}: Error finding container 608eb6e7a765718c7766bba9019b99dc5944a6061ae7e61d08751b00e08f0e33: Status 404 returned error can't find the container with id 608eb6e7a765718c7766bba9019b99dc5944a6061ae7e61d08751b00e08f0e33
Sep 11 19:32:45.111198 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:45.111171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wpt8b" event={"ID":"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e","Type":"ContainerStarted","Data":"608eb6e7a765718c7766bba9019b99dc5944a6061ae7e61d08751b00e08f0e33"}
Sep 11 19:32:46.116910 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:46.116838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wpt8b" event={"ID":"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e","Type":"ContainerStarted","Data":"c14febd2d8e37266cfb0c457d6dcea2ee06bc0d5047e438264a92bf6fd681141"}
Sep 11 19:32:46.116910 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:46.116887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wpt8b" event={"ID":"1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e","Type":"ContainerStarted","Data":"0fe74aee5384818256454dad9a798b0926d8ccc59756e8bedf64ec439d26d42b"}
Sep 11 19:32:46.138889 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:46.138837    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wpt8b" podStartSLOduration=375.307617737 podStartE2EDuration="6m16.138814472s" totalImagesPullingTime="831.196735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:46.137824257 +0000 UTC m=+375.887079842" watchObservedRunningTime="2026-09-11 19:32:46.138814472 +0000 UTC m=+375.888070049"
Sep 11 19:32:46.227258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:46.227233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:46.287888 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:46.287843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:49.984045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:49.984008    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:49.984510 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:49.984062    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:49.988850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:49.988825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:50.137792 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:50.137764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:32:50.182541 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:50.182515    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdd68d9f4-2jf5t"]
Sep 11 19:32:50.283974 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:50.283889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:50.338634 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:50.338603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:50.391771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:50.391742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:32:51.191385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:32:51.191345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:15.208318 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.208281    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fdd68d9f4-2jf5t" podUID="36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" containerName="console" containerID="cri-o://9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177" gracePeriod=15
Sep 11 19:33:15.453169 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.453145    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:33:15.584610 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-service-ca\") pod \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") "
Sep 11 19:33:15.584610 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584613    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-config\") pod \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") "
Sep 11 19:33:15.584775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccg98\" (UniqueName: \"kubernetes.io/projected/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-kube-api-access-ccg98\") pod \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") "
Sep 11 19:33:15.584775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584753    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-oauth-config\") pod \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") "
Sep 11 19:33:15.584861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584785    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-oauth-serving-cert\") pod \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") "
Sep 11 19:33:15.584861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-trusted-ca-bundle\") pod \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") "
Sep 11 19:33:15.584861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-serving-cert\") pod \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\" (UID: \"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1\") "
Sep 11 19:33:15.585032 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.584963    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" (UID: "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:15.585194 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.585168    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-config" (OuterVolumeSpecName: "console-config") pod "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" (UID: "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:15.585309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.585192    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:33:15.585309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.585238    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" (UID: "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:15.585309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.585263    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" (UID: "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:15.587030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.587003    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" (UID: "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:33:15.587200 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.587173    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" (UID: "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:33:15.587247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.587184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-kube-api-access-ccg98" (OuterVolumeSpecName: "kube-api-access-ccg98") pod "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" (UID: "36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1"). InnerVolumeSpecName "kube-api-access-ccg98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:33:15.686330 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.686302    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-oauth-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:33:15.686330 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.686330    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-trusted-ca-bundle\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:33:15.686458 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.686340    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:33:15.686458 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.686348    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:33:15.686458 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.686357    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccg98\" (UniqueName: \"kubernetes.io/projected/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-kube-api-access-ccg98\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:33:15.686458 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:15.686366    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1-console-oauth-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:33:16.240367 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.240330    2576 generic.go:356] "Generic (PLEG): container finished" podID="36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" containerID="9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177" exitCode=0
Sep 11 19:33:16.240821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.240397    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd68d9f4-2jf5t"
Sep 11 19:33:16.240821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.240421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd68d9f4-2jf5t" event={"ID":"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1","Type":"ContainerDied","Data":"9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177"}
Sep 11 19:33:16.240821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.240520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd68d9f4-2jf5t" event={"ID":"36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1","Type":"ContainerDied","Data":"c48c180924cf2d6b175c1e5640b634088cae28185540f1295ecf2bfc1adf3d67"}
Sep 11 19:33:16.240821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.240552    2576 scope.go:117] "RemoveContainer" containerID="9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177"
Sep 11 19:33:16.250174 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.250085    2576 scope.go:117] "RemoveContainer" containerID="9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177"
Sep 11 19:33:16.250428 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:33:16.250409    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177\": container with ID starting with 9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177 not found: ID does not exist" containerID="9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177"
Sep 11 19:33:16.250472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.250436    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177"} err="failed to get container status \"9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177\": rpc error: code = NotFound desc = could not find container \"9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177\": container with ID starting with 9c51f8948839956e4ba0af88539e9d782cbcfc12d125b808cbde7a61615c3177 not found: ID does not exist"
Sep 11 19:33:16.261240 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.261218    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdd68d9f4-2jf5t"]
Sep 11 19:33:16.264479 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.264457    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdd68d9f4-2jf5t"]
Sep 11 19:33:16.725975 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:16.725943    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" path="/var/lib/kubelet/pods/36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1/volumes"
Sep 11 19:33:24.741060 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:24.741021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:46.329018 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:46.328961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:46.386206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:46.386152    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:47.790022 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.789970    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544bf87dc8-6j4nd"]
Sep 11 19:33:47.790455 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.790434    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" containerName="console"
Sep 11 19:33:47.790455 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.790453    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" containerName="console"
Sep 11 19:33:47.790570 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.790538    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b3ef8e-547b-4f5a-8ed2-8ff03b9381e1" containerName="console"
Sep 11 19:33:47.793792 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.793770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.807971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.807937    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544bf87dc8-6j4nd"]
Sep 11 19:33:47.819700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.819675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-config\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.819801 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.819716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-oauth-serving-cert\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.819842 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.819791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppzh8\" (UniqueName: \"kubernetes.io/projected/3440aa37-64fc-4df2-a28d-a8712a1fde47-kube-api-access-ppzh8\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.819842 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.819831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-trusted-ca-bundle\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.819902 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.819876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-service-ca\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.819935 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.819921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-serving-cert\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.819969 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.819939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-oauth-config\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.847201 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.847164    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:47.910177 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.910144    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:47.921088 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-oauth-config\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.921160 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-config\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.921160 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-oauth-serving-cert\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.921160 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppzh8\" (UniqueName: \"kubernetes.io/projected/3440aa37-64fc-4df2-a28d-a8712a1fde47-kube-api-access-ppzh8\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.921290 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-trusted-ca-bundle\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.921290 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-service-ca\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.921290 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-serving-cert\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.921940 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-config\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.922074 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.921980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-oauth-serving-cert\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.922122 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.922095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-trusted-ca-bundle\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.922317 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.922292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-service-ca\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.923556 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.923533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-oauth-config\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.923732 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.923715    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-serving-cert\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.930053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.930035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppzh8\" (UniqueName: \"kubernetes.io/projected/3440aa37-64fc-4df2-a28d-a8712a1fde47-kube-api-access-ppzh8\") pod \"console-544bf87dc8-6j4nd\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") " pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:47.992007 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:47.991964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:48.064523 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:48.064449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:48.105676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:48.105655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:48.378724 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:48.378703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544bf87dc8-6j4nd"]
Sep 11 19:33:48.381172 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:33:48.381140    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3440aa37_64fc_4df2_a28d_a8712a1fde47.slice/crio-06f2f662d4359a9cafdb3fa3b880d808be615d6c368ba5a6995fce0332790776 WatchSource:0}: Error finding container 06f2f662d4359a9cafdb3fa3b880d808be615d6c368ba5a6995fce0332790776: Status 404 returned error can't find the container with id 06f2f662d4359a9cafdb3fa3b880d808be615d6c368ba5a6995fce0332790776
Sep 11 19:33:48.585267 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:48.585229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:48.647968 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:48.647896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:49.383068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:49.383032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bf87dc8-6j4nd" event={"ID":"3440aa37-64fc-4df2-a28d-a8712a1fde47","Type":"ContainerStarted","Data":"c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2"}
Sep 11 19:33:49.383452 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:49.383082    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bf87dc8-6j4nd" event={"ID":"3440aa37-64fc-4df2-a28d-a8712a1fde47","Type":"ContainerStarted","Data":"06f2f662d4359a9cafdb3fa3b880d808be615d6c368ba5a6995fce0332790776"}
Sep 11 19:33:49.403794 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:49.403753    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544bf87dc8-6j4nd" podStartSLOduration=2.40373771 podStartE2EDuration="2.40373771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:49.40248648 +0000 UTC m=+439.151742071" watchObservedRunningTime="2026-09-11 19:33:49.40373771 +0000 UTC m=+439.152993283"
Sep 11 19:33:58.106700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.106605    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:58.106700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.106667    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:58.111645 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.111623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:58.335118 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.335082    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:58.422284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.422226    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:33:58.434901 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.434866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:58.510269 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.510238    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4b48bd9b-slp8d"]
Sep 11 19:33:58.608246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.608203    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:58.667672 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.667630    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:33:58.721785 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:33:58.721759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:34:01.772887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:01.772854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:34:01.873322 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:01.873289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:34:23.533416 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.533347    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c4b48bd9b-slp8d" podUID="23699064-e254-46a4-ae6d-44fd00abcc15" containerName="console" containerID="cri-o://c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa" gracePeriod=15
Sep 11 19:34:23.770401 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.770376    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:34:23.886253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-trusted-ca-bundle\") pod \"23699064-e254-46a4-ae6d-44fd00abcc15\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") "
Sep 11 19:34:23.886253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886226    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-oauth-config\") pod \"23699064-e254-46a4-ae6d-44fd00abcc15\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") "
Sep 11 19:34:23.886438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886282    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pjx8\" (UniqueName: \"kubernetes.io/projected/23699064-e254-46a4-ae6d-44fd00abcc15-kube-api-access-8pjx8\") pod \"23699064-e254-46a4-ae6d-44fd00abcc15\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") "
Sep 11 19:34:23.886438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886301    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-service-ca\") pod \"23699064-e254-46a4-ae6d-44fd00abcc15\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") "
Sep 11 19:34:23.886438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886353    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-console-config\") pod \"23699064-e254-46a4-ae6d-44fd00abcc15\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") "
Sep 11 19:34:23.886438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886376    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-serving-cert\") pod \"23699064-e254-46a4-ae6d-44fd00abcc15\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") "
Sep 11 19:34:23.886438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-oauth-serving-cert\") pod \"23699064-e254-46a4-ae6d-44fd00abcc15\" (UID: \"23699064-e254-46a4-ae6d-44fd00abcc15\") "
Sep 11 19:34:23.886717 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886674    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "23699064-e254-46a4-ae6d-44fd00abcc15" (UID: "23699064-e254-46a4-ae6d-44fd00abcc15"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:23.886849 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886791    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-service-ca" (OuterVolumeSpecName: "service-ca") pod "23699064-e254-46a4-ae6d-44fd00abcc15" (UID: "23699064-e254-46a4-ae6d-44fd00abcc15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:23.886926 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886836    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-console-config" (OuterVolumeSpecName: "console-config") pod "23699064-e254-46a4-ae6d-44fd00abcc15" (UID: "23699064-e254-46a4-ae6d-44fd00abcc15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:23.886926 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.886890    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "23699064-e254-46a4-ae6d-44fd00abcc15" (UID: "23699064-e254-46a4-ae6d-44fd00abcc15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:34:23.888631 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.888605    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "23699064-e254-46a4-ae6d-44fd00abcc15" (UID: "23699064-e254-46a4-ae6d-44fd00abcc15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:34:23.888693 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.888669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "23699064-e254-46a4-ae6d-44fd00abcc15" (UID: "23699064-e254-46a4-ae6d-44fd00abcc15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:34:23.888693 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.888678    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23699064-e254-46a4-ae6d-44fd00abcc15-kube-api-access-8pjx8" (OuterVolumeSpecName: "kube-api-access-8pjx8") pod "23699064-e254-46a4-ae6d-44fd00abcc15" (UID: "23699064-e254-46a4-ae6d-44fd00abcc15"). InnerVolumeSpecName "kube-api-access-8pjx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:34:23.987028 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.986980    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pjx8\" (UniqueName: \"kubernetes.io/projected/23699064-e254-46a4-ae6d-44fd00abcc15-kube-api-access-8pjx8\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:34:23.987028 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.987025    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:34:23.987157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.987035    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-console-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:34:23.987157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.987043    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:34:23.987157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.987051    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-oauth-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:34:23.987157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.987059    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23699064-e254-46a4-ae6d-44fd00abcc15-trusted-ca-bundle\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:34:23.987157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:23.987067    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23699064-e254-46a4-ae6d-44fd00abcc15-console-oauth-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:34:24.529550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.529522    2576 generic.go:356] "Generic (PLEG): container finished" podID="23699064-e254-46a4-ae6d-44fd00abcc15" containerID="c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa" exitCode=0
Sep 11 19:34:24.529678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.529556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4b48bd9b-slp8d" event={"ID":"23699064-e254-46a4-ae6d-44fd00abcc15","Type":"ContainerDied","Data":"c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa"}
Sep 11 19:34:24.529678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.529568    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4b48bd9b-slp8d"
Sep 11 19:34:24.529678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.529592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4b48bd9b-slp8d" event={"ID":"23699064-e254-46a4-ae6d-44fd00abcc15","Type":"ContainerDied","Data":"c5c428e9f309466fb50a4970a5afca06255aefe2c2f4a6cea7348fdf7051c9a9"}
Sep 11 19:34:24.529678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.529612    2576 scope.go:117] "RemoveContainer" containerID="c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa"
Sep 11 19:34:24.538699 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.538537    2576 scope.go:117] "RemoveContainer" containerID="c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa"
Sep 11 19:34:24.538914 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:34:24.538778    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa\": container with ID starting with c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa not found: ID does not exist" containerID="c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa"
Sep 11 19:34:24.538914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.538804    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa"} err="failed to get container status \"c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa\": rpc error: code = NotFound desc = could not find container \"c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa\": container with ID starting with c1f806665dc8034b38ee63bd698df7b05921bb991bcadae2adf37a6c97aaa8fa not found: ID does not exist"
Sep 11 19:34:24.554229 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.554203    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4b48bd9b-slp8d"]
Sep 11 19:34:24.558811 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.558793    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c4b48bd9b-slp8d"]
Sep 11 19:34:24.725703 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:24.725679    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23699064-e254-46a4-ae6d-44fd00abcc15" path="/var/lib/kubelet/pods/23699064-e254-46a4-ae6d-44fd00abcc15/volumes"
Sep 11 19:34:35.419166 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:35.419124    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:34:35.513302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:34:35.513258    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:04.234452 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:04.234411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:05.585427 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:05.585389    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:07.831020 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:07.830961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:07.932086 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:07.932050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:09.561351 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.561317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:09.651539 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.651506    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:09.771911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.771886    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-798q6"]
Sep 11 19:35:09.772218 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.772204    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23699064-e254-46a4-ae6d-44fd00abcc15" containerName="console"
Sep 11 19:35:09.772274 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.772219    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="23699064-e254-46a4-ae6d-44fd00abcc15" containerName="console"
Sep 11 19:35:09.772313 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.772275    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="23699064-e254-46a4-ae6d-44fd00abcc15" containerName="console"
Sep 11 19:35:09.775253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.775237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:09.778815 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.778772    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 19:35:09.779149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.779127    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 19:35:09.779149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.779138    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7wl7q\""
Sep 11 19:35:09.791129 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.791108    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-798q6"]
Sep 11 19:35:09.814964 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.814916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b76d96-47fe-49ae-aa1d-c6604deb9ca5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-798q6\" (UID: \"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:09.814964 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.814958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstdf\" (UniqueName: \"kubernetes.io/projected/c0b76d96-47fe-49ae-aa1d-c6604deb9ca5-kube-api-access-jstdf\") pod \"cert-manager-webhook-6486ffd997-798q6\" (UID: \"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:09.915304 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.915279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstdf\" (UniqueName: \"kubernetes.io/projected/c0b76d96-47fe-49ae-aa1d-c6604deb9ca5-kube-api-access-jstdf\") pod \"cert-manager-webhook-6486ffd997-798q6\" (UID: \"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:09.915392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.915338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b76d96-47fe-49ae-aa1d-c6604deb9ca5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-798q6\" (UID: \"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:09.931371 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.931348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0b76d96-47fe-49ae-aa1d-c6604deb9ca5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-798q6\" (UID: \"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:09.932343 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:09.932314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstdf\" (UniqueName: \"kubernetes.io/projected/c0b76d96-47fe-49ae-aa1d-c6604deb9ca5-kube-api-access-jstdf\") pod \"cert-manager-webhook-6486ffd997-798q6\" (UID: \"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:10.093861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:10.093799    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:10.368181 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:10.368112    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-798q6"]
Sep 11 19:35:10.371561 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:35:10.371534    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0b76d96_47fe_49ae_aa1d_c6604deb9ca5.slice/crio-ee02f4758731abe821749ac1fc7bf02d3b7496818dfff29acfd5776bc23b0e8f WatchSource:0}: Error finding container ee02f4758731abe821749ac1fc7bf02d3b7496818dfff29acfd5776bc23b0e8f: Status 404 returned error can't find the container with id ee02f4758731abe821749ac1fc7bf02d3b7496818dfff29acfd5776bc23b0e8f
Sep 11 19:35:10.725871 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:10.725839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-798q6" event={"ID":"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5","Type":"ContainerStarted","Data":"ee02f4758731abe821749ac1fc7bf02d3b7496818dfff29acfd5776bc23b0e8f"}
Sep 11 19:35:11.715728 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:11.715691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:12.124696 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:12.124657    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:13.735864 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:13.735831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-798q6" event={"ID":"c0b76d96-47fe-49ae-aa1d-c6604deb9ca5","Type":"ContainerStarted","Data":"3b9d121e6701736f4157c25f6eaf6c50cd5d2913cb6758bd97500f6409fa174d"}
Sep 11 19:35:13.736261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:13.735980    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:13.752351 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:13.752303    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-798q6" podStartSLOduration=1.843167532 podStartE2EDuration="4.752288958s" totalImagesPullingTime="2.909121426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:13.751433887 +0000 UTC m=+523.500689462" watchObservedRunningTime="2026-09-11 19:35:13.752288958 +0000 UTC m=+523.501544533"
Sep 11 19:35:14.636772 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:14.636744    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:14.737783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:14.737750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:19.523272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:19.523238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:19.741707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:19.741677    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-798q6"
Sep 11 19:35:22.912472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:22.912368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:23.024562 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:23.024520    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:29.521052 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:29.521009    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:29.622057 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:29.622013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:29.848333 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:29.848262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:31.259371 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:31.259338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:32.746700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:32.746663    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:32.846935 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:32.846906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:40.761503 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:40.761464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:43.257827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:43.257797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:43.340805 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:43.340773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:43.892969 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:43.892940    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.179831 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.179753    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.300690 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.300652    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.357421 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.357390    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"]
Sep 11 19:35:44.363704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.363678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.370385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.370358    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 19:35:44.370385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.370374    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 19:35:44.370555 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.370405    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 19:35:44.370721 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.370707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2rjxh\""
Sep 11 19:35:44.370775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.370760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 19:35:44.377030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.377006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"]
Sep 11 19:35:44.471149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.471124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-tmp\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.471307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.471162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.471307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.471186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.471307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.471236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-manifests\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.471307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.471281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrdg\" (UniqueName: \"kubernetes.io/projected/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-kube-api-access-brrdg\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.546858 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.546822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.571863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.571835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrdg\" (UniqueName: \"kubernetes.io/projected/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-kube-api-access-brrdg\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.571977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.571881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-tmp\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.571977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.571901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.571977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.571927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.571977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.571954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-manifests\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.572401 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.572379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-manifests\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.574403 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.574378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-tmp\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.574578 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.574547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.574693 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.574655    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.581199 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.581177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrdg\" (UniqueName: \"kubernetes.io/projected/3ae6b7fa-202e-48ef-83f6-8687a1817ee9-kube-api-access-brrdg\") pod \"opendatahub-operator-controller-manager-7c47b89ccd-wr2jz\" (UID: \"3ae6b7fa-202e-48ef-83f6-8687a1817ee9\") " pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.651980 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.651941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.679606 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.679575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:44.756017 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.755941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.846507 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.846468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.937829 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.937794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:44.960289 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:44.960266    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"]
Sep 11 19:35:44.963399 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:35:44.963371    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae6b7fa_202e_48ef_83f6_8687a1817ee9.slice/crio-e30eea41b5e2a79ced39fcdc9733fd765b40450a1f0efa18fe67e0c732a1dc00 WatchSource:0}: Error finding container e30eea41b5e2a79ced39fcdc9733fd765b40450a1f0efa18fe67e0c732a1dc00: Status 404 returned error can't find the container with id e30eea41b5e2a79ced39fcdc9733fd765b40450a1f0efa18fe67e0c732a1dc00
Sep 11 19:35:45.009259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:45.009170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:45.514704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:45.514659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:45.665395 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:45.665359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:45.860168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:45.860081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz" event={"ID":"3ae6b7fa-202e-48ef-83f6-8687a1817ee9","Type":"ContainerStarted","Data":"e30eea41b5e2a79ced39fcdc9733fd765b40450a1f0efa18fe67e0c732a1dc00"}
Sep 11 19:35:48.875356 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:48.875324    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz" event={"ID":"3ae6b7fa-202e-48ef-83f6-8687a1817ee9","Type":"ContainerStarted","Data":"35eedcbbdc37d28192bb1085ca8f35f124bdad71b340d9afa8e1ab67465a38b7"}
Sep 11 19:35:49.881704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:49.881668    2576 generic.go:356] "Generic (PLEG): container finished" podID="3ae6b7fa-202e-48ef-83f6-8687a1817ee9" containerID="35eedcbbdc37d28192bb1085ca8f35f124bdad71b340d9afa8e1ab67465a38b7" exitCode=0
Sep 11 19:35:49.882157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:49.881760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz" event={"ID":"3ae6b7fa-202e-48ef-83f6-8687a1817ee9","Type":"ContainerDied","Data":"35eedcbbdc37d28192bb1085ca8f35f124bdad71b340d9afa8e1ab67465a38b7"}
Sep 11 19:35:50.320110 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:50.320075    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:35:50.888200 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:50.888121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz" event={"ID":"3ae6b7fa-202e-48ef-83f6-8687a1817ee9","Type":"ContainerStarted","Data":"ea751f1cd917f338ac6b5e2db90104a9384785745d10415fda982a6c105087e0"}
Sep 11 19:35:50.888552 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:50.888249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:35:50.911623 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:35:50.911571    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz" podStartSLOduration=2.138903462 podStartE2EDuration="6.911552015s" totalImagesPullingTime="3.682069543s" totalInitContainerRuntime="1.09057901s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:50.911248341 +0000 UTC m=+560.660503980" watchObservedRunningTime="2026-09-11 19:35:50.911552015 +0000 UTC m=+560.660807589"
Sep 11 19:36:01.894670 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:01.894640    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c47b89ccd-wr2jz"
Sep 11 19:36:03.462905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:03.462870    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:03.587345 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:03.587312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:03.824659 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:03.824634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:03.927769 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:03.927739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:09.024838 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.024804    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"]
Sep 11 19:36:09.028065 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.028049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.030726 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.030708    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 19:36:09.030813 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.030707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 19:36:09.038821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.038798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"]
Sep 11 19:36:09.044453 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.044422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:09.066009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.065962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33dabe4-9726-4c62-a2f7-ebade984e79d-tmp\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.066134 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.066033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33dabe4-9726-4c62-a2f7-ebade984e79d-tls-certs\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.066134 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.066061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r255n\" (UniqueName: \"kubernetes.io/projected/b33dabe4-9726-4c62-a2f7-ebade984e79d-kube-api-access-r255n\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.167414 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.167390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33dabe4-9726-4c62-a2f7-ebade984e79d-tls-certs\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.167543 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.167427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r255n\" (UniqueName: \"kubernetes.io/projected/b33dabe4-9726-4c62-a2f7-ebade984e79d-kube-api-access-r255n\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.167543 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:36:09.167529    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 11 19:36:09.167631 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.167556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33dabe4-9726-4c62-a2f7-ebade984e79d-tmp\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.167631 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:36:09.167583    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33dabe4-9726-4c62-a2f7-ebade984e79d-tls-certs podName:b33dabe4-9726-4c62-a2f7-ebade984e79d nodeName:}" failed. No retries permitted until 2026-09-11 19:36:09.667568588 +0000 UTC m=+579.416824140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b33dabe4-9726-4c62-a2f7-ebade984e79d-tls-certs") pod "kube-auth-proxy-596df76fbd-8qmvg" (UID: "b33dabe4-9726-4c62-a2f7-ebade984e79d") : secret "kube-auth-proxy-tls" not found
Sep 11 19:36:09.169953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.169929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33dabe4-9726-4c62-a2f7-ebade984e79d-tmp\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.177865 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.177846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r255n\" (UniqueName: \"kubernetes.io/projected/b33dabe4-9726-4c62-a2f7-ebade984e79d-kube-api-access-r255n\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.334636 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.334547    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:09.670782 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.670704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33dabe4-9726-4c62-a2f7-ebade984e79d-tls-certs\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.673360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.673328    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33dabe4-9726-4c62-a2f7-ebade984e79d-tls-certs\") pod \"kube-auth-proxy-596df76fbd-8qmvg\" (UID: \"b33dabe4-9726-4c62-a2f7-ebade984e79d\") " pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:09.938278 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:09.938199    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"
Sep 11 19:36:10.174098 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:10.174068    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:10.211362 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:10.211340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg"]
Sep 11 19:36:10.213841 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:36:10.213815    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33dabe4_9726_4c62_a2f7_ebade984e79d.slice/crio-a2f7bfdf817cef31cbec3018efe80a0fcc5d011ec52ac651bb5862d465af3fe5 WatchSource:0}: Error finding container a2f7bfdf817cef31cbec3018efe80a0fcc5d011ec52ac651bb5862d465af3fe5: Status 404 returned error can't find the container with id a2f7bfdf817cef31cbec3018efe80a0fcc5d011ec52ac651bb5862d465af3fe5
Sep 11 19:36:10.256625 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:10.256591    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:10.978849 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:10.978774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg" event={"ID":"b33dabe4-9726-4c62-a2f7-ebade984e79d","Type":"ContainerStarted","Data":"a2f7bfdf817cef31cbec3018efe80a0fcc5d011ec52ac651bb5862d465af3fe5"}
Sep 11 19:36:11.277799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:11.277654    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:13.996194 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:13.996157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg" event={"ID":"b33dabe4-9726-4c62-a2f7-ebade984e79d","Type":"ContainerStarted","Data":"3f9eeb8354073db69688e66d1d683c8382a8ce64c5d8a833a0d7ae5b5152efbf"}
Sep 11 19:36:14.014953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.014902    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-596df76fbd-8qmvg" podStartSLOduration=3.143551742 podStartE2EDuration="6.014886451s" totalImagesPullingTime="2.871334709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:14.013124584 +0000 UTC m=+583.762380178" watchObservedRunningTime="2026-09-11 19:36:14.014886451 +0000 UTC m=+583.764142025"
Sep 11 19:36:14.654261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.654226    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kf2t8"]
Sep 11 19:36:14.658211 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.658191    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:14.660585 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.660560    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 19:36:14.660704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.660610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rdq9p\""
Sep 11 19:36:14.667749 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.667726    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kf2t8"]
Sep 11 19:36:14.674357 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.674327    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:14.716857 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.716827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v4jh\" (UniqueName: \"kubernetes.io/projected/95f33bbc-f145-48f2-b21a-77f0f8c09632-kube-api-access-9v4jh\") pod \"odh-model-controller-7998c67dc4-kf2t8\" (UID: \"95f33bbc-f145-48f2-b21a-77f0f8c09632\") " pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:14.716980 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.716865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95f33bbc-f145-48f2-b21a-77f0f8c09632-cert\") pod \"odh-model-controller-7998c67dc4-kf2t8\" (UID: \"95f33bbc-f145-48f2-b21a-77f0f8c09632\") " pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:14.733748 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.733717    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:14.818163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.818127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v4jh\" (UniqueName: \"kubernetes.io/projected/95f33bbc-f145-48f2-b21a-77f0f8c09632-kube-api-access-9v4jh\") pod \"odh-model-controller-7998c67dc4-kf2t8\" (UID: \"95f33bbc-f145-48f2-b21a-77f0f8c09632\") " pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:14.818329 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.818180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95f33bbc-f145-48f2-b21a-77f0f8c09632-cert\") pod \"odh-model-controller-7998c67dc4-kf2t8\" (UID: \"95f33bbc-f145-48f2-b21a-77f0f8c09632\") " pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:14.820686 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.820660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95f33bbc-f145-48f2-b21a-77f0f8c09632-cert\") pod \"odh-model-controller-7998c67dc4-kf2t8\" (UID: \"95f33bbc-f145-48f2-b21a-77f0f8c09632\") " pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:14.825751 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.825721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v4jh\" (UniqueName: \"kubernetes.io/projected/95f33bbc-f145-48f2-b21a-77f0f8c09632-kube-api-access-9v4jh\") pod \"odh-model-controller-7998c67dc4-kf2t8\" (UID: \"95f33bbc-f145-48f2-b21a-77f0f8c09632\") " pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:14.832300 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.832263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:14.934515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.934446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:14.971446 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:14.971423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:15.161668 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.161635    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:15.177329 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.177302    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7dsv5"]
Sep 11 19:36:15.180860 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.180839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.183430 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.183409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 19:36:15.183615 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.183596    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jc4qx\""
Sep 11 19:36:15.192095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.192071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7dsv5"]
Sep 11 19:36:15.221943 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.221915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rcx\" (UniqueName: \"kubernetes.io/projected/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-kube-api-access-f4rcx\") pod \"model-serving-api-54d89bd5fc-7dsv5\" (UID: \"cfb4a10d-ef07-4ce5-bfad-6731cda6347e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.222104 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.221957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7dsv5\" (UID: \"cfb4a10d-ef07-4ce5-bfad-6731cda6347e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.244402 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.244381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kf2t8"]
Sep 11 19:36:15.246851 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:36:15.246828    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f33bbc_f145_48f2_b21a_77f0f8c09632.slice/crio-25175b6dd71a10ee105dd15ca1f9df18866198cfb7e1db4f78c877cdebab02ca WatchSource:0}: Error finding container 25175b6dd71a10ee105dd15ca1f9df18866198cfb7e1db4f78c877cdebab02ca: Status 404 returned error can't find the container with id 25175b6dd71a10ee105dd15ca1f9df18866198cfb7e1db4f78c877cdebab02ca
Sep 11 19:36:15.265277 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.265250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:15.323013 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.322954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rcx\" (UniqueName: \"kubernetes.io/projected/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-kube-api-access-f4rcx\") pod \"model-serving-api-54d89bd5fc-7dsv5\" (UID: \"cfb4a10d-ef07-4ce5-bfad-6731cda6347e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.323156 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.323046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7dsv5\" (UID: \"cfb4a10d-ef07-4ce5-bfad-6731cda6347e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.323223 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:36:15.323153    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 11 19:36:15.323223 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:36:15.323221    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-tls-certs podName:cfb4a10d-ef07-4ce5-bfad-6731cda6347e nodeName:}" failed. No retries permitted until 2026-09-11 19:36:15.823200353 +0000 UTC m=+585.572455907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-tls-certs") pod "model-serving-api-54d89bd5fc-7dsv5" (UID: "cfb4a10d-ef07-4ce5-bfad-6731cda6347e") : secret "model-serving-api-tls" not found
Sep 11 19:36:15.331458 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.331437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rcx\" (UniqueName: \"kubernetes.io/projected/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-kube-api-access-f4rcx\") pod \"model-serving-api-54d89bd5fc-7dsv5\" (UID: \"cfb4a10d-ef07-4ce5-bfad-6731cda6347e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.369651 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.369607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:15.465401 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.465320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:15.790059 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.790030    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"]
Sep 11 19:36:15.793591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.793567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.795914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.795891    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 19:36:15.796069 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.796042    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k5mwl\""
Sep 11 19:36:15.805611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.805589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"]
Sep 11 19:36:15.819386 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.819354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:15.826784 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.826748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.826905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.826803    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.826905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.826846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.826905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.826876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0ba881-b73e-4140-8996-05d519d7bd53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.827116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.826954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7dsv5\" (UID: \"cfb4a10d-ef07-4ce5-bfad-6731cda6347e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.827116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.827030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.827116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.827107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.827264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.827132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.827264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.827172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.827264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.827196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6n9h\" (UniqueName: \"kubernetes.io/projected/8a0ba881-b73e-4140-8996-05d519d7bd53-kube-api-access-t6n9h\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.829579 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.829551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb4a10d-ef07-4ce5-bfad-6731cda6347e-tls-certs\") pod \"model-serving-api-54d89bd5fc-7dsv5\" (UID: \"cfb4a10d-ef07-4ce5-bfad-6731cda6347e\") " pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:15.928198 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0ba881-b73e-4140-8996-05d519d7bd53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6n9h\" (UniqueName: \"kubernetes.io/projected/8a0ba881-b73e-4140-8996-05d519d7bd53-kube-api-access-t6n9h\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.928862 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.928797    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.929096 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.929072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.929650 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.929607    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.930229 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.930200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0ba881-b73e-4140-8996-05d519d7bd53-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.932021 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.931980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.932108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.932076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.941077 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.941050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0ba881-b73e-4140-8996-05d519d7bd53-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:15.941957 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:15.941934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6n9h\" (UniqueName: \"kubernetes.io/projected/8a0ba881-b73e-4140-8996-05d519d7bd53-kube-api-access-t6n9h\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c59pd7\" (UID: \"8a0ba881-b73e-4140-8996-05d519d7bd53\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:16.007532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:16.007490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8" event={"ID":"95f33bbc-f145-48f2-b21a-77f0f8c09632","Type":"ContainerStarted","Data":"25175b6dd71a10ee105dd15ca1f9df18866198cfb7e1db4f78c877cdebab02ca"}
Sep 11 19:36:16.090927 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:16.090832    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:16.093869 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:16.093825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:16.105267 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:16.105211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:16.402414 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:16.402382    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7dsv5"]
Sep 11 19:36:16.403368 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:16.403348    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"]
Sep 11 19:36:16.404825 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:36:16.404798    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb4a10d_ef07_4ce5_bfad_6731cda6347e.slice/crio-d8a531122f52533d4ed28a3adbe3c3466eb56f61536d65722e5d4a4bb43a7387 WatchSource:0}: Error finding container d8a531122f52533d4ed28a3adbe3c3466eb56f61536d65722e5d4a4bb43a7387: Status 404 returned error can't find the container with id d8a531122f52533d4ed28a3adbe3c3466eb56f61536d65722e5d4a4bb43a7387
Sep 11 19:36:16.408195 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:36:16.408155    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0ba881_b73e_4140_8996_05d519d7bd53.slice/crio-04a98cd331ec7084fa23f981dc46ea6ab476a237af02f010e5eab5e08b475ad9 WatchSource:0}: Error finding container 04a98cd331ec7084fa23f981dc46ea6ab476a237af02f010e5eab5e08b475ad9: Status 404 returned error can't find the container with id 04a98cd331ec7084fa23f981dc46ea6ab476a237af02f010e5eab5e08b475ad9
Sep 11 19:36:17.015806 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:17.015761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7" event={"ID":"8a0ba881-b73e-4140-8996-05d519d7bd53","Type":"ContainerStarted","Data":"04a98cd331ec7084fa23f981dc46ea6ab476a237af02f010e5eab5e08b475ad9"}
Sep 11 19:36:17.017359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:17.017321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5" event={"ID":"cfb4a10d-ef07-4ce5-bfad-6731cda6347e","Type":"ContainerStarted","Data":"d8a531122f52533d4ed28a3adbe3c3466eb56f61536d65722e5d4a4bb43a7387"}
Sep 11 19:36:17.218716 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:17.218676    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:19.030911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:19.030869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8" event={"ID":"95f33bbc-f145-48f2-b21a-77f0f8c09632","Type":"ContainerStarted","Data":"74ef11a2c34c5f32d12e7f31acc0479e268497d5c5f2b7a369d81bfe477f43fa"}
Sep 11 19:36:19.031350 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:19.031012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:19.048127 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:19.048067    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8" podStartSLOduration=2.084656126 podStartE2EDuration="5.048047063s" totalImagesPullingTime="2.963390937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:19.046867563 +0000 UTC m=+588.796123163" watchObservedRunningTime="2026-09-11 19:36:19.048047063 +0000 UTC m=+588.797302637"
Sep 11 19:36:20.220247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:20.219974    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:36:20.220247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:20.220099    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:36:20.220247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:20.220143    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:36:21.042431 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.042388    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7" event={"ID":"8a0ba881-b73e-4140-8996-05d519d7bd53","Type":"ContainerStarted","Data":"8bf9d60344da976bd616006fca31d147fd5b5267abe9b8b18e78596c0c306678"}
Sep 11 19:36:21.043928 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.043901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5" event={"ID":"cfb4a10d-ef07-4ce5-bfad-6731cda6347e","Type":"ContainerStarted","Data":"b13ebfc67b75af09ddd27f681f0021aeed8adba5d56febf66ed36d792092c500"}
Sep 11 19:36:21.044068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.044036    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:21.104549 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.104495    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7" podStartSLOduration=2.296063929 podStartE2EDuration="6.104478794s" totalImagesPullingTime="3.808414865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:21.101759495 +0000 UTC m=+590.851015078" watchObservedRunningTime="2026-09-11 19:36:21.104478794 +0000 UTC m=+590.853734368"
Sep 11 19:36:21.105516 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.105497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:21.110296 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.110273    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:21.135585 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.135544    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5" podStartSLOduration=2.32446954 podStartE2EDuration="6.135529969s" totalImagesPullingTime="3.811060429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:21.133220685 +0000 UTC m=+590.882476279" watchObservedRunningTime="2026-09-11 19:36:21.135529969 +0000 UTC m=+590.884785543"
Sep 11 19:36:21.650409 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.650376    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"]
Sep 11 19:36:21.653911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.653893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.656345 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.656323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 19:36:21.656345 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.656333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 19:36:21.656600 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.656569    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 19:36:21.656711 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.656612    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dmm5l\""
Sep 11 19:36:21.665311 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.665288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"]
Sep 11 19:36:21.783544 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.783509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.783544 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.783540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.783721 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.783618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.783800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.783779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.783842 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.783834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.783889 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.783853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.784063 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.784045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9758\" (UniqueName: \"kubernetes.io/projected/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-kube-api-access-r9758\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.787951 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.787932    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"]
Sep 11 19:36:21.790926 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.790912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.793689 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.793654    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 19:36:21.793689 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.793663    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 19:36:21.793870 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.793700    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ndnhc\""
Sep 11 19:36:21.793870 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.793726    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 19:36:21.793870 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.793655    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:36:21.793870 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.793809    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 19:36:21.799554 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.799534    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"]
Sep 11 19:36:21.884713 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.884818 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.884818 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.884818 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.884818 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-manager-config\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.884982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-metrics-cert\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.884982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.884982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv8pj\" (UniqueName: \"kubernetes.io/projected/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-kube-api-access-qv8pj\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.884982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.884982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.884974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-cert\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.885252 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.885052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9758\" (UniqueName: \"kubernetes.io/projected/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-kube-api-access-r9758\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.885872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.885847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.887217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.887191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.887334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.887317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.887425 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.887406    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.887491 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.887472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.899097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.899070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9758\" (UniqueName: \"kubernetes.io/projected/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-kube-api-access-r9758\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.899174 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.899149    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a1b97a-12b5-4504-b8dd-3adf01a14f6f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kxdp5\" (UID: \"06a1b97a-12b5-4504-b8dd-3adf01a14f6f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.962976 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.962921    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:21.986503 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.986472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-manager-config\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.986623 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.986529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-metrics-cert\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.986623 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.986568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv8pj\" (UniqueName: \"kubernetes.io/projected/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-kube-api-access-qv8pj\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.986623 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.986604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-cert\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.987259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.987230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-manager-config\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.989624 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.989600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-metrics-cert\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:21.989776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:21.989755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-cert\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:22.000250 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:22.000226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv8pj\" (UniqueName: \"kubernetes.io/projected/7fade6e9-b798-4b84-8a2a-d47a0cebcbd3-kube-api-access-qv8pj\") pod \"lws-controller-manager-6d6bf85947-gpfbd\" (UID: \"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3\") " pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:22.049755 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:22.049716    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:22.050370 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:22.050351    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c59pd7"
Sep 11 19:36:22.100793 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:22.100760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:22.253446 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:22.253421    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"]
Sep 11 19:36:22.255353 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:36:22.255329    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a1b97a_12b5_4504_b8dd_3adf01a14f6f.slice/crio-da10a76621c1ce5a2011b1363f7cca6a98594c8e3d8690eb57919cd59ab2462d WatchSource:0}: Error finding container da10a76621c1ce5a2011b1363f7cca6a98594c8e3d8690eb57919cd59ab2462d: Status 404 returned error can't find the container with id da10a76621c1ce5a2011b1363f7cca6a98594c8e3d8690eb57919cd59ab2462d
Sep 11 19:36:22.376338 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:22.376317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"]
Sep 11 19:36:22.378626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:36:22.378590    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fade6e9_b798_4b84_8a2a_d47a0cebcbd3.slice/crio-367cdf636b829a8933db2e971773f2566f69b097d3a3de3284d5c58ad84823fd WatchSource:0}: Error finding container 367cdf636b829a8933db2e971773f2566f69b097d3a3de3284d5c58ad84823fd: Status 404 returned error can't find the container with id 367cdf636b829a8933db2e971773f2566f69b097d3a3de3284d5c58ad84823fd
Sep 11 19:36:23.056414 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:23.056376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd" event={"ID":"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3","Type":"ContainerStarted","Data":"367cdf636b829a8933db2e971773f2566f69b097d3a3de3284d5c58ad84823fd"}
Sep 11 19:36:23.057959 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:23.057914    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5" event={"ID":"06a1b97a-12b5-4504-b8dd-3adf01a14f6f","Type":"ContainerStarted","Data":"da10a76621c1ce5a2011b1363f7cca6a98594c8e3d8690eb57919cd59ab2462d"}
Sep 11 19:36:24.063406 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:24.063202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:24.162439 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:24.162382    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:24.351942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:24.351838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:24.506859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:24.506818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:24.883540 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:24.883504    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:36:24.883610 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:24.883574    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:36:25.072652 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.072620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5" event={"ID":"06a1b97a-12b5-4504-b8dd-3adf01a14f6f","Type":"ContainerStarted","Data":"99d7f1dacb522bfd26ca0ea00182f54150c3cf743d9b95f1dc7eca0a1e8cf4eb"}
Sep 11 19:36:25.073040 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.072809    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:25.074278 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.074243    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-kxdp5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:36:25.074395 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.074306    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5" podUID="06a1b97a-12b5-4504-b8dd-3adf01a14f6f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:36:25.116972 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.116926    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5" podStartSLOduration=1.494071571 podStartE2EDuration="4.116912347s" totalImagesPullingTime="2.622840776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:25.116058127 +0000 UTC m=+594.865313721" watchObservedRunningTime="2026-09-11 19:36:25.116912347 +0000 UTC m=+594.866167920"
Sep 11 19:36:25.339812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.339773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:25.461106 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.461069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:25.568615 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:25.568576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:26.086006 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:26.081559    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kxdp5"
Sep 11 19:36:27.086886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:27.086851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd" event={"ID":"7fade6e9-b798-4b84-8a2a-d47a0cebcbd3","Type":"ContainerStarted","Data":"c0d0e2e8c1bb6c3f51a5800e45259c2810400c5002daa9d33ae53674ca8bfeaf"}
Sep 11 19:36:27.105515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:27.105463    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd" podStartSLOduration=1.590042604 podStartE2EDuration="6.105443096s" totalImagesPullingTime="4.515400492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:27.105049033 +0000 UTC m=+596.854304635" watchObservedRunningTime="2026-09-11 19:36:27.105443096 +0000 UTC m=+596.854698670"
Sep 11 19:36:28.092131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:28.092101    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:30.038962 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:30.038931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kf2t8"
Sep 11 19:36:30.668723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:30.668698    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:36:30.669428 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:30.669408    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:36:30.675667 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:30.675650    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:36:30.676233 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:30.676215    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:36:32.053662 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:32.053630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7dsv5"
Sep 11 19:36:39.099482 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:39.099454    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d6bf85947-gpfbd"
Sep 11 19:36:41.531805 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:41.531773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:41.612417 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:41.612386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:52.705359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:52.705282    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544bf87dc8-6j4nd"]
Sep 11 19:36:52.838522 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:52.838474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:52.895375 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:52.895349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:52.950236 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:52.950209    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:54.524738 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:54.524696    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:36:54.595413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:36:54.595380    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:08.609723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:08.609684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:08.710334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:08.710295    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:10.460602 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:10.460575    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:10.560880 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:10.560848    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:15.530011 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:15.529944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:15.621900 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:15.621862    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:17.725726 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:17.725689    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-544bf87dc8-6j4nd" podUID="3440aa37-64fc-4df2-a28d-a8712a1fde47" containerName="console" containerID="cri-o://c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2" gracePeriod=15
Sep 11 19:37:17.966977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:17.966955    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:37:18.038188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038133    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-trusted-ca-bundle\") pod \"3440aa37-64fc-4df2-a28d-a8712a1fde47\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") "
Sep 11 19:37:18.038188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-oauth-config\") pod \"3440aa37-64fc-4df2-a28d-a8712a1fde47\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") "
Sep 11 19:37:18.038347 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038206    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-config\") pod \"3440aa37-64fc-4df2-a28d-a8712a1fde47\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") "
Sep 11 19:37:18.038347 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038222    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppzh8\" (UniqueName: \"kubernetes.io/projected/3440aa37-64fc-4df2-a28d-a8712a1fde47-kube-api-access-ppzh8\") pod \"3440aa37-64fc-4df2-a28d-a8712a1fde47\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") "
Sep 11 19:37:18.038347 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038270    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-service-ca\") pod \"3440aa37-64fc-4df2-a28d-a8712a1fde47\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") "
Sep 11 19:37:18.038347 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038287    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-oauth-serving-cert\") pod \"3440aa37-64fc-4df2-a28d-a8712a1fde47\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") "
Sep 11 19:37:18.038549 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038403    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-serving-cert\") pod \"3440aa37-64fc-4df2-a28d-a8712a1fde47\" (UID: \"3440aa37-64fc-4df2-a28d-a8712a1fde47\") "
Sep 11 19:37:18.038651 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3440aa37-64fc-4df2-a28d-a8712a1fde47" (UID: "3440aa37-64fc-4df2-a28d-a8712a1fde47"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:18.038757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3440aa37-64fc-4df2-a28d-a8712a1fde47" (UID: "3440aa37-64fc-4df2-a28d-a8712a1fde47"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:18.038757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038676    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-trusted-ca-bundle\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:37:18.038757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038691    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-service-ca" (OuterVolumeSpecName: "service-ca") pod "3440aa37-64fc-4df2-a28d-a8712a1fde47" (UID: "3440aa37-64fc-4df2-a28d-a8712a1fde47"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:18.038757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.038697    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-config" (OuterVolumeSpecName: "console-config") pod "3440aa37-64fc-4df2-a28d-a8712a1fde47" (UID: "3440aa37-64fc-4df2-a28d-a8712a1fde47"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:18.040612 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.040579    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3440aa37-64fc-4df2-a28d-a8712a1fde47" (UID: "3440aa37-64fc-4df2-a28d-a8712a1fde47"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:37:18.040710 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.040627    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3440aa37-64fc-4df2-a28d-a8712a1fde47-kube-api-access-ppzh8" (OuterVolumeSpecName: "kube-api-access-ppzh8") pod "3440aa37-64fc-4df2-a28d-a8712a1fde47" (UID: "3440aa37-64fc-4df2-a28d-a8712a1fde47"). InnerVolumeSpecName "kube-api-access-ppzh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:37:18.040710 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.040702    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3440aa37-64fc-4df2-a28d-a8712a1fde47" (UID: "3440aa37-64fc-4df2-a28d-a8712a1fde47"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:37:18.139060 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.139037    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:37:18.139060 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.139058    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-oauth-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:37:18.139189 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.139069    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-serving-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:37:18.139189 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.139077    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-oauth-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:37:18.139189 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.139085    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3440aa37-64fc-4df2-a28d-a8712a1fde47-console-config\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:37:18.139189 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.139092    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppzh8\" (UniqueName: \"kubernetes.io/projected/3440aa37-64fc-4df2-a28d-a8712a1fde47-kube-api-access-ppzh8\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:37:18.340720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.340655    2576 generic.go:356] "Generic (PLEG): container finished" podID="3440aa37-64fc-4df2-a28d-a8712a1fde47" containerID="c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2" exitCode=0
Sep 11 19:37:18.340720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.340714    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bf87dc8-6j4nd"
Sep 11 19:37:18.340855 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.340713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bf87dc8-6j4nd" event={"ID":"3440aa37-64fc-4df2-a28d-a8712a1fde47","Type":"ContainerDied","Data":"c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2"}
Sep 11 19:37:18.340855 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.340840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bf87dc8-6j4nd" event={"ID":"3440aa37-64fc-4df2-a28d-a8712a1fde47","Type":"ContainerDied","Data":"06f2f662d4359a9cafdb3fa3b880d808be615d6c368ba5a6995fce0332790776"}
Sep 11 19:37:18.340920 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.340869    2576 scope.go:117] "RemoveContainer" containerID="c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2"
Sep 11 19:37:18.357522 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.357501    2576 scope.go:117] "RemoveContainer" containerID="c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2"
Sep 11 19:37:18.357835 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:37:18.357815    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2\": container with ID starting with c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2 not found: ID does not exist" containerID="c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2"
Sep 11 19:37:18.357886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.357843    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2"} err="failed to get container status \"c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2\": rpc error: code = NotFound desc = could not find container \"c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2\": container with ID starting with c58dd946cd434951eb06fb7461e4449eaa56b393f131d9eaf2b8fc5c58b4fca2 not found: ID does not exist"
Sep 11 19:37:18.366549 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.366526    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544bf87dc8-6j4nd"]
Sep 11 19:37:18.373097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.373075    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-544bf87dc8-6j4nd"]
Sep 11 19:37:18.725712 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:18.725682    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3440aa37-64fc-4df2-a28d-a8712a1fde47" path="/var/lib/kubelet/pods/3440aa37-64fc-4df2-a28d-a8712a1fde47/volumes"
Sep 11 19:37:29.477311 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:29.477273    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:30.287077 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:30.287032    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:33.296538 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:33.296498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:33.512634 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:33.512597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:33.738506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:33.738475    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:34.273231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:34.273200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:35.926360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:35.926328    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:36.039504 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:36.039473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:37.634181 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:37.634142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:37.728705 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:37.728679    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:38.738883 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:38.738844    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:39.909485 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:39.909449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:41.323344 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:41.323311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:42.887680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:42.887636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:42.988395 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:42.988368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:43.268751 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:43.268711    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:43.330096 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:43.330059    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:48.676708 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:48.676669    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:48.777219 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:48.777190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:49.531137 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:49.531097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:49.632855 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:49.632828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:49.730518 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:49.730461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:49.834495 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:49.834424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:52.939823 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:52.939756    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:53.354097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:53.354058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:54.919528 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:54.919493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:55.021447 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:55.021421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:57.358317 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:57.358286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:37:57.458492 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:37:57.458457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:03.017673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:03.017637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:03.136569 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:03.136539    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:03.567635 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:03.567607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:03.674085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:03.674048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:05.524058 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:05.524019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:05.629853 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:05.629813    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:08.124453 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:08.124402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:08.177729 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:08.177693    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:08.524067 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:08.524033    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:08.624140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:08.624109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:08.929957 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:08.929874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:09.117786 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:09.117743    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:14.833307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:14.833277    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:14.938237 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:14.938206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:17.358027 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:17.357972    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:17.465188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:17.465146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:25.321214 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:25.321133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:32.486080 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:32.486040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:32.792581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:32.792507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:46.349318 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:46.349281    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:46.464091 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:46.464062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:46.523448 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:46.523414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:47.262137 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:47.262097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:38:47.332771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:38:47.332743    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:03.906753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:03.906705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:04.002704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:04.002656    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:04.384641 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:04.384607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:48.496314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:48.496276    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:48.566245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:48.566210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:49.092099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:49.092050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:49.688520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:49.688489    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:49.791858 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:49.791816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:50.298880 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:50.298849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:39:50.398568 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:39:50.398534    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:01.351707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:01.351625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:01.648615 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:01.648528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:18.621234 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:18.621195    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:18.719306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:18.719253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:18.795611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:18.795571    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:18.964904 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:18.964805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:22.011803 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:22.011762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:22.110665 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:22.110631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:22.322014 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:22.321897    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:22.416769 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:22.416733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:25.246246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:25.246188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:25.308549 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:25.308508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:56.073840 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:56.073802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:57.618153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:57.618116    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:57.995440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:57.995403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:58.236467 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:58.236431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:40:58.328635 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:40:58.328552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:41:08.350913 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:08.350868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:41:08.436218 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:08.436161    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:41:27.656761 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:27.656684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:41:30.697590 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:30.697560    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:41:30.700743 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:30.700721    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:41:30.703703 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:30.703685    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:41:30.706715 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:30.706699    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:41:43.908037 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:43.907978    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:41:50.794775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:50.794705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:41:54.153085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:54.153045    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:41:56.990765 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:41:56.990728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:42:11.883353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:42:11.883312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:42:25.096194 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:42:25.096158    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:42:29.669127 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:42:29.669094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:43:28.448354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:43:28.448310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:43:28.517077 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:43:28.517037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:05.683184 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:05.683138    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:05.749093 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:05.749058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:28.800239 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:28.800133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:30.785554 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:30.785519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:30.886130 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:30.886097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:31.860394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:31.860351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:31.954401 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:31.954369    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:47.265440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.265397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:47.362764 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.362730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:47.590328 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.590230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:47.637752 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.637719    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"]
Sep 11 19:44:47.638141 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.638127    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3440aa37-64fc-4df2-a28d-a8712a1fde47" containerName="console"
Sep 11 19:44:47.638195 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.638143    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3440aa37-64fc-4df2-a28d-a8712a1fde47" containerName="console"
Sep 11 19:44:47.638271 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.638255    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3440aa37-64fc-4df2-a28d-a8712a1fde47" containerName="console"
Sep 11 19:44:47.641326 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.641302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.646510 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.646489    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c7766c-openshift-default-dockercfg-sl2kb\""
Sep 11 19:44:47.663044 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.663022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"]
Sep 11 19:44:47.701561 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.701519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:47.730732 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.730704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-istio-token\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.730859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.730749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-envoy\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.730859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.730788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-data\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.730859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.730833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx5jx\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-kube-api-access-gx5jx\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.731077 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.730894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-certs\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.731077 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.730956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafdff16-c931-4653-b1e1-03b48f75175a-istio-podinfo\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.731077 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.731049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafdff16-c931-4653-b1e1-03b48f75175a-istiod-ca-cert\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.731248 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.731103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-credential-socket\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.731248 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.731143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-socket\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.813350 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.813245    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:47.832215 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-certs\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafdff16-c931-4653-b1e1-03b48f75175a-istio-podinfo\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafdff16-c931-4653-b1e1-03b48f75175a-istiod-ca-cert\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-credential-socket\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-socket\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-istio-token\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832641 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-envoy\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832641 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-data\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832641 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5jx\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-kube-api-access-gx5jx\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832641 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-certs\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.832971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.832947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-credential-socket\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.833051 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.833027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-socket\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.833150 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.833130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-data\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.833413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.833389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafdff16-c931-4653-b1e1-03b48f75175a-istiod-ca-cert\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.835871 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.835845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-envoy\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.836295 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.836252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafdff16-c931-4653-b1e1-03b48f75175a-istio-podinfo\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.842129 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.842072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-istio-token\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.842931 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.842914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5jx\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-kube-api-access-gx5jx\") pod \"e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") " pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:47.911158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.911127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:47.952670 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:47.952642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:48.020087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.020036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:48.150747 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.150672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:48.232766 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.232745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"]
Sep 11 19:44:48.235526 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:44:48.235500    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafdff16_c931_4653_b1e1_03b48f75175a.slice/crio-929102c583ab0548e86c49797fe256f597d78f3e3394e75a60ee4b8753466621 WatchSource:0}: Error finding container 929102c583ab0548e86c49797fe256f597d78f3e3394e75a60ee4b8753466621: Status 404 returned error can't find the container with id 929102c583ab0548e86c49797fe256f597d78f3e3394e75a60ee4b8753466621
Sep 11 19:44:48.237887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.237850    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:48.238003 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.237914    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:48.238003 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.237951    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:48.467831 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.467793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" event={"ID":"fafdff16-c931-4653-b1e1-03b48f75175a","Type":"ContainerStarted","Data":"e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de"}
Sep 11 19:44:48.468217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.467857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" event={"ID":"fafdff16-c931-4653-b1e1-03b48f75175a","Type":"ContainerStarted","Data":"929102c583ab0548e86c49797fe256f597d78f3e3394e75a60ee4b8753466621"}
Sep 11 19:44:48.493836 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.493789    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podStartSLOduration=1.493770404 podStartE2EDuration="1.493770404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:48.491270484 +0000 UTC m=+1098.240526101" watchObservedRunningTime="2026-09-11 19:44:48.493770404 +0000 UTC m=+1098.243025978"
Sep 11 19:44:48.578953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.578879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:48.681600 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.681543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:48.833946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.833850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:48.952876 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:48.952843    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:49.030240 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:49.030214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:49.957584 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:49.957555    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:50.476844 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:50.476808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:50.477735 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:50.477716    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:44:50.553608 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:50.553491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:50.632923 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:50.632877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:50.916441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:50.916338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:51.031706 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:51.031671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:51.128157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:51.128125    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:52.229910 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:52.229867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:52.324114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:52.324080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:52.740466 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:52.740431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:52.877514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:52.877479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:52.958749 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:52.958721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:53.356283 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:53.356248    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:54.353360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:54.353324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:54.457396 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:54.457363    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:54.555409 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:54.555377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:54.987652 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:54.987610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:55.070475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.070439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:55.524287 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.524253    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"]
Sep 11 19:44:55.529338 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.529318    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.532025 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.531981    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 19:44:55.533192 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.533172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 19:44:55.533380 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.533179    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-10cc24-serving-cert\""
Sep 11 19:44:55.533380 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.533194    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hvn79\""
Sep 11 19:44:55.533557 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.533207    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:44:55.539707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.539684    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"]
Sep 11 19:44:55.571200 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.571168    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:55.671315 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.671291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:55.697384 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.697349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87m8r\" (UniqueName: \"kubernetes.io/projected/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-kube-api-access-87m8r\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.697487 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.697392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-maas-api-tls\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.697487 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.697415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.697608 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.697520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-metrics-certs\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.744099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.744062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:55.798948 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.798885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87m8r\" (UniqueName: \"kubernetes.io/projected/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-kube-api-access-87m8r\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.798948 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.798916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-maas-api-tls\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.798948 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.798939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.799242 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.799021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-metrics-certs\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.799657 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.799633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.801606 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.801586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-maas-api-tls\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.801707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.801644    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-metrics-certs\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.811193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.811171    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87m8r\" (UniqueName: \"kubernetes.io/projected/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-kube-api-access-87m8r\") pod \"maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.843264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.843240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:55.860937 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.860900    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"]
Sep 11 19:44:55.866670 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.866637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:55.869541 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.869500    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-6bf598-openshift-default-dockercfg-rt2tz\""
Sep 11 19:44:55.881933 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.881681    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"]
Sep 11 19:44:55.892933 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:55.892875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:56.000942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.000900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-socket\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.000942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.000944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-podinfo\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.001227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.000982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-envoy\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.001227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.001040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-certs\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.001227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.001088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4vl5\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-kube-api-access-h4vl5\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.001227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.001112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-token\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.001227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.001172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37affb1a-a748-4416-8ccd-70a07bd526ce-istiod-ca-cert\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.001227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.001204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-credential-socket\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.001448 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.001227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-data\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-socket\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-podinfo\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-envoy\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-certs\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4vl5\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-kube-api-access-h4vl5\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-token\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37affb1a-a748-4416-8ccd-70a07bd526ce-istiod-ca-cert\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-credential-socket\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.102877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-data\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.103215 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-socket\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.103215 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.102980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-certs\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.103215 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.103196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-credential-socket\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.103383 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.103261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-data\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.103590 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.103570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37affb1a-a748-4416-8ccd-70a07bd526ce-istiod-ca-cert\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.105095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.105076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-envoy\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.105206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.105191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-podinfo\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.113265 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.113230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-token\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.114892 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.114873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4vl5\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-kube-api-access-h4vl5\") pod \"e2e-autores-6bf598-openshift-default-8856d95c4-mplrf\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") " pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.141219 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.141197    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"]
Sep 11 19:44:56.143326 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:44:56.143302    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e8f7f7_c7a9_49c9_87d1_1f5eac3901bc.slice/crio-77a634c3dfe63b6c73c5f5be825e6b0b3bc2c6f83e1297c8af265783e8e2124d WatchSource:0}: Error finding container 77a634c3dfe63b6c73c5f5be825e6b0b3bc2c6f83e1297c8af265783e8e2124d: Status 404 returned error can't find the container with id 77a634c3dfe63b6c73c5f5be825e6b0b3bc2c6f83e1297c8af265783e8e2124d
Sep 11 19:44:56.144692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.144677    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:44:56.187124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.187104    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:56.263882 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.263841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:56.366231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.366145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:56.450283 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.450253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:56.475169 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.475145    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"]
Sep 11 19:44:56.479016 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:44:56.478969    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37affb1a_a748_4416_8ccd_70a07bd526ce.slice/crio-f1cb1d856476f6f2ab8c4f2ec868da70a20e8243a557069880cdae55d76d3b6e WatchSource:0}: Error finding container f1cb1d856476f6f2ab8c4f2ec868da70a20e8243a557069880cdae55d76d3b6e: Status 404 returned error can't find the container with id f1cb1d856476f6f2ab8c4f2ec868da70a20e8243a557069880cdae55d76d3b6e
Sep 11 19:44:56.481597 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.481551    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:56.481702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.481639    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:56.481702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.481671    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:56.515927 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.515586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp" event={"ID":"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc","Type":"ContainerStarted","Data":"77a634c3dfe63b6c73c5f5be825e6b0b3bc2c6f83e1297c8af265783e8e2124d"}
Sep 11 19:44:56.518174 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.518148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" event={"ID":"37affb1a-a748-4416-8ccd-70a07bd526ce","Type":"ContainerStarted","Data":"f1cb1d856476f6f2ab8c4f2ec868da70a20e8243a557069880cdae55d76d3b6e"}
Sep 11 19:44:56.850104 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:56.850048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:57.088630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.088592    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:57.188532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.188404    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:57.323331 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.323293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:57.525467 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.525434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" event={"ID":"37affb1a-a748-4416-8ccd-70a07bd526ce","Type":"ContainerStarted","Data":"0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd"}
Sep 11 19:44:57.563569 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.563509    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podStartSLOduration=2.563492975 podStartE2EDuration="2.563492975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:44:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:57.561591048 +0000 UTC m=+1107.310846665" watchObservedRunningTime="2026-09-11 19:44:57.563492975 +0000 UTC m=+1107.312748550"
Sep 11 19:44:57.609158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.608869    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"]
Sep 11 19:44:57.618172 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.618149    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.621542 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.621503    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4c47b5e2-openshift-default-dockercfg-x8rmd\""
Sep 11 19:44:57.631666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.631641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"]
Sep 11 19:44:57.663297 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.663087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:57.720351 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv4hz\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-kube-api-access-sv4hz\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720351 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-envoy\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720644 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-credential-socket\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-certs\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-token\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720826 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-socket\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-data\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istiod-ca-cert\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.720946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.720942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-podinfo\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.751705 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.751656    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:57.821639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.821564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-token\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.821639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.821629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-socket\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.821902 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.821873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-data\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822027 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istiod-ca-cert\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822098 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-podinfo\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv4hz\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-kube-api-access-sv4hz\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-socket\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-envoy\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-data\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822368 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-credential-socket\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822368 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-certs\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822815 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istiod-ca-cert\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.822927 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-certs\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.823012 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.822945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-credential-socket\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.825278 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.825239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-envoy\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.825550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.825528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-podinfo\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.830829 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.830807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-token\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.831430 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.831411    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv4hz\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-kube-api-access-sv4hz\") pod \"e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") " pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:57.934136 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:57.934069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:58.007474 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.007441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:58.187511 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.187433    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:58.194157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.194133    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:58.532475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.532444    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:58.533477 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.533458    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:44:58.566900 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.566843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:58.734974 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.734946    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"]
Sep 11 19:44:58.742259 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:44:58.742233    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721f7e25_94f6_4fa3_be00_ce9fc13b81ee.slice/crio-eebac6ac39fa200b18c1e9e664a9b8efb7ec320c69e7db9e2fa5466222783d9e WatchSource:0}: Error finding container eebac6ac39fa200b18c1e9e664a9b8efb7ec320c69e7db9e2fa5466222783d9e: Status 404 returned error can't find the container with id eebac6ac39fa200b18c1e9e664a9b8efb7ec320c69e7db9e2fa5466222783d9e
Sep 11 19:44:58.744355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.744322    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:58.744445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.744385    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:58.744445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:58.744415    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:44:59.539409 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.539374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp" event={"ID":"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc","Type":"ContainerStarted","Data":"743d8675a450f5488c499100856eb69d9ef680fa6e8a3e22f9967d44be1f6fba"}
Sep 11 19:44:59.539877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.539464    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:44:59.541036 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.541011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" event={"ID":"721f7e25-94f6-4fa3-be00-ce9fc13b81ee","Type":"ContainerStarted","Data":"c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d"}
Sep 11 19:44:59.541149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.541059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" event={"ID":"721f7e25-94f6-4fa3-be00-ce9fc13b81ee","Type":"ContainerStarted","Data":"eebac6ac39fa200b18c1e9e664a9b8efb7ec320c69e7db9e2fa5466222783d9e"}
Sep 11 19:44:59.563759 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.563713    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp" podStartSLOduration=2.211966459 podStartE2EDuration="4.56369371s" totalImagesPullingTime="2.351727251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:59.563052926 +0000 UTC m=+1109.312308522" watchObservedRunningTime="2026-09-11 19:44:59.56369371 +0000 UTC m=+1109.312949284"
Sep 11 19:44:59.601500 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.601454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:59.612496 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.612451    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" podStartSLOduration=2.612438237 podStartE2EDuration="2.612438237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:44:59.608921258 +0000 UTC m=+1109.358176844" watchObservedRunningTime="2026-09-11 19:44:59.612438237 +0000 UTC m=+1109.361693872"
Sep 11 19:44:59.698631 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.698605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:44:59.934956 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.934871    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:44:59.939747 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:44:59.939723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:45:00.159080 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.159045    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"]
Sep 11 19:45:00.162821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.162797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"
Sep 11 19:45:00.165832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.165814    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qgbxs\""
Sep 11 19:45:00.173152 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.173136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"
Sep 11 19:45:00.181396 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.181371    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"]
Sep 11 19:45:00.450962 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.450940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"]
Sep 11 19:45:00.452864 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:45:00.452840    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8939c546_7efa_496f_b312_8f85b420a28a.slice/crio-4c1ce1d529fca51b5bb40f72df04bebf01b1973401a3fc5bc0586a7dcd58e3bc WatchSource:0}: Error finding container 4c1ce1d529fca51b5bb40f72df04bebf01b1973401a3fc5bc0586a7dcd58e3bc: Status 404 returned error can't find the container with id 4c1ce1d529fca51b5bb40f72df04bebf01b1973401a3fc5bc0586a7dcd58e3bc
Sep 11 19:45:00.546929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.546891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w" event={"ID":"8939c546-7efa-496f-b312-8f85b420a28a","Type":"ContainerStarted","Data":"4c1ce1d529fca51b5bb40f72df04bebf01b1973401a3fc5bc0586a7dcd58e3bc"}
Sep 11 19:45:00.547438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.547373    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:45:00.548247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.548226    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:45:00.848216 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:00.848188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:01.087584 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:01.087545    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:01.230040 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:01.229974    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:02.498468 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:02.498423    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:04.163653 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:04.163557    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:04.578288 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:04.578253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w" event={"ID":"8939c546-7efa-496f-b312-8f85b420a28a","Type":"ContainerStarted","Data":"98524497f0928afcf5f45637853927ae52f87b3d9a29249b8b2ea36309a82051"}
Sep 11 19:45:05.174064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.172961    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w" podStartSLOduration=2.086717213 podStartE2EDuration="5.172937467s" totalImagesPullingTime="3.086220254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:45:04.602287368 +0000 UTC m=+1114.351542968" watchObservedRunningTime="2026-09-11 19:45:05.172937467 +0000 UTC m=+1114.922193042"
Sep 11 19:45:05.174064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.173582    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"]
Sep 11 19:45:05.182316 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.182295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.189008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.185589    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-6bf598-serving-cert\""
Sep 11 19:45:05.190422 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.190400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"]
Sep 11 19:45:05.214570 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.214479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pchls\" (UniqueName: \"kubernetes.io/projected/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-kube-api-access-pchls\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.214570 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.214524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.214802 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.214659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-metrics-certs\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.214802 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.214690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-openshift-service-ca\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.235830 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.235793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:05.315251 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.315211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-metrics-certs\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.315251 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.315247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-openshift-service-ca\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.315466 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.315291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pchls\" (UniqueName: \"kubernetes.io/projected/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-kube-api-access-pchls\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.315466 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.315437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.315602 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:45:05.315581    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-serving-cert: secret "maas-api-e2e-autores-6bf598-serving-cert" not found
Sep 11 19:45:05.315674 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:45:05.315663    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls podName:93054bf6-bd2a-4c8e-8dc0-4f127e53eaff nodeName:}" failed. No retries permitted until 2026-09-11 19:45:05.815644581 +0000 UTC m=+1115.564900134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls") pod "maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" (UID: "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff") : secret "maas-api-e2e-autores-6bf598-serving-cert" not found
Sep 11 19:45:05.316020 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.316004    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-openshift-service-ca\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.317823 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.317793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-metrics-certs\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.324698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.324675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pchls\" (UniqueName: \"kubernetes.io/projected/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-kube-api-access-pchls\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.336132 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.336103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:05.438040 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.437919    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:05.537772 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.537736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:05.552409 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.552387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:45:05.589448 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.589412    2576 generic.go:356] "Generic (PLEG): container finished" podID="8939c546-7efa-496f-b312-8f85b420a28a" containerID="98524497f0928afcf5f45637853927ae52f87b3d9a29249b8b2ea36309a82051" exitCode=0
Sep 11 19:45:05.589622 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.589495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w" event={"ID":"8939c546-7efa-496f-b312-8f85b420a28a","Type":"ContainerDied","Data":"98524497f0928afcf5f45637853927ae52f87b3d9a29249b8b2ea36309a82051"}
Sep 11 19:45:05.624868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.624822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:05.782016 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.780766    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:05.819648 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.819611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.822344 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.822318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls\") pod \"maas-api-e2e-autores-6bf598-5468f4f796-z6nrm\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:05.880448 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.880419    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"]
Sep 11 19:45:05.894218 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.893334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:05.894616 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.894596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.904015 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.902266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-872425-openshift-default-dockercfg-qb8bv\""
Sep 11 19:45:05.913298 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.913269    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"]
Sep 11 19:45:05.920978 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.920927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457e450-32e8-451d-97c1-9cc285eda8d5-istiod-ca-cert\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921122 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvgdw\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-kube-api-access-bvgdw\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921122 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-token\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-certs\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-data\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-socket\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-podinfo\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921467 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-envoy\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.921467 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.921286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-credential-socket\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:05.991489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:05.991449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:06.022914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.022880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-certs\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.023463 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.023435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-data\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.023652 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.023633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-socket\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.023759 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.023517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-certs\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.023895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.023855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-podinfo\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.024048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.023939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-envoy\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.024048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.023973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-credential-socket\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.024048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.024006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-socket\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.024247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.024114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457e450-32e8-451d-97c1-9cc285eda8d5-istiod-ca-cert\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.024247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.024142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvgdw\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-kube-api-access-bvgdw\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.024247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.024193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-token\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.024580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.024526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-credential-socket\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.025118 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.023737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-data\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.025387 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.025364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457e450-32e8-451d-97c1-9cc285eda8d5-istiod-ca-cert\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.028737 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.028242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-envoy\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.031932 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.030451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-podinfo\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.045007 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.044901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-token\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.045691 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.045648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvgdw\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-kube-api-access-bvgdw\") pod \"e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") " pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.103008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.102493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:06.104117 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.104094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:06.203942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.203850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:06.227706 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.227574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:06.408161 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.406543    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"]
Sep 11 19:45:06.411475 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:45:06.411453    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93054bf6_bd2a_4c8e_8dc0_4f127e53eaff.slice/crio-ef52909c2d3438ef2d6a331eb909055a6ad3439e1e765dd9061ab6d0c25065ee WatchSource:0}: Error finding container ef52909c2d3438ef2d6a331eb909055a6ad3439e1e765dd9061ab6d0c25065ee: Status 404 returned error can't find the container with id ef52909c2d3438ef2d6a331eb909055a6ad3439e1e765dd9061ab6d0c25065ee
Sep 11 19:45:06.461047 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.461011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:06.540246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.540223    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"]
Sep 11 19:45:06.541940 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:45:06.541915    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4457e450_32e8_451d_97c1_9cc285eda8d5.slice/crio-aad147751acb1a5af48c9bc5b94d03558f179037096e284ee7d07344a7a21696 WatchSource:0}: Error finding container aad147751acb1a5af48c9bc5b94d03558f179037096e284ee7d07344a7a21696: Status 404 returned error can't find the container with id aad147751acb1a5af48c9bc5b94d03558f179037096e284ee7d07344a7a21696
Sep 11 19:45:06.544299 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.544263    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:06.544374 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.544332    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:06.544374 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.544361    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:06.610473 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.610432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" event={"ID":"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff","Type":"ContainerStarted","Data":"ef52909c2d3438ef2d6a331eb909055a6ad3439e1e765dd9061ab6d0c25065ee"}
Sep 11 19:45:06.615093 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.614744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" event={"ID":"4457e450-32e8-451d-97c1-9cc285eda8d5","Type":"ContainerStarted","Data":"aad147751acb1a5af48c9bc5b94d03558f179037096e284ee7d07344a7a21696"}
Sep 11 19:45:06.798312 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.798051    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"
Sep 11 19:45:06.812484 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.812405    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:06.911367 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:06.911336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:07.521606 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.521577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:07.621085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.621010    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"
Sep 11 19:45:07.621085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.621031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w" event={"ID":"8939c546-7efa-496f-b312-8f85b420a28a","Type":"ContainerDied","Data":"4c1ce1d529fca51b5bb40f72df04bebf01b1973401a3fc5bc0586a7dcd58e3bc"}
Sep 11 19:45:07.621085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.621080    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c1ce1d529fca51b5bb40f72df04bebf01b1973401a3fc5bc0586a7dcd58e3bc"
Sep 11 19:45:07.623014 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.622955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" event={"ID":"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff","Type":"ContainerStarted","Data":"c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089"}
Sep 11 19:45:07.623571 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.623549    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:07.625381 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.625353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" event={"ID":"4457e450-32e8-451d-97c1-9cc285eda8d5","Type":"ContainerStarted","Data":"955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c"}
Sep 11 19:45:07.643153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.643130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:07.717172 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.717129    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podStartSLOduration=2.717113998 podStartE2EDuration="2.717113998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:45:07.714895926 +0000 UTC m=+1117.464151527" watchObservedRunningTime="2026-09-11 19:45:07.717113998 +0000 UTC m=+1117.466369572"
Sep 11 19:45:07.717520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:07.717498    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" podStartSLOduration=2.185695087 podStartE2EDuration="2.717490878s" totalImagesPullingTime="531.795791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:45:07.664630132 +0000 UTC m=+1117.413885717" watchObservedRunningTime="2026-09-11 19:45:07.717490878 +0000 UTC m=+1117.466746503"
Sep 11 19:45:08.009531 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.009496    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:08.166827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.166791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:08.228481 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.228444    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:08.233879 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.233849    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:08.302870 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.302786    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:08.417601 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.417564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:08.522405 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.522359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:08.631758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.631650    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:08.633071 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:08.633048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:09.570946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:09.570907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:09.680070 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:09.680039    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:09.780201 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:09.780166    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:10.560580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:10.560542    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:10.644065 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:10.644033    2576 generic.go:356] "Generic (PLEG): container finished" podID="fafdff16-c931-4653-b1e1-03b48f75175a" containerID="e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de" exitCode=0
Sep 11 19:45:10.644465 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:10.644114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" event={"ID":"fafdff16-c931-4653-b1e1-03b48f75175a","Type":"ContainerDied","Data":"e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de"}
Sep 11 19:45:10.644596 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:10.644580    2576 scope.go:117] "RemoveContainer" containerID="e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de"
Sep 11 19:45:10.645620 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:10.645590    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:10.645719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:10.645676    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:10.645794 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:10.645724    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:11.289681 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:11.289640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:11.651908 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:11.651827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" event={"ID":"fafdff16-c931-4653-b1e1-03b48f75175a","Type":"ContainerStarted","Data":"5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c"}
Sep 11 19:45:11.659621 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:11.659581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:11.953268 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:11.953187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:45:11.953447 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:11.953346    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 19:45:11.953447 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:11.953413    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 19:45:12.798954 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:12.798906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:12.953041 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:12.952978    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 19:45:12.953193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:12.953076    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 19:45:13.025110 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:13.025074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:13.953829 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:13.953790    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 19:45:13.954264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:13.953850    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 19:45:13.995636 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:13.995596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:14.648014 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:14.647959    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:45:14.953301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:14.953201    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 19:45:14.953301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:14.953283    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 19:45:15.342387 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.342345    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"]
Sep 11 19:45:15.343060 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.343035    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8939c546-7efa-496f-b312-8f85b420a28a" containerName="cleanup"
Sep 11 19:45:15.343060 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.343062    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8939c546-7efa-496f-b312-8f85b420a28a" containerName="cleanup"
Sep 11 19:45:15.343224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.343159    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8939c546-7efa-496f-b312-8f85b420a28a" containerName="cleanup"
Sep 11 19:45:15.352832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.352708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.356859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.355342    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-872425-serving-cert\""
Sep 11 19:45:15.370335 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.362253    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"]
Sep 11 19:45:15.400056 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.399886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:15.443799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.443754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c9d563-71a8-4a7e-ad72-994eae429513-openshift-service-ca\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.444131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.444109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-metrics-certs\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.444363 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.444344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7rm\" (UniqueName: \"kubernetes.io/projected/a8c9d563-71a8-4a7e-ad72-994eae429513-kube-api-access-zc7rm\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.444567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.444518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.505874 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.505802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:15.545917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.545863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c9d563-71a8-4a7e-ad72-994eae429513-openshift-service-ca\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.550139 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.550113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-metrics-certs\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.550399 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.550363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7rm\" (UniqueName: \"kubernetes.io/projected/a8c9d563-71a8-4a7e-ad72-994eae429513-kube-api-access-zc7rm\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.550905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.550885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.551120 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:45:15.551094    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-serving-cert: secret "maas-api-e2e-inf-b-872425-serving-cert" not found
Sep 11 19:45:15.551221 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:45:15.551166    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls podName:a8c9d563-71a8-4a7e-ad72-994eae429513 nodeName:}" failed. No retries permitted until 2026-09-11 19:45:16.051145004 +0000 UTC m=+1125.800400571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls") pod "maas-api-e2e-inf-b-872425-5b7455957-kb7xg" (UID: "a8c9d563-71a8-4a7e-ad72-994eae429513") : secret "maas-api-e2e-inf-b-872425-serving-cert" not found
Sep 11 19:45:15.551423 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.547142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c9d563-71a8-4a7e-ad72-994eae429513-openshift-service-ca\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.559451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.559424    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-metrics-certs\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.563270 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.563211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7rm\" (UniqueName: \"kubernetes.io/projected/a8c9d563-71a8-4a7e-ad72-994eae429513-kube-api-access-zc7rm\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:15.614176 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.613894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:15.813425 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.813386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:15.954153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.954061    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 19:45:15.954153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.954132    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 19:45:15.996073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:15.996022    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:16.060772 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.060724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:16.064440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.064414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls\") pod \"maas-api-e2e-inf-b-872425-5b7455957-kb7xg\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:16.085181 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.085139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:16.187015 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.186467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:16.272273 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.272234    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:16.834475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.834396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:16.892940 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.892905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"]
Sep 11 19:45:16.945324 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.945202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:16.953591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.953561    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 19:45:16.953838 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:16.953809    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 19:45:17.043147 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.043103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:17.255659 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.255604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:17.355315 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.355283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:17.717222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.717181    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg" event={"ID":"a8c9d563-71a8-4a7e-ad72-994eae429513","Type":"ContainerStarted","Data":"7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2"}
Sep 11 19:45:17.717417 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.717248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg" event={"ID":"a8c9d563-71a8-4a7e-ad72-994eae429513","Type":"ContainerStarted","Data":"fc21064f9da95ba73d80dd1230e07c52b07b4ed613f8b4bf2917625c28adcf8d"}
Sep 11 19:45:17.718132 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.718107    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:17.773799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.773726    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg" podStartSLOduration=2.250985919 podStartE2EDuration="2.773702983s" totalImagesPullingTime="522.717064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:45:17.770964624 +0000 UTC m=+1127.520220241" watchObservedRunningTime="2026-09-11 19:45:17.773702983 +0000 UTC m=+1127.522958560"
Sep 11 19:45:17.957767 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.957682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:45:17.958226 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.957969    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:45:17.958713 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:17.958699    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:45:18.350147 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:18.350119    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:19.329673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:19.329556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:20.116116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:20.116065    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:20.883325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:20.883284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:21.941151 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:21.941117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:22.757234 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.757202    2576 generic.go:356] "Generic (PLEG): container finished" podID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerID="0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd" exitCode=0
Sep 11 19:45:22.757437 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.757273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" event={"ID":"37affb1a-a748-4416-8ccd-70a07bd526ce","Type":"ContainerDied","Data":"0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd"}
Sep 11 19:45:22.757708 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.757686    2576 scope.go:117] "RemoveContainer" containerID="0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd"
Sep 11 19:45:22.759022 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.758966    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:22.759135 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.759080    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:22.759180 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.759129    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:22.759180 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.759146    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" event={"ID":"721f7e25-94f6-4fa3-be00-ce9fc13b81ee","Type":"ContainerDied","Data":"c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d"}
Sep 11 19:45:22.759261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.759128    2576 generic.go:356] "Generic (PLEG): container finished" podID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerID="c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d" exitCode=0
Sep 11 19:45:22.759537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.759520    2576 scope.go:117] "RemoveContainer" containerID="c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d"
Sep 11 19:45:22.760565 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.760535    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:22.760628 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.760601    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:22.760674 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.760640    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:22.869919 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:22.869777    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:23.596777 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.596741    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:23.711809 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.711776    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:23.766648 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.766614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" event={"ID":"721f7e25-94f6-4fa3-be00-ce9fc13b81ee","Type":"ContainerStarted","Data":"752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0"}
Sep 11 19:45:23.768583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.768560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" event={"ID":"37affb1a-a748-4416-8ccd-70a07bd526ce","Type":"ContainerStarted","Data":"9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c"}
Sep 11 19:45:23.801422 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.801378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:23.935426 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.935323    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:45:23.935609 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.935463    2576 patch_prober.go:28] interesting pod/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:45:23.935609 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.935509    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:45:23.949948 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:23.949912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:24.189337 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.188103    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:45:24.189654 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.189629    2576 patch_prober.go:28] interesting pod/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 11 19:45:24.189852 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.189827    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 11 19:45:24.589306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.589261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:24.751307 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.751271    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:45:24.860097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.859942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:24.937010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.936487    2576 patch_prober.go:28] interesting pod/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:45:24.937010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:24.936554    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:45:25.188015 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:25.187886    2576 patch_prober.go:28] interesting pod/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 11 19:45:25.188325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:25.188291    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 11 19:45:25.671272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:25.671233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:25.935172 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:25.935067    2576 patch_prober.go:28] interesting pod/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:45:25.935172 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:25.935151    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:45:26.188061 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:26.187939    2576 patch_prober.go:28] interesting pod/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 11 19:45:26.188369 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:26.188337    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 11 19:45:26.556506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:26.556481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:26.936113 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:26.934521    2576 patch_prober.go:28] interesting pod/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:45:26.936113 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:26.934586    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:45:27.187765 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:27.187667    2576 patch_prober.go:28] interesting pod/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 11 19:45:27.188054 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:27.188022    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 11 19:45:27.306089 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:27.306048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:27.935438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:27.935398    2576 patch_prober.go:28] interesting pod/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 11 19:45:27.935758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:27.935727    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 11 19:45:28.051936 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.051902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:28.157048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.151301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:28.193611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.193513    2576 patch_prober.go:28] interesting pod/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 11 19:45:28.193789 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.193599    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 11 19:45:28.247761 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.247695    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:28.365186 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.365151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:28.537011 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.536945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:45:28.570131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.568864    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:28.582009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.573221    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"]
Sep 11 19:45:28.582009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.573445    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy" containerID="cri-o://752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0" gracePeriod=30
Sep 11 19:45:28.662019 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:28.658229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:29.054163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.054114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:29.188104 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.188016    2576 patch_prober.go:28] interesting pod/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 11 19:45:29.188296 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.188103    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 11 19:45:29.196067 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.196039    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:29.338677 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.338590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:29.632838 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.632744    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:29.731181 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.731146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:29.862758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:29.862729    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:30.192149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:30.192119    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:45:30.193313 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:30.193288    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:45:30.547191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:30.547154    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:45:30.640126 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:30.640087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:31.415364 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:31.415328    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:31.516747 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:31.516715    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:31.658490 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:31.658451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:32.338558 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.338524    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:32.439278 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.439246    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:32.841826 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.841802    2576 generic.go:356] "Generic (PLEG): container finished" podID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerID="955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c" exitCode=0
Sep 11 19:45:32.842045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.841888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" event={"ID":"4457e450-32e8-451d-97c1-9cc285eda8d5","Type":"ContainerDied","Data":"955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c"}
Sep 11 19:45:32.842380 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.842364    2576 scope.go:117] "RemoveContainer" containerID="955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c"
Sep 11 19:45:32.843548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.843522    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:32.843612 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.843588    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:32.843650 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.843623    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:45:32.957817 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:32.957724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:33.854070 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:33.854008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" event={"ID":"4457e450-32e8-451d-97c1-9cc285eda8d5","Type":"ContainerStarted","Data":"0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a"}
Sep 11 19:45:34.019140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.019106    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:34.228059 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.228026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:34.229010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.228966    2576 patch_prober.go:28] interesting pod/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 19:45:34.229065 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.229034    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 19:45:34.554883 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.554850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:34.665539 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.665516    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:45:34.719679 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-envoy\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.719863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719715    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-token\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.719863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719750    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istiod-ca-cert\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.719863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-podinfo\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.719863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719785    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-credential-socket\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.719863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719824    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-socket\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.720188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719892    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-data\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.720188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-certs\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.720188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.719966    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv4hz\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-kube-api-access-sv4hz\") pod \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\" (UID: \"721f7e25-94f6-4fa3-be00-ce9fc13b81ee\") "
Sep 11 19:45:34.720188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.720151    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:45:34.720188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.720167    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:45:34.720460 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.720336    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.720460 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.720348    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.720579 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.720477    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:45:34.720637 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.720613    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:45:34.720696 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.720654    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:45:34.722915 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.722864    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:45:34.723076 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.722963    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:45:34.723157 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.723068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:45:34.723744 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.723486    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-kube-api-access-sv4hz" (OuterVolumeSpecName: "kube-api-access-sv4hz") pod "721f7e25-94f6-4fa3-be00-ce9fc13b81ee" (UID: "721f7e25-94f6-4fa3-be00-ce9fc13b81ee"). InnerVolumeSpecName "kube-api-access-sv4hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:45:34.821306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.821277    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.821306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.821304    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.821484 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.821313    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.821484 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.821324    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.821484 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.821331    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv4hz\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-kube-api-access-sv4hz\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.821484 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.821340    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.821484 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.821348    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/721f7e25-94f6-4fa3-be00-ce9fc13b81ee-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:45:34.861202 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.861173    2576 generic.go:356] "Generic (PLEG): container finished" podID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerID="752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0" exitCode=0
Sep 11 19:45:34.861583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.861221    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"
Sep 11 19:45:34.861583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.861266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" event={"ID":"721f7e25-94f6-4fa3-be00-ce9fc13b81ee","Type":"ContainerDied","Data":"752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0"}
Sep 11 19:45:34.861583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.861318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z" event={"ID":"721f7e25-94f6-4fa3-be00-ce9fc13b81ee","Type":"ContainerDied","Data":"eebac6ac39fa200b18c1e9e664a9b8efb7ec320c69e7db9e2fa5466222783d9e"}
Sep 11 19:45:34.861583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.861343    2576 scope.go:117] "RemoveContainer" containerID="752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0"
Sep 11 19:45:34.870878 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.870862    2576 scope.go:117] "RemoveContainer" containerID="c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d"
Sep 11 19:45:34.884006 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.882581    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"]
Sep 11 19:45:34.887524 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.887495    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4c47b5e2-openshift-default-cfb7f4dc6-mjr5z"]
Sep 11 19:45:34.899856 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.899816    2576 scope.go:117] "RemoveContainer" containerID="752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0"
Sep 11 19:45:34.900581 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:45:34.900270    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0\": container with ID starting with 752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0 not found: ID does not exist" containerID="752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0"
Sep 11 19:45:34.900581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.900306    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0"} err="failed to get container status \"752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0\": rpc error: code = NotFound desc = could not find container \"752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0\": container with ID starting with 752f1c543bc821202b5ca4e2f888f127f6a35c514bf5ce2a10251a4b48c9ecf0 not found: ID does not exist"
Sep 11 19:45:34.900581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.900331    2576 scope.go:117] "RemoveContainer" containerID="c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d"
Sep 11 19:45:34.900942 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:45:34.900882    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d\": container with ID starting with c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d not found: ID does not exist" containerID="c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d"
Sep 11 19:45:34.900942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.900913    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d"} err="failed to get container status \"c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d\": rpc error: code = NotFound desc = could not find container \"c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d\": container with ID starting with c5b3502bde98a8d360b0005c7c706633dfa7ec865fda3b6d0d6da7a2b796b77d not found: ID does not exist"
Sep 11 19:45:34.935352 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:34.935324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:35.228546 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:35.228510    2576 patch_prober.go:28] interesting pod/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 19:45:35.228742 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:35.228583    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 19:45:35.849164 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:35.849132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:35.944392 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:35.944356    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:36.228717 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:36.228685    2576 patch_prober.go:28] interesting pod/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 19:45:36.228884 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:36.228737    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 19:45:36.440252 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:36.440218    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:36.540581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:36.540490    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:36.641531 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:36.641480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:36.729247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:36.729211    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" path="/var/lib/kubelet/pods/721f7e25-94f6-4fa3-be00-ce9fc13b81ee/volumes"
Sep 11 19:45:36.922053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:36.921949    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:37.228327 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:37.228289    2576 patch_prober.go:28] interesting pod/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 19:45:37.228789 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:37.228364    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 19:45:37.740633 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:37.740605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:38.228702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:38.228672    2576 patch_prober.go:28] interesting pod/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 19:45:38.229089 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:38.228736    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 19:45:38.536736 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:38.536647    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:38.631685 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:38.631657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:39.228470 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:39.228431    2576 patch_prober.go:28] interesting pod/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 11 19:45:39.228649 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:39.228498    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 11 19:45:39.440568 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:39.440527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:40.231797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:40.231773    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:40.232720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:40.232701    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:45:40.541894 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:40.541799    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:58.435524 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:58.435437    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:45:59.669045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:45:59.669006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:00.175222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:00.175186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:00.942468 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:00.942434    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:01.959804 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:01.959767    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:02.061008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:02.060952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:03.077975 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:03.077944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:03.936627 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:03.936595    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:04.854782 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:04.854735    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:05.687871 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:05.687833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:06.656332 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:06.656302    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:07.400155 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:07.400112    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:08.335628 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:08.335585    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:13.533237 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:13.533204    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:14.329425 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:14.329388    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:14.425532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:14.425492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:14.504419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:14.504390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:14.585407 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:14.584478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:14.662235 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:14.662205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:14.906385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:14.906294    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:15.048893 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:15.048859    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:15.195268 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:15.195167    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:15.528253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:15.528214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:15.629727 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:15.629692    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:16.047576 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:16.047533    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:16.828147 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:16.828119    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:17.851011 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:17.850951    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:18.428873 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:18.428842    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:18.542235 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:18.542203    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:18.795844 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:18.795812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:19.568241 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:19.568212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:20.467893 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:20.467857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:20.568576 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:20.568537    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:20.958170 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:20.958093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:21.058513 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:21.058479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:21.158368 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:21.158337    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:21.584172 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:21.584133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:22.434531 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:22.434495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:23.153125 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:23.153084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:24.050816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:24.050780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:24.837243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:24.837211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:30.739412 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:30.739387    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:46:30.742778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:30.742759    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:46:30.746458 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:30.746439    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:46:30.749678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:30.749660    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:46:41.198016 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:41.197953    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:42.999495 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:42.999441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:43.856149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:43.856105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:44.946783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:44.946747    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:45.946482 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:45.946439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:46.998380 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:46.998348    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:48.097043 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:48.096979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:49.166232 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:49.166188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:50.030490 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:50.030451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:51.152084 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:51.152053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:51.888683 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:51.888646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:51.995690 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:51.995658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:52.098878 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:52.098845    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:52.197212 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:52.197101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:52.646600 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:52.646569    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:53.391888 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:53.391850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:53.689494 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:53.689412    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:53.853318 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:53.853279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:54.208168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:54.208109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:54.613082 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:54.613047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:54.804582 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:54.804550    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:55.925653 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:55.925623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:56.778226 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:56.778176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:56.883181 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:56.883142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:57.161953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:57.161874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:58.050042 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:58.049979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:59.009480 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:59.009444    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:59.099086 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:59.099049    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:59.335045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:59.334960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:59.571463 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:59.571429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:46:59.691207 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:46:59.691126    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:00.194872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:00.194840    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:01.452610 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:01.452571    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:02.548140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:02.548094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:03.680731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:03.680701    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:04.563825 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:04.563791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:15.771645 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.771613    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"]
Sep 11 19:47:15.772179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.772161    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy"
Sep 11 19:47:15.772179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.772180    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy"
Sep 11 19:47:15.772259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.772191    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy"
Sep 11 19:47:15.772259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.772197    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy"
Sep 11 19:47:15.772259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.772258    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy"
Sep 11 19:47:15.775300 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.775285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.778967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.778942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-6bf598\"/\"autores-model-6bf598-kserve-self-signed-certs\""
Sep 11 19:47:15.779132 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.778952    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-6bf598\"/\"kube-root-ca.crt\""
Sep 11 19:47:15.779132 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.779011    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-6bf598\"/\"openshift-service-ca.crt\""
Sep 11 19:47:15.779132 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.778952    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-6bf598\"/\"default-dockercfg-tzgqg\""
Sep 11 19:47:15.786061 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.786036    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"]
Sep 11 19:47:15.792471 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.792451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-dshm\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.792597 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.792537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-tmp-dir\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.792673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.792620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-model-cache\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.792673 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.792651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d92d25-64da-442a-ab66-1bf0a847d55f-tls-certs\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.792817 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.792790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-home\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.792892 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.792855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqz5r\" (UniqueName: \"kubernetes.io/projected/70d92d25-64da-442a-ab66-1bf0a847d55f-kube-api-access-cqz5r\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.863113 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.863085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:15.893475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-dshm\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.893604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-tmp-dir\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.893604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-model-cache\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.893604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d92d25-64da-442a-ab66-1bf0a847d55f-tls-certs\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.893604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-home\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.893604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqz5r\" (UniqueName: \"kubernetes.io/projected/70d92d25-64da-442a-ab66-1bf0a847d55f-kube-api-access-cqz5r\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.893866 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-tmp-dir\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.893938 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893916    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-model-cache\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.894025 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.893978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-home\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.895998 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.895963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-dshm\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.896246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.896230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d92d25-64da-442a-ab66-1bf0a847d55f-tls-certs\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:15.902654 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:15.902635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqz5r\" (UniqueName: \"kubernetes.io/projected/70d92d25-64da-442a-ab66-1bf0a847d55f-kube-api-access-cqz5r\") pod \"autores-model-6bf598-kserve-56897df7c9-ck99h\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") " pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:16.085777 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:16.085674    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:16.364087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:16.364064    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"]
Sep 11 19:47:16.406293 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:16.406255    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h" event={"ID":"70d92d25-64da-442a-ab66-1bf0a847d55f","Type":"ContainerStarted","Data":"c5da700710d21ead7df75ddf72be23756f339eddbb667aa8062747ac47babf78"}
Sep 11 19:47:18.426617 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:18.426571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h" event={"ID":"70d92d25-64da-442a-ab66-1bf0a847d55f","Type":"ContainerStarted","Data":"697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5"}
Sep 11 19:47:18.454738 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:18.454687    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h" podStartSLOduration=2.346283427 podStartE2EDuration="3.454670946s" totalImagesPullingTime="1.108387519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:18.452810773 +0000 UTC m=+1248.202066366" watchObservedRunningTime="2026-09-11 19:47:18.454670946 +0000 UTC m=+1248.203926519"
Sep 11 19:47:21.828420 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:21.828339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:22.802663 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:22.802624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:23.758387 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:23.758345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:24.775366 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:24.775329    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:25.726378 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:25.726341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:25.824847 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:25.824814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:26.086832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:26.086758    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:26.086832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:26.086801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:26.099901 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:26.099879    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:26.482796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:26.482765    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:47:26.619399 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:26.619366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:27.555012 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:27.554960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:28.338001 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:28.337950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:29.077334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:29.077296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:29.202952 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:29.202917    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:29.303916 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:29.303877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:29.411347 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:29.411262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:29.492432 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:29.492397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:29.666153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:29.666070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:29.894006 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:29.893959    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:30.293323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:30.293291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:30.455069 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:30.455033    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:31.064114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:31.064074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:31.991275 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:31.991236    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:32.159965 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:32.159935    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:33.048252 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:33.048215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:33.916068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:33.916030    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:34.813426 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:34.813391    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:36.111844 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:36.111811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:37.939011 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:37.938954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:38.050528 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:38.050505    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:38.151274 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:38.151238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:38.250863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:38.250838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:38.695302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:38.695227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:49.924799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:49.924759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:50.900464 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:50.900415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:51.997934 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:51.997890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:52.980776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:52.980738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:53.799031 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:53.798967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:54.717909 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:54.717875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:59.540386 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.540347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"]
Sep 11 19:47:59.540832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.540646    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" podUID="93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" containerName="maas-api" containerID="cri-o://c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089" gracePeriod=30
Sep 11 19:47:59.569112 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.569071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:59.638141 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.638088    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" podUID="93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Sep 11 19:47:59.640854 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.640824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:59.708807 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.708769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:59.771072 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.771032    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:59.802350 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.802291    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:47:59.840889 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.840838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:47:59.894453 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.894433    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls\") pod \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") "
Sep 11 19:47:59.894591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.894470    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pchls\" (UniqueName: \"kubernetes.io/projected/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-kube-api-access-pchls\") pod \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") "
Sep 11 19:47:59.894591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.894508    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-metrics-certs\") pod \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") "
Sep 11 19:47:59.894591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.894549    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-openshift-service-ca\") pod \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\" (UID: \"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff\") "
Sep 11 19:47:59.895045 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.895011    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" (UID: "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:47:59.896882 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.896858    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" (UID: "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:47:59.896967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.896898    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" (UID: "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:47:59.896967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.896935    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-kube-api-access-pchls" (OuterVolumeSpecName: "kube-api-access-pchls") pod "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" (UID: "93054bf6-bd2a-4c8e-8dc0-4f127e53eaff"). InnerVolumeSpecName "kube-api-access-pchls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:47:59.995731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.995685    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:47:59.995731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.995727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pchls\" (UniqueName: \"kubernetes.io/projected/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-kube-api-access-pchls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:47:59.995731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.995738    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:47:59.995731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:47:59.995746    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:00.113109 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.113019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:00.212921 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.212887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:00.658435 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.658401    2576 generic.go:356] "Generic (PLEG): container finished" podID="93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" containerID="c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089" exitCode=0
Sep 11 19:48:00.658917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.658456    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"
Sep 11 19:48:00.658917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.658461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" event={"ID":"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff","Type":"ContainerDied","Data":"c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089"}
Sep 11 19:48:00.658917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.658511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm" event={"ID":"93054bf6-bd2a-4c8e-8dc0-4f127e53eaff","Type":"ContainerDied","Data":"ef52909c2d3438ef2d6a331eb909055a6ad3439e1e765dd9061ab6d0c25065ee"}
Sep 11 19:48:00.658917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.658536    2576 scope.go:117] "RemoveContainer" containerID="c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089"
Sep 11 19:48:00.668101 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.668075    2576 scope.go:117] "RemoveContainer" containerID="c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089"
Sep 11 19:48:00.668364 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:48:00.668345    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089\": container with ID starting with c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089 not found: ID does not exist" containerID="c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089"
Sep 11 19:48:00.668423 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.668374    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089"} err="failed to get container status \"c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089\": rpc error: code = NotFound desc = could not find container \"c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089\": container with ID starting with c7c8166f8e08497a797bf7e9b921ba0565cc9f94cced3215e48db82820443089 not found: ID does not exist"
Sep 11 19:48:00.680127 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.680093    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"]
Sep 11 19:48:00.685511 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.685490    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6bf598-5468f4f796-z6nrm"]
Sep 11 19:48:00.726915 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.726892    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" path="/var/lib/kubelet/pods/93054bf6-bd2a-4c8e-8dc0-4f127e53eaff/volumes"
Sep 11 19:48:00.934562 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:00.934489    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:01.834376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:01.834336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:02.543084 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:02.543046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:03.246643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:03.246588    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:04.535788 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:04.535735    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:05.103129 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:05.103095    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"]
Sep 11 19:48:05.196567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:05.196528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:10.335326 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:10.335289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:10.437862 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:10.437824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:10.534827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:10.534790    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:13.314827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:13.314795    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:20.124461 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.124423    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h" podUID="70d92d25-64da-442a-ab66-1bf0a847d55f" containerName="main" containerID="cri-o://697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5" gracePeriod=45
Sep 11 19:48:20.379616 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.379566    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:48:20.464482 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464460    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-model-cache\") pod \"70d92d25-64da-442a-ab66-1bf0a847d55f\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") "
Sep 11 19:48:20.464626 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d92d25-64da-442a-ab66-1bf0a847d55f-tls-certs\") pod \"70d92d25-64da-442a-ab66-1bf0a847d55f\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") "
Sep 11 19:48:20.464626 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-home\") pod \"70d92d25-64da-442a-ab66-1bf0a847d55f\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") "
Sep 11 19:48:20.464626 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-dshm\") pod \"70d92d25-64da-442a-ab66-1bf0a847d55f\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") "
Sep 11 19:48:20.464800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464664    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-tmp-dir\") pod \"70d92d25-64da-442a-ab66-1bf0a847d55f\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") "
Sep 11 19:48:20.464800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464706    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqz5r\" (UniqueName: \"kubernetes.io/projected/70d92d25-64da-442a-ab66-1bf0a847d55f-kube-api-access-cqz5r\") pod \"70d92d25-64da-442a-ab66-1bf0a847d55f\" (UID: \"70d92d25-64da-442a-ab66-1bf0a847d55f\") "
Sep 11 19:48:20.464800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464710    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-model-cache" (OuterVolumeSpecName: "model-cache") pod "70d92d25-64da-442a-ab66-1bf0a847d55f" (UID: "70d92d25-64da-442a-ab66-1bf0a847d55f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:20.464800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464756    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-home" (OuterVolumeSpecName: "home") pod "70d92d25-64da-442a-ab66-1bf0a847d55f" (UID: "70d92d25-64da-442a-ab66-1bf0a847d55f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:20.465071 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.464886    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70d92d25-64da-442a-ab66-1bf0a847d55f" (UID: "70d92d25-64da-442a-ab66-1bf0a847d55f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:20.465121 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.465077    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:20.465121 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.465096    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:20.465121 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.465114    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:20.466953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.466927    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-dshm" (OuterVolumeSpecName: "dshm") pod "70d92d25-64da-442a-ab66-1bf0a847d55f" (UID: "70d92d25-64da-442a-ab66-1bf0a847d55f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:20.467097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.466972    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d92d25-64da-442a-ab66-1bf0a847d55f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70d92d25-64da-442a-ab66-1bf0a847d55f" (UID: "70d92d25-64da-442a-ab66-1bf0a847d55f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:48:20.467097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.467070    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d92d25-64da-442a-ab66-1bf0a847d55f-kube-api-access-cqz5r" (OuterVolumeSpecName: "kube-api-access-cqz5r") pod "70d92d25-64da-442a-ab66-1bf0a847d55f" (UID: "70d92d25-64da-442a-ab66-1bf0a847d55f"). InnerVolumeSpecName "kube-api-access-cqz5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:48:20.565733 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.565697    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70d92d25-64da-442a-ab66-1bf0a847d55f-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:20.565826 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.565736    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqz5r\" (UniqueName: \"kubernetes.io/projected/70d92d25-64da-442a-ab66-1bf0a847d55f-kube-api-access-cqz5r\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:20.565826 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.565748    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70d92d25-64da-442a-ab66-1bf0a847d55f-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:20.767006 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.766954    2576 generic.go:356] "Generic (PLEG): container finished" podID="70d92d25-64da-442a-ab66-1bf0a847d55f" containerID="697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5" exitCode=0
Sep 11 19:48:20.767111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.767023    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"
Sep 11 19:48:20.767111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.767031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h" event={"ID":"70d92d25-64da-442a-ab66-1bf0a847d55f","Type":"ContainerDied","Data":"697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5"}
Sep 11 19:48:20.767111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.767056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h" event={"ID":"70d92d25-64da-442a-ab66-1bf0a847d55f","Type":"ContainerDied","Data":"c5da700710d21ead7df75ddf72be23756f339eddbb667aa8062747ac47babf78"}
Sep 11 19:48:20.767111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.767072    2576 scope.go:117] "RemoveContainer" containerID="697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5"
Sep 11 19:48:20.775786 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.775766    2576 scope.go:117] "RemoveContainer" containerID="697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5"
Sep 11 19:48:20.776095 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:48:20.776076    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5\": container with ID starting with 697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5 not found: ID does not exist" containerID="697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5"
Sep 11 19:48:20.776156 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.776103    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5"} err="failed to get container status \"697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5\": rpc error: code = NotFound desc = could not find container \"697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5\": container with ID starting with 697d9b7c0806d4e3af5d5b6b307c2a732f07071d1f39f5bc51fa03be81dfeae5 not found: ID does not exist"
Sep 11 19:48:20.784118 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.784096    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"]
Sep 11 19:48:20.790358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:20.790338    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-6bf598/autores-model-6bf598-kserve-56897df7c9-ck99h"]
Sep 11 19:48:22.726525 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:22.726487    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d92d25-64da-442a-ab66-1bf0a847d55f" path="/var/lib/kubelet/pods/70d92d25-64da-442a-ab66-1bf0a847d55f/volumes"
Sep 11 19:48:26.320410 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:26.320373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:32.189342 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.189298    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:32.294378 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.294345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:32.388736 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.388708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:32.963974 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.963944    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"]
Sep 11 19:48:32.964372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.964356    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" containerName="maas-api"
Sep 11 19:48:32.964372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.964372    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" containerName="maas-api"
Sep 11 19:48:32.964537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.964382    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d92d25-64da-442a-ab66-1bf0a847d55f" containerName="main"
Sep 11 19:48:32.964537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.964388    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d92d25-64da-442a-ab66-1bf0a847d55f" containerName="main"
Sep 11 19:48:32.964537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.964453    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d92d25-64da-442a-ab66-1bf0a847d55f" containerName="main"
Sep 11 19:48:32.964537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.964487    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="721f7e25-94f6-4fa3-be00-ce9fc13b81ee" containerName="istio-proxy"
Sep 11 19:48:32.964537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.964498    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93054bf6-bd2a-4c8e-8dc0-4f127e53eaff" containerName="maas-api"
Sep 11 19:48:32.968998 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.968962    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:32.972748 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.972727    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"openshift-service-ca.crt\""
Sep 11 19:48:32.972935 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.972756    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"default-dockercfg-vxzf9\""
Sep 11 19:48:32.972935 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.972806    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"kube-root-ca.crt\""
Sep 11 19:48:32.972935 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.972756    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"premium-w4-c7766c-kserve-self-signed-certs\""
Sep 11 19:48:32.976758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.976541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"]
Sep 11 19:48:32.991519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:32.991496    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:33.067812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.067785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-tmp-dir\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.067914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.067848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzttw\" (UniqueName: \"kubernetes.io/projected/a7d34ea6-30dc-4793-9d80-8bd27588293b-kube-api-access-dzttw\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.067914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.067869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-home\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.067914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.067885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-model-cache\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.067914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.067913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d34ea6-30dc-4793-9d80-8bd27588293b-tls-certs\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.068111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.067965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-dshm\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169280 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzttw\" (UniqueName: \"kubernetes.io/projected/a7d34ea6-30dc-4793-9d80-8bd27588293b-kube-api-access-dzttw\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169280 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-home\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-model-cache\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d34ea6-30dc-4793-9d80-8bd27588293b-tls-certs\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-dshm\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-tmp-dir\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169780 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-home\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-model-cache\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.169886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.169840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-tmp-dir\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.171799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.171773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-dshm\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.171958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.171941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d34ea6-30dc-4793-9d80-8bd27588293b-tls-certs\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.177627 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.177606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzttw\" (UniqueName: \"kubernetes.io/projected/a7d34ea6-30dc-4793-9d80-8bd27588293b-kube-api-access-dzttw\") pod \"premium-w4-c7766c-kserve-6d47f9bc96-g9rwc\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") " pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.279074 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.279048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:33.550733 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.550709    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"]
Sep 11 19:48:33.552689 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:48:33.552662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7d34ea6_30dc_4793_9d80_8bd27588293b.slice/crio-26c626e16dcb8907edca3d3e70124cf7383a6e3ae592322f74864adcbfe23f0d WatchSource:0}: Error finding container 26c626e16dcb8907edca3d3e70124cf7383a6e3ae592322f74864adcbfe23f0d: Status 404 returned error can't find the container with id 26c626e16dcb8907edca3d3e70124cf7383a6e3ae592322f74864adcbfe23f0d
Sep 11 19:48:33.847240 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.847152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc" event={"ID":"a7d34ea6-30dc-4793-9d80-8bd27588293b","Type":"ContainerStarted","Data":"a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64"}
Sep 11 19:48:33.847240 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.847199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc" event={"ID":"a7d34ea6-30dc-4793-9d80-8bd27588293b","Type":"ContainerStarted","Data":"26c626e16dcb8907edca3d3e70124cf7383a6e3ae592322f74864adcbfe23f0d"}
Sep 11 19:48:33.863489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:33.863447    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc" podStartSLOduration=1.863432243 podStartE2EDuration="1.863432243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:48:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:48:33.862789607 +0000 UTC m=+1323.612045182" watchObservedRunningTime="2026-09-11 19:48:33.863432243 +0000 UTC m=+1323.612687814"
Sep 11 19:48:36.449546 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.449503    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"]
Sep 11 19:48:36.453916 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.453895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.456583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.456557    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"kube-root-ca.crt\""
Sep 11 19:48:36.456716 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.456557    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"openshift-service-ca.crt\""
Sep 11 19:48:36.457481 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.457466    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"default-dockercfg-z9db5\""
Sep 11 19:48:36.457798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.457783    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"premium-w0-10cc24-kserve-self-signed-certs\""
Sep 11 19:48:36.462326 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.462298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"]
Sep 11 19:48:36.480222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.480187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:36.599615 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.599581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tls-certs\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.599798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.599664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7r55\" (UniqueName: \"kubernetes.io/projected/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-kube-api-access-s7r55\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.599798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.599704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-model-cache\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.599798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.599770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tmp-dir\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.599798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.599792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-home\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.599973 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.599826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-dshm\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.700876 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.700786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7r55\" (UniqueName: \"kubernetes.io/projected/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-kube-api-access-s7r55\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.700876 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.700827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-model-cache\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.700876 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.700863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tmp-dir\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.701191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.700886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-home\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.701191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.700909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-dshm\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.701191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.700944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tls-certs\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.701414 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.701392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tmp-dir\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.701471 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.701455    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-home\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.701508 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.701488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-model-cache\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.703566 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.703539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-dshm\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.703731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.703712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tls-certs\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.709225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.709205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7r55\" (UniqueName: \"kubernetes.io/projected/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-kube-api-access-s7r55\") pod \"premium-w0-10cc24-kserve-7476b4449f-vhn45\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") " pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:36.766111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:36.766082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:37.035613 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:37.035586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"]
Sep 11 19:48:37.037631 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:48:37.037609    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7d254f7_d5e5_488e_8bbc_dd9918c0ff57.slice/crio-19dfcce41dd5614972d5ade5538d53c145d9e819d8c1a35b2dfcfcbe42789bff WatchSource:0}: Error finding container 19dfcce41dd5614972d5ade5538d53c145d9e819d8c1a35b2dfcfcbe42789bff: Status 404 returned error can't find the container with id 19dfcce41dd5614972d5ade5538d53c145d9e819d8c1a35b2dfcfcbe42789bff
Sep 11 19:48:37.877055 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:37.877014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45" event={"ID":"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57","Type":"ContainerStarted","Data":"a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664"}
Sep 11 19:48:37.877055 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:37.877057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45" event={"ID":"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57","Type":"ContainerStarted","Data":"19dfcce41dd5614972d5ade5538d53c145d9e819d8c1a35b2dfcfcbe42789bff"}
Sep 11 19:48:37.896471 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:37.896429    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45" podStartSLOduration=1.896414589 podStartE2EDuration="1.896414589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:48:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:48:37.895366968 +0000 UTC m=+1327.644622554" watchObservedRunningTime="2026-09-11 19:48:37.896414589 +0000 UTC m=+1327.645670162"
Sep 11 19:48:42.131429 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:42.131396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:42.355627 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:42.355597    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"]
Sep 11 19:48:42.355870 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:42.355837    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" containerID="cri-o://9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c" gracePeriod=30
Sep 11 19:48:42.385069 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:42.385002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:42.807438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:42.807409    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:42.907805 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:42.907774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:43.122368 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:43.122291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:43.221069 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:43.221037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:43.279616 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:43.279583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:43.279804 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:43.279674    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:43.295081 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:43.295057    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:43.691160 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:43.691124    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:43.919342 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:43.919315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:48:45.142427 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:45.142390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:45.195054 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:45.195020    2576 patch_prober.go:28] interesting pod/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:48:45.195179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:45.195091    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:48:45.849317 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:45.849287    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:45.948083 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:45.948055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:46.049720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:46.049680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:46.660700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:46.660663    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:46.766438 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:46.766400    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:46.766605 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:46.766451    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:46.779208 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:46.779184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:46.935761 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:46.935689    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:48:47.407642 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.407609    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:47.609711 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.609687    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:48:47.702321 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702247    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-token\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-socket\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702346    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-credential-socket\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702379    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37affb1a-a748-4416-8ccd-70a07bd526ce-istiod-ca-cert\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702443    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4vl5\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-kube-api-access-h4vl5\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702467    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-certs\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702487    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-podinfo\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702513    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-data\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702651    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:47.702688 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702742    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702745    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-envoy\") pod \"37affb1a-a748-4416-8ccd-70a07bd526ce\" (UID: \"37affb1a-a748-4416-8ccd-70a07bd526ce\") "
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702760    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.702800    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37affb1a-a748-4416-8ccd-70a07bd526ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.703067    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.703079    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.703089    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.703100    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.703206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.703112    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37affb1a-a748-4416-8ccd-70a07bd526ce-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.704742 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.704706    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:48:47.704908 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.704883    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:48:47.705028 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.704973    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:48:47.705206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.705174    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-kube-api-access-h4vl5" (OuterVolumeSpecName: "kube-api-access-h4vl5") pod "37affb1a-a748-4416-8ccd-70a07bd526ce" (UID: "37affb1a-a748-4416-8ccd-70a07bd526ce"). InnerVolumeSpecName "kube-api-access-h4vl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:48:47.804165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.804139    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.804165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.804161    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.804301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.804170    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.804301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.804180    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4vl5\" (UniqueName: \"kubernetes.io/projected/37affb1a-a748-4416-8ccd-70a07bd526ce-kube-api-access-h4vl5\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:48:47.931371 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.931340    2576 generic.go:356] "Generic (PLEG): container finished" podID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerID="9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c" exitCode=0
Sep 11 19:48:47.931486 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.931398    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"
Sep 11 19:48:47.931486 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.931421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" event={"ID":"37affb1a-a748-4416-8ccd-70a07bd526ce","Type":"ContainerDied","Data":"9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c"}
Sep 11 19:48:47.931607 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.931488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf" event={"ID":"37affb1a-a748-4416-8ccd-70a07bd526ce","Type":"ContainerDied","Data":"f1cb1d856476f6f2ab8c4f2ec868da70a20e8243a557069880cdae55d76d3b6e"}
Sep 11 19:48:47.931607 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.931534    2576 scope.go:117] "RemoveContainer" containerID="9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c"
Sep 11 19:48:47.943937 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.943911    2576 scope.go:117] "RemoveContainer" containerID="0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd"
Sep 11 19:48:47.952759 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.952741    2576 scope.go:117] "RemoveContainer" containerID="9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c"
Sep 11 19:48:47.953248 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:48:47.953198    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c\": container with ID starting with 9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c not found: ID does not exist" containerID="9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c"
Sep 11 19:48:47.953329 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.953259    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c"} err="failed to get container status \"9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c\": rpc error: code = NotFound desc = could not find container \"9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c\": container with ID starting with 9666220d5000b165f0b40156348a6f4c7cd85de74393018404fdb1541b9bd35c not found: ID does not exist"
Sep 11 19:48:47.953329 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.953277    2576 scope.go:117] "RemoveContainer" containerID="0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd"
Sep 11 19:48:47.953537 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:48:47.953520    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd\": container with ID starting with 0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd not found: ID does not exist" containerID="0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd"
Sep 11 19:48:47.953574 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.953543    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd"} err="failed to get container status \"0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd\": rpc error: code = NotFound desc = could not find container \"0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd\": container with ID starting with 0138c4677eeda84b8ba632ee0a7270bdcf8cb1e8cb82068affe4675d001052dd not found: ID does not exist"
Sep 11 19:48:47.954928 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.954909    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"]
Sep 11 19:48:47.958439 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:47.958418    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-6bf598-openshift-default-8856d95c4-mplrf"]
Sep 11 19:48:48.251874 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.251845    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:48.730613 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.730563    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" path="/var/lib/kubelet/pods/37affb1a-a748-4416-8ccd-70a07bd526ce/volumes"
Sep 11 19:48:48.989593 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.989523    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"]
Sep 11 19:48:48.989911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.989897    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy"
Sep 11 19:48:48.989957 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.989912    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy"
Sep 11 19:48:48.989957 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.989924    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy"
Sep 11 19:48:48.989957 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.989930    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy"
Sep 11 19:48:48.990073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.990011    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy"
Sep 11 19:48:48.994335 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.994304    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:48.997186 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:48.997155    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a29559-serving-cert\""
Sep 11 19:48:49.008522 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.008499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"]
Sep 11 19:48:49.028474 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.028451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:49.117579 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.117550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-maas-api-tls\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.117745 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.117588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84592a45-b691-44d2-9450-d671a4b3d976-openshift-service-ca\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.117745 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.117611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-metrics-certs\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.117745 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.117724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6db5\" (UniqueName: \"kubernetes.io/projected/84592a45-b691-44d2-9450-d671a4b3d976-kube-api-access-r6db5\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.127680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.127654    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:49.219169 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.219144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-maas-api-tls\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.219301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.219188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84592a45-b691-44d2-9450-d671a4b3d976-openshift-service-ca\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.219301 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.219219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-metrics-certs\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.219417 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.219297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6db5\" (UniqueName: \"kubernetes.io/projected/84592a45-b691-44d2-9450-d671a4b3d976-kube-api-access-r6db5\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.219878 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.219855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84592a45-b691-44d2-9450-d671a4b3d976-openshift-service-ca\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.221868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.221843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-metrics-certs\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.221946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.221891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-maas-api-tls\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.225853 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.225829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:49.228100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.228078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6db5\" (UniqueName: \"kubernetes.io/projected/84592a45-b691-44d2-9450-d671a4b3d976-kube-api-access-r6db5\") pod \"maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.308173 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.308111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:49.580862 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.580793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"]
Sep 11 19:48:49.583361 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:48:49.583333    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84592a45_b691_44d2_9450_d671a4b3d976.slice/crio-37331b1046baa9bcd0f1c622726354b592b2d4770641ed6510904d1915e5b46b WatchSource:0}: Error finding container 37331b1046baa9bcd0f1c622726354b592b2d4770641ed6510904d1915e5b46b: Status 404 returned error can't find the container with id 37331b1046baa9bcd0f1c622726354b592b2d4770641ed6510904d1915e5b46b
Sep 11 19:48:49.605490 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.605459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:49.703322 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.703296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:49.910742 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.910651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:49.945468 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:49.945438    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb" event={"ID":"84592a45-b691-44d2-9450-d671a4b3d976","Type":"ContainerStarted","Data":"37331b1046baa9bcd0f1c622726354b592b2d4770641ed6510904d1915e5b46b"}
Sep 11 19:48:50.071565 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.071523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:50.165577 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.165492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:50.817700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.817661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:50.907616 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.907578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:50.952207 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.952180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb" event={"ID":"84592a45-b691-44d2-9450-d671a4b3d976","Type":"ContainerStarted","Data":"0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068"}
Sep 11 19:48:50.952556 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.952232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:50.971515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.971468    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb" podStartSLOduration=2.614951305 podStartE2EDuration="2.97145452s" totalImagesPullingTime="356.503215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:48:50.969370732 +0000 UTC m=+1340.718626318" watchObservedRunningTime="2026-09-11 19:48:50.97145452 +0000 UTC m=+1340.720710094"
Sep 11 19:48:50.982966 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:50.982934    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:52.456443 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:52.456354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:56.963325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:56.963299    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:48:58.559832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:58.559798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:58.637404 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:58.637379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:48:59.312369 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:48:59.312336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:05.173193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:05.173157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:05.274811 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:05.274775    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:05.401232 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:05.401196    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:05.711532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:05.711498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:05.816190 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:05.816153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:08.653647 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.653609    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"]
Sep 11 19:49:08.654186 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.654167    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="37affb1a-a748-4416-8ccd-70a07bd526ce" containerName="istio-proxy"
Sep 11 19:49:08.657532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.657512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.660977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.660953    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"test-model-872425-kserve-self-signed-certs\""
Sep 11 19:49:08.660977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.660969    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"default-dockercfg-k4t55\""
Sep 11 19:49:08.661178 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.661050    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"openshift-service-ca.crt\""
Sep 11 19:49:08.661178 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.661064    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"kube-root-ca.crt\""
Sep 11 19:49:08.665311 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.665287    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"]
Sep 11 19:49:08.783542 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.783515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e0b567-af50-4b83-ac91-27e63efa8911-tls-certs\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.783665 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.783550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-tmp-dir\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.783665 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.783577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5ds\" (UniqueName: \"kubernetes.io/projected/d2e0b567-af50-4b83-ac91-27e63efa8911-kube-api-access-jz5ds\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.783665 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.783613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-model-cache\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.783665 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.783655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-home\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.783803 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.783781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-dshm\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885183 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-dshm\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e0b567-af50-4b83-ac91-27e63efa8911-tls-certs\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-tmp-dir\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5ds\" (UniqueName: \"kubernetes.io/projected/d2e0b567-af50-4b83-ac91-27e63efa8911-kube-api-access-jz5ds\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885479 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-model-cache\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885479 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-home\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-tmp-dir\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885663 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-model-cache\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.885731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.885712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-home\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.887758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.887726    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-dshm\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.888010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.887965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e0b567-af50-4b83-ac91-27e63efa8911-tls-certs\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.893801 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.893775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5ds\" (UniqueName: \"kubernetes.io/projected/d2e0b567-af50-4b83-ac91-27e63efa8911-kube-api-access-jz5ds\") pod \"test-model-872425-kserve-74cdb59d5c-j8g7k\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") " pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:08.953953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.953893    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:08.969418 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:08.969396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:09.240829 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:09.240753    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"]
Sep 11 19:49:09.243312 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:49:09.243275    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2e0b567_af50_4b83_ac91_27e63efa8911.slice/crio-151302b16e34d34ee35a720765f205691ac832c07039c62d895606135835a2f9 WatchSource:0}: Error finding container 151302b16e34d34ee35a720765f205691ac832c07039c62d895606135835a2f9: Status 404 returned error can't find the container with id 151302b16e34d34ee35a720765f205691ac832c07039c62d895606135835a2f9
Sep 11 19:49:10.056395 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:10.056356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k" event={"ID":"d2e0b567-af50-4b83-ac91-27e63efa8911","Type":"ContainerStarted","Data":"91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed"}
Sep 11 19:49:10.056868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:10.056411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k" event={"ID":"d2e0b567-af50-4b83-ac91-27e63efa8911","Type":"ContainerStarted","Data":"151302b16e34d34ee35a720765f205691ac832c07039c62d895606135835a2f9"}
Sep 11 19:49:10.075720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:10.075661    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k" podStartSLOduration=2.075640723 podStartE2EDuration="2.075640723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:49:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:49:10.073973181 +0000 UTC m=+1359.823228770" watchObservedRunningTime="2026-09-11 19:49:10.075640723 +0000 UTC m=+1359.824896298"
Sep 11 19:49:11.186813 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:11.186781    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:11.556275 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:11.556232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:11.648946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:11.648907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:12.081620 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:12.081587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:12.932375 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:12.932335    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:13.708460 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:13.708419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:14.577151 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:14.577117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:15.435742 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:15.435706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:15.830692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:15.830656    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:16.352365 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.352334    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"]
Sep 11 19:49:16.357291 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.357272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.359694 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.359672    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-02df91be-serving-cert\""
Sep 11 19:49:16.366103 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.366079    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"]
Sep 11 19:49:16.389971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.389945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:16.449446 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.449416    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:16.456840 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.456815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2869\" (UniqueName: \"kubernetes.io/projected/f69db861-81d8-473d-ab5a-ee4cee28799e-kube-api-access-m2869\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.456958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.456857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69db861-81d8-473d-ab5a-ee4cee28799e-openshift-service-ca\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.456958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.456884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-metrics-certs\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.457099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.457056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.558534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.558504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69db861-81d8-473d-ab5a-ee4cee28799e-openshift-service-ca\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.558709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.558548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-metrics-certs\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.558709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.558596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.558709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.558696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2869\" (UniqueName: \"kubernetes.io/projected/f69db861-81d8-473d-ab5a-ee4cee28799e-kube-api-access-m2869\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.558880 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:49:16.558813    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-serving-cert: secret "maas-api-e2e-mt-02df91be-serving-cert" not found
Sep 11 19:49:16.558936 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:49:16.558890    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls podName:f69db861-81d8-473d-ab5a-ee4cee28799e nodeName:}" failed. No retries permitted until 2026-09-11 19:49:17.058866449 +0000 UTC m=+1366.808122014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls") pod "maas-api-e2e-mt-02df91be-68c778b98c-nw2ss" (UID: "f69db861-81d8-473d-ab5a-ee4cee28799e") : secret "maas-api-e2e-mt-02df91be-serving-cert" not found
Sep 11 19:49:16.559209 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.559188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69db861-81d8-473d-ab5a-ee4cee28799e-openshift-service-ca\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.561321 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.561289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-metrics-certs\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.569613 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.569581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2869\" (UniqueName: \"kubernetes.io/projected/f69db861-81d8-473d-ab5a-ee4cee28799e-kube-api-access-m2869\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:16.867311 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.867273    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:16.965341 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:16.965307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:17.063349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:17.063312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:17.065729 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:17.065708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls\") pod \"maas-api-e2e-mt-02df91be-68c778b98c-nw2ss\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:17.273243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:17.273200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:17.323676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:17.323643    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:17.553670 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:17.553646    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"]
Sep 11 19:49:17.555504 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:49:17.555482    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69db861_81d8_473d_ab5a_ee4cee28799e.slice/crio-89f6857f500f62447ab9ef394aa41f02b011cc23c0b757b9e5c786a5e93f1691 WatchSource:0}: Error finding container 89f6857f500f62447ab9ef394aa41f02b011cc23c0b757b9e5c786a5e93f1691: Status 404 returned error can't find the container with id 89f6857f500f62447ab9ef394aa41f02b011cc23c0b757b9e5c786a5e93f1691
Sep 11 19:49:18.100050 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:18.100017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss" event={"ID":"f69db861-81d8-473d-ab5a-ee4cee28799e","Type":"ContainerStarted","Data":"89f6857f500f62447ab9ef394aa41f02b011cc23c0b757b9e5c786a5e93f1691"}
Sep 11 19:49:18.196099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:18.196059    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:18.970132 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:18.970097    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:18.970297 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:18.970144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:18.982544 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:18.982522    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:19.106647 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:19.106607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss" event={"ID":"f69db861-81d8-473d-ab5a-ee4cee28799e","Type":"ContainerStarted","Data":"785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30"}
Sep 11 19:49:19.107125 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:19.106933    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:19.118300 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:19.118270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:49:19.130920 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:19.130858    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss" podStartSLOduration=2.638955262 podStartE2EDuration="3.130837933s" totalImagesPullingTime="491.882671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:49:19.129041114 +0000 UTC m=+1368.878296709" watchObservedRunningTime="2026-09-11 19:49:19.130837933 +0000 UTC m=+1368.880093507"
Sep 11 19:49:25.117430 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:25.117400    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:30.948931 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:30.948898    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:38.746762 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:38.746705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:39.636615 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:39.636582    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:40.345253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:40.345216    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:41.031181 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:41.031145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:41.601207 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:41.601174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:41.825309 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:41.825258    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:42.237753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:42.237703    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:42.338534 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:42.338503    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:42.631646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:42.631552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:42.732785 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:42.732754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:43.334523 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:43.334487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:43.984644 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:43.984611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:48.322031 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:48.321971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:48.423597 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:48.423560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:49.724288 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:49.724259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:50.628341 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:50.628309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:51.539777 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:51.539739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:52.261642 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:52.261603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:53.031270 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:53.031225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:53.945304 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:53.945264    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:54.644025 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:54.643968    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:59.374771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.374738    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"]
Sep 11 19:49:59.375303 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.375031    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss" podUID="f69db861-81d8-473d-ab5a-ee4cee28799e" containerName="maas-api" containerID="cri-o://785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30" gracePeriod=30
Sep 11 19:49:59.408712 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.408672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:59.480003 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.479950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:59.564602 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.564540    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:59.627334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.627283    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:49:59.628777 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.628748    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:49:59.730467 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.730435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69db861-81d8-473d-ab5a-ee4cee28799e-openshift-service-ca\") pod \"f69db861-81d8-473d-ab5a-ee4cee28799e\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") "
Sep 11 19:49:59.730609 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.730556    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-metrics-certs\") pod \"f69db861-81d8-473d-ab5a-ee4cee28799e\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") "
Sep 11 19:49:59.730609 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.730591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls\") pod \"f69db861-81d8-473d-ab5a-ee4cee28799e\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") "
Sep 11 19:49:59.730729 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.730625    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2869\" (UniqueName: \"kubernetes.io/projected/f69db861-81d8-473d-ab5a-ee4cee28799e-kube-api-access-m2869\") pod \"f69db861-81d8-473d-ab5a-ee4cee28799e\" (UID: \"f69db861-81d8-473d-ab5a-ee4cee28799e\") "
Sep 11 19:49:59.730822 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.730794    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f69db861-81d8-473d-ab5a-ee4cee28799e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f69db861-81d8-473d-ab5a-ee4cee28799e" (UID: "f69db861-81d8-473d-ab5a-ee4cee28799e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:49:59.731001 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.730965    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f69db861-81d8-473d-ab5a-ee4cee28799e-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:49:59.732820 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.732788    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69db861-81d8-473d-ab5a-ee4cee28799e-kube-api-access-m2869" (OuterVolumeSpecName: "kube-api-access-m2869") pod "f69db861-81d8-473d-ab5a-ee4cee28799e" (UID: "f69db861-81d8-473d-ab5a-ee4cee28799e"). InnerVolumeSpecName "kube-api-access-m2869". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:49:59.733123 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.733107    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f69db861-81d8-473d-ab5a-ee4cee28799e" (UID: "f69db861-81d8-473d-ab5a-ee4cee28799e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:49:59.733214 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.733186    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f69db861-81d8-473d-ab5a-ee4cee28799e" (UID: "f69db861-81d8-473d-ab5a-ee4cee28799e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:49:59.832352 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.832317    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:49:59.832352 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.832346    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f69db861-81d8-473d-ab5a-ee4cee28799e-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:49:59.832352 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.832356    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2869\" (UniqueName: \"kubernetes.io/projected/f69db861-81d8-473d-ab5a-ee4cee28799e-kube-api-access-m2869\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:49:59.992080 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:49:59.992043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:00.104341 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.104302    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:00.323208 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.323127    2576 generic.go:356] "Generic (PLEG): container finished" podID="f69db861-81d8-473d-ab5a-ee4cee28799e" containerID="785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30" exitCode=0
Sep 11 19:50:00.323208 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.323173    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"
Sep 11 19:50:00.323451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.323213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss" event={"ID":"f69db861-81d8-473d-ab5a-ee4cee28799e","Type":"ContainerDied","Data":"785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30"}
Sep 11 19:50:00.323451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.323272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss" event={"ID":"f69db861-81d8-473d-ab5a-ee4cee28799e","Type":"ContainerDied","Data":"89f6857f500f62447ab9ef394aa41f02b011cc23c0b757b9e5c786a5e93f1691"}
Sep 11 19:50:00.323451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.323302    2576 scope.go:117] "RemoveContainer" containerID="785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30"
Sep 11 19:50:00.333565 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.333551    2576 scope.go:117] "RemoveContainer" containerID="785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30"
Sep 11 19:50:00.333869 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:50:00.333852    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30\": container with ID starting with 785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30 not found: ID does not exist" containerID="785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30"
Sep 11 19:50:00.333919 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.333876    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30"} err="failed to get container status \"785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30\": rpc error: code = NotFound desc = could not find container \"785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30\": container with ID starting with 785c76dd3c316ed094cbc54896b3fbec84c76d23311ec248c621f2ac04ee0c30 not found: ID does not exist"
Sep 11 19:50:00.344375 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.344351    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"]
Sep 11 19:50:00.348260 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.348237    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-02df91be-68c778b98c-nw2ss"]
Sep 11 19:50:00.727692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.727662    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69db861-81d8-473d-ab5a-ee4cee28799e" path="/var/lib/kubelet/pods/f69db861-81d8-473d-ab5a-ee4cee28799e/volumes"
Sep 11 19:50:00.924378 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:00.924351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:01.739383 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:01.739349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:02.428348 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:02.428309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:03.168946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:03.168909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:03.945542 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:03.945502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:05.736011 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:05.735960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:05.797693 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:05.797664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:05.996595 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:05.996512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:12.118746 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:12.118715    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:16.370912 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:16.370879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:16.481976 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:16.481943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:16.594766 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:16.594733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:19.206031 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:19.205972    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:20.243492 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:20.243448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:20.613192 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:50:20.613108    2576 controller.go:195] "Failed to update lease" err="Put \"https://a967f5d11ae1742838df16b28457a97d-ce4c780847635e77.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-171.ec2.internal?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:50:20.925059 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:20.924968    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:22.461698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:22.461614    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:22.571029 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:22.570982    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:22.660644 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:22.660614    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:22.791053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:22.790982    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:28.525537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:28.525506    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:28.586131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:28.586092    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:29.428517 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:29.428484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:29.739179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:29.739144    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:30.055302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:30.055217    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:30.614041 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:50:30.613981    2576 controller.go:195] "Failed to update lease" err="Put \"https://a967f5d11ae1742838df16b28457a97d-ce4c780847635e77.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-171.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:50:39.055687 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:39.055651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:39.523433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:39.523395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:40.615054 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:50:40.614959    2576 controller.go:195] "Failed to update lease" err="Put \"https://a967f5d11ae1742838df16b28457a97d-ce4c780847635e77.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-171.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:50:40.710802 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:50:40.710760    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T19:50:30Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T19:50:30Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T19:50:30Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-11T19:50:30Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-130-171.ec2.internal\": Patch \"https://a967f5d11ae1742838df16b28457a97d-ce4c780847635e77.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-130-171.ec2.internal/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:50:43.056861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:43.056831    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:43.331105 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:43.331026    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:44.140170 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:44.140129    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:44.860963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:44.860930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:45.524104 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:45.524066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:46.222596 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:46.222562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:47.151588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:47.151554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:47.837651 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:47.837617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:48.904168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904129    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904130    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904139    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904185    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904184    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tlnfp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904223    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904220    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904240    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904260    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"default-dockercfg-z9db5\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904263    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904267    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904271    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kxtl7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904295    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904282    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"default-dockercfg-k4t55\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904308    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904324    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904330    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904339    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904370    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nfn9q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904366    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nfll6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.904643 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904431    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x76hz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904439    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904451    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"default-dockercfg-zjpp2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904475    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904489    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904500    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-872425-openshift-default-dockercfg-qb8bv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904513    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904523    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904532    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904542    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904570    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904579    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904576    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2rjxh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904588    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904609    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904617    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904619    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904635    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.905548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904652    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rm699\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904663    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a29559-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904676    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904680    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jxgmf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904689    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904701    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904715    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-fllr391hqg207\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904722    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wvb6b\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904741    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904750    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904756    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904767    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2glhs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904757    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904784    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904810    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904817    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sc9kv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904824    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904840    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906355 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:50:48.904840    2576 controller.go:195] "Failed to update lease" err="Put \"https://a967f5d11ae1742838df16b28457a97d-ce4c780847635e77.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-171.ec2.internal?timeout=10s\": http2: client connection lost"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904855    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-10cc24-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904860    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904875    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904889    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904894    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904898    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-872425-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904923    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904888    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904934    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5cl97\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904938    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904948    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.904972    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rdq9p\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905011    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905024    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905025    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905053    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7wl7q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905058    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"premium-w4-c7766c-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.906914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905062    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k4fsc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905078    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905080    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905102    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pfbwm\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905119    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905132    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-aqqoab1drfqd8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905138    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g4bbn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905159    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905168    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905169    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905181    2576 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905199    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905204    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905206    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905207    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jc4qx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905218    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dmm5l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905219    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905237    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.907520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905235    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905248    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905237    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905238    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905253    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905269    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905273    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905232    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905274    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905293    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905297    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"signing-key\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905291    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905313    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfkst\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905320    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"premium-w0-10cc24-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905321    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905333    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905318    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905339    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905347    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905333    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ndnhc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905343    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905359    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"default-dockercfg-vxzf9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905349    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905381    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905383    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905390    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wqcq9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905389    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905400    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905389    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905405    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9vcq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905420    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905424    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905436    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905446    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905448    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905459    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-46jqv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.908676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905421    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7kkw4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905471    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f99f\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905481    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905486    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905491    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hvn79\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905490    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8q9lb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905507    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905512    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905486    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905512    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c7766c-openshift-default-dockercfg-sl2kb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905518    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905534    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r9785\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905528    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905461    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905535    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905550    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905562    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"test-model-872425-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905574    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905578    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905585    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s6r98\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905594    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905602    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905618    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sj6d6\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905622    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905620    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905632    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-299kh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905628    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mtlf7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905598    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905646    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905647    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905640    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905663    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k5mwl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905664    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905679    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905685    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905686    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.909821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905697    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905707    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905714    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905716    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905728    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-9kmr9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905740    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905742    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905716    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:48.910385 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:48.905751    2576 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Sep 11 19:50:49.711485 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.711456    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 19:50:49.711651 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.711486    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.711651 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.711527    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 19:50:49.732064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.732037    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2f99f\""
Sep 11 19:50:49.735583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.735561    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 19:50:49.745373 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.745351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 19:50:49.745531 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.745517    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.748700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.748682    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.749349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.749333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"premium-w0-10cc24-kserve-self-signed-certs\""
Sep 11 19:50:49.752289 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.752272    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.754678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.754658    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.754784 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.754732    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.764775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.764746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ndnhc\""
Sep 11 19:50:49.768527 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.768509    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.774773 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.774751    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 19:50:49.786378 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.786363    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 19:50:49.792803 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.792780    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.798595 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.798577    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w9vcq\""
Sep 11 19:50:49.802887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.802873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 19:50:49.809215 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.809201    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.813665 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.813648    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 19:50:49.836182 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.836160    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 19:50:49.836249 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.836187    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 19:50:49.836781 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.836767    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 19:50:49.838347 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.838333    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.839114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.839101    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.848937 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.848922    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.851783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.851769    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.855037 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.855019    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 19:50:49.855101 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.855047    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 19:50:49.857736 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.857705    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 19:50:49.860333 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.860315    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k4fsc\""
Sep 11 19:50:49.860435 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.860420    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 19:50:49.872729 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.872708    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.873746 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.873723    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.873818 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.873783    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.873818 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.873791    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 19:50:49.877947 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.877932    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a29559-serving-cert\""
Sep 11 19:50:49.888311 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.888283    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 19:50:49.895214 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.895194    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 19:50:49.897722 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.897705    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 19:50:49.899061 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.899047    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 19:50:49.901064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.901047    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.908906 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.908890    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 19:50:49.912722 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.912708    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 19:50:49.917658 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.917644    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9kmr9\""
Sep 11 19:50:49.933382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.933363    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.940539 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.940515    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pfbwm\""
Sep 11 19:50:49.941853 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.941839    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-10cc24-serving-cert\""
Sep 11 19:50:49.944289 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.944255    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 19:50:49.944386 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.944343    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 19:50:49.945550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.945535    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"openshift-service-ca.crt\""
Sep 11 19:50:49.946912 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.946898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s6r98\""
Sep 11 19:50:49.949349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.949335    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"test-model-872425-kserve-self-signed-certs\""
Sep 11 19:50:49.956270 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.956254    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 19:50:49.962416 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.962375    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 19:50:49.967590 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.967576    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wvb6b\""
Sep 11 19:50:49.972758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.972743    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 19:50:49.982956 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.982940    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 19:50:49.988953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.988936    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-872425-serving-cert\""
Sep 11 19:50:49.996052 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:49.996035    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zjpp2\""
Sep 11 19:50:50.006914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.006899    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 19:50:50.008137 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.008121    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"default-dockercfg-z9db5\""
Sep 11 19:50:50.009359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.009346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 19:50:50.021567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.021549    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 19:50:50.024257 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.024241    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 19:50:50.028475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.028460    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rdq9p\""
Sep 11 19:50:50.042902 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.042881    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"default-dockercfg-vxzf9\""
Sep 11 19:50:50.044497 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.044481    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 19:50:50.044595 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.044550    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7kkw4\""
Sep 11 19:50:50.045421 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.045406    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"premium-w4-c7766c-kserve-self-signed-certs\""
Sep 11 19:50:50.046877 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.046863    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 19:50:50.050795 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.050781    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.053508 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.053494    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2rjxh\""
Sep 11 19:50:50.056337 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.056324    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.057367 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.057354    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 19:50:50.057639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.057623    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:50:50.072973 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.072956    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.075646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.075630    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 19:50:50.077526 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.077512    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.084401 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.084386    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-aqqoab1drfqd8\""
Sep 11 19:50:50.107774 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.107753    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.109633 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.109619    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sc9kv\""
Sep 11 19:50:50.117292 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.117277    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.128551 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.128533    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 19:50:50.128647 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.128633    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nfll6\""
Sep 11 19:50:50.134364 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.134350    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.144887 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.144869    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.144971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.144919    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 19:50:50.148086 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.148069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfkst\""
Sep 11 19:50:50.153328 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.153311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dmm5l\""
Sep 11 19:50:50.157553 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.157535    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.159050 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.159034    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 19:50:50.159116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.159068    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.160679 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.160664    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.163156 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.163135    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 19:50:50.163902 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.163888    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 19:50:50.168576 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.168559    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.168671 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.168584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 19:50:50.170114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.170098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mtlf7\""
Sep 11 19:50:50.171969 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.171955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:50:50.175038 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.175023    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 19:50:50.179384 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.179367    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 19:50:50.179384 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.179381    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 19:50:50.185188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.185173    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jc4qx\""
Sep 11 19:50:50.185252 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.185224    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.190483 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.190470    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:50:50.191586 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.191574    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.198800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.198783    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.198890 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.198811    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 19:50:50.201419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.201405    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 19:50:50.205441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.205425    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.214731 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.214673    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c7766c-openshift-default-dockercfg-sl2kb\""
Sep 11 19:50:50.215707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.215691    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.217835 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.217818    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 19:50:50.230112 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.230092    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r9785\""
Sep 11 19:50:50.232844 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.232830    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 19:50:50.241083 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.241065    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 19:50:50.244087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.244073    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 19:50:50.249382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.249366    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kxtl7\""
Sep 11 19:50:50.253443 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.253428    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wqcq9\""
Sep 11 19:50:50.254485 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.254469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k5mwl\""
Sep 11 19:50:50.255277 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.255262    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nfn9q\""
Sep 11 19:50:50.257634 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.257617    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 19:50:50.266694 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.266681    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.280072 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.280054    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hvn79\""
Sep 11 19:50:50.282943 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.282928    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 19:50:50.284267 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.284254    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fllr391hqg207\""
Sep 11 19:50:50.291559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.291545    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.311377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.311357    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.339776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.339750    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 19:50:50.342604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.342578    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"]
Sep 11 19:50:50.342961 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.342949    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69db861-81d8-473d-ab5a-ee4cee28799e" containerName="maas-api"
Sep 11 19:50:50.343017 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.342963    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69db861-81d8-473d-ab5a-ee4cee28799e" containerName="maas-api"
Sep 11 19:50:50.343076 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.343067    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69db861-81d8-473d-ab5a-ee4cee28799e" containerName="maas-api"
Sep 11 19:50:50.346193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.346179    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.351609 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.351592    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.371562 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.371547    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5cl97\""
Sep 11 19:50:50.392087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.392066    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-872425\"/\"default-dockercfg-k4t55\""
Sep 11 19:50:50.412145 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.412128    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.431936 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.431919    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-299kh\""
Sep 11 19:50:50.451695 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.451678    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 19:50:50.460414 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76403f8-c234-4158-b368-8efdd870f10e-istio-podinfo\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460479 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-data\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460479 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-credential-socket\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460557 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-envoy\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460557 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-istio-token\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsj7\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-kube-api-access-qdsj7\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-certs\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76403f8-c234-4158-b368-8efdd870f10e-istiod-ca-cert\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.460751 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.460659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-socket\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.471666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.471648    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:50:50.491608 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.491593    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sj6d6\""
Sep 11 19:50:50.511697 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.511683    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 19:50:50.531968 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.531949    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.561837 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.561813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-istio-token\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.561932 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.561847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsj7\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-kube-api-access-qdsj7\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.561932 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.561877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-certs\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.561932 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.561908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76403f8-c234-4158-b368-8efdd870f10e-istiod-ca-cert\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.561954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-socket\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76403f8-c234-4158-b368-8efdd870f10e-istio-podinfo\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-data\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-credential-socket\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562326 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-envoy\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562326 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562312    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-certs\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562428 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-socket\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562488 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-data\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562488 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-credential-socket\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.562714 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.562693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76403f8-c234-4158-b368-8efdd870f10e-istiod-ca-cert\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.564514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.564496    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76403f8-c234-4158-b368-8efdd870f10e-istio-podinfo\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.564608 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.564500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-envoy\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:50.571454 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.571433    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-d14d7e-openshift-default-dockercfg-j2m26\""
Sep 11 19:50:50.596770 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.596728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x76hz\""
Sep 11 19:50:50.611376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.611353    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8q9lb\""
Sep 11 19:50:50.631975 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.631955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 19:50:50.651322 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.651299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.671685 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.671667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.691391 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.691370    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tlnfp\""
Sep 11 19:50:50.712065 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.712048    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:50:50.731476 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.731424    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2glhs\""
Sep 11 19:50:50.751928 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.751903    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 19:50:50.771602 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.771579    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 19:50:50.792024 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.791981    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 19:50:50.811353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.811331    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.831709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.831679    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-872425-openshift-default-dockercfg-qb8bv\""
Sep 11 19:50:50.851947 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.851929    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 19:50:50.871747 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.871725    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:50.894734 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.894703    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:50:50.912170 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.912150    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 19:50:50.931706 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.931686    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g4bbn\""
Sep 11 19:50:50.951842 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.951825    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 19:50:50.971946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.971922    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 19:50:50.991672 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:50.991622    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-46jqv\""
Sep 11 19:50:51.011312 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.011293    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:50:51.031720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.031697    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jxgmf\""
Sep 11 19:50:51.050942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.050914    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 19:50:51.071271 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.071251    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 19:50:51.092020 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.091982    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 19:50:51.111288 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.111270    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 19:50:51.131456 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.131440    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 19:50:51.151855 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.151837    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"kube-root-ca.crt\""
Sep 11 19:50:51.171773 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.171757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7wl7q\""
Sep 11 19:50:51.191396 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.191379    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rm699\""
Sep 11 19:50:51.236628 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.236606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsj7\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-kube-api-access-qdsj7\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:51.255872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.255818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-istio-token\") pod \"e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") " pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:51.556488 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.556425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:51.835221 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.835198    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"]
Sep 11 19:50:51.836598 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:50:51.836568    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76403f8_c234_4158_b368_8efdd870f10e.slice/crio-4a919bcbb5a7221c13625e794b9018ff084361985eafa03bdd934d4da517503f WatchSource:0}: Error finding container 4a919bcbb5a7221c13625e794b9018ff084361985eafa03bdd934d4da517503f: Status 404 returned error can't find the container with id 4a919bcbb5a7221c13625e794b9018ff084361985eafa03bdd934d4da517503f
Sep 11 19:50:51.838835 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.838798    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:50:51.838921 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.838866    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:50:51.838921 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:51.838895    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:50:52.613793 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:52.613750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" event={"ID":"c76403f8-c234-4158-b368-8efdd870f10e","Type":"ContainerStarted","Data":"5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713"}
Sep 11 19:50:52.614212 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:52.613826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" event={"ID":"c76403f8-c234-4158-b368-8efdd870f10e","Type":"ContainerStarted","Data":"4a919bcbb5a7221c13625e794b9018ff084361985eafa03bdd934d4da517503f"}
Sep 11 19:50:52.635460 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:52.635400    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podStartSLOduration=23.635380347 podStartE2EDuration="23.635380347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:50:52.632345975 +0000 UTC m=+1462.381601578" watchObservedRunningTime="2026-09-11 19:50:52.635380347 +0000 UTC m=+1462.384635930"
Sep 11 19:50:53.557216 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:53.557179    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:53.562184 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:53.562159    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:53.619001 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:53.618962    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:53.619783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:53.619769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:50:53.738428 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:53.738389    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:53.871522 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:53.871449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:54.325809 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:54.325776    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:54.541048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:54.541016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:54.646642 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:54.646577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:55.331243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:55.331212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:55.867624 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:55.867594    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:56.432611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:56.432583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:57.292039 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:57.292007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:57.387050 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:57.387018    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"]
Sep 11 19:50:57.424971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:57.424942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:58.531971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:58.531931    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:59.211514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.211483    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"]
Sep 11 19:50:59.211749 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.211723    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb" podUID="84592a45-b691-44d2-9450-d671a4b3d976" containerName="maas-api" containerID="cri-o://0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068" gracePeriod=30
Sep 11 19:50:59.241445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.241412    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:59.310382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.310341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:59.376326 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.376274    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:59.467252 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.467234    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:50:59.473176 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.473137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:59.544351 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.544326    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-metrics-certs\") pod \"84592a45-b691-44d2-9450-d671a4b3d976\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") "
Sep 11 19:50:59.544776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.544383    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84592a45-b691-44d2-9450-d671a4b3d976-openshift-service-ca\") pod \"84592a45-b691-44d2-9450-d671a4b3d976\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") "
Sep 11 19:50:59.544776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.544417    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-maas-api-tls\") pod \"84592a45-b691-44d2-9450-d671a4b3d976\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") "
Sep 11 19:50:59.544776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.544442    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6db5\" (UniqueName: \"kubernetes.io/projected/84592a45-b691-44d2-9450-d671a4b3d976-kube-api-access-r6db5\") pod \"84592a45-b691-44d2-9450-d671a4b3d976\" (UID: \"84592a45-b691-44d2-9450-d671a4b3d976\") "
Sep 11 19:50:59.544958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.544803    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84592a45-b691-44d2-9450-d671a4b3d976-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84592a45-b691-44d2-9450-d671a4b3d976" (UID: "84592a45-b691-44d2-9450-d671a4b3d976"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:50:59.546490 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.546442    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:59.547105 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.547070    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84592a45-b691-44d2-9450-d671a4b3d976" (UID: "84592a45-b691-44d2-9450-d671a4b3d976"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:50:59.547210 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.547156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84592a45-b691-44d2-9450-d671a4b3d976-kube-api-access-r6db5" (OuterVolumeSpecName: "kube-api-access-r6db5") pod "84592a45-b691-44d2-9450-d671a4b3d976" (UID: "84592a45-b691-44d2-9450-d671a4b3d976"). InnerVolumeSpecName "kube-api-access-r6db5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:50:59.547210 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.547183    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "84592a45-b691-44d2-9450-d671a4b3d976" (UID: "84592a45-b691-44d2-9450-d671a4b3d976"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:50:59.620489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.620463    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:50:59.646879 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.646846    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.646879 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.646881    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84592a45-b691-44d2-9450-d671a4b3d976-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.647139 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.646898    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84592a45-b691-44d2-9450-d671a4b3d976-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.647139 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.646912    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6db5\" (UniqueName: \"kubernetes.io/projected/84592a45-b691-44d2-9450-d671a4b3d976-kube-api-access-r6db5\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:50:59.652827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.652787    2576 generic.go:356] "Generic (PLEG): container finished" podID="84592a45-b691-44d2-9450-d671a4b3d976" containerID="0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068" exitCode=0
Sep 11 19:50:59.652965 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.652884    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb" event={"ID":"84592a45-b691-44d2-9450-d671a4b3d976","Type":"ContainerDied","Data":"0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068"}
Sep 11 19:50:59.652965 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.652932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb" event={"ID":"84592a45-b691-44d2-9450-d671a4b3d976","Type":"ContainerDied","Data":"37331b1046baa9bcd0f1c622726354b592b2d4770641ed6510904d1915e5b46b"}
Sep 11 19:50:59.652965 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.652960    2576 scope.go:117] "RemoveContainer" containerID="0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068"
Sep 11 19:50:59.653176 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.653149    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"
Sep 11 19:50:59.687740 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.687173    2576 scope.go:117] "RemoveContainer" containerID="0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068"
Sep 11 19:50:59.687740 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:50:59.687557    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068\": container with ID starting with 0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068 not found: ID does not exist" containerID="0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068"
Sep 11 19:50:59.687740 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.687584    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068"} err="failed to get container status \"0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068\": rpc error: code = NotFound desc = could not find container \"0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068\": container with ID starting with 0ef8ac5f0729344a4c74ba6967b1dec19de5b2cc696e9b3866514ba0eeb0e068 not found: ID does not exist"
Sep 11 19:50:59.697214 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.697186    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"]
Sep 11 19:50:59.700466 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:50:59.700443    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a29559-5888c7fdb6-4gjvb"]
Sep 11 19:51:00.729159 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:00.729128    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84592a45-b691-44d2-9450-d671a4b3d976" path="/var/lib/kubelet/pods/84592a45-b691-44d2-9450-d671a4b3d976/volumes"
Sep 11 19:51:00.783975 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:00.783943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:01.537954 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:01.537922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:02.221635 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:02.221597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:03.123293 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:03.123263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:03.793102 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:03.793070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:04.614713 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:04.614679    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:06.211567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:06.211513    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:06.314577 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:06.314542    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:06.452755 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:06.452705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:06.860256 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:06.860222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:07.124569 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.124475    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"]
Sep 11 19:51:07.125106 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.125087    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84592a45-b691-44d2-9450-d671a4b3d976" containerName="maas-api"
Sep 11 19:51:07.125177 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.125110    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84592a45-b691-44d2-9450-d671a4b3d976" containerName="maas-api"
Sep 11 19:51:07.125234 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.125215    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84592a45-b691-44d2-9450-d671a4b3d976" containerName="maas-api"
Sep 11 19:51:07.129821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.129799    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.132794 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.132767    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-6d1dae-openshift-default-dockercfg-jpnhc\""
Sep 11 19:51:07.138671 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.138637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"]
Sep 11 19:51:07.153353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.153321    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:07.220617 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.220564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dfbea5e-193a-4813-874a-72df10c0406f-istio-podinfo\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.220617 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.220617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-envoy\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.221192 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.220744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-certs\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.221192 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.220842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-credential-socket\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.221192 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.220968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-socket\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.221192 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.221053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khjqx\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-kube-api-access-khjqx\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.221192 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.221106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dfbea5e-193a-4813-874a-72df10c0406f-istiod-ca-cert\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.221192 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.221143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-data\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.221472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.221206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-istio-token\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.254446 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.254399    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:07.322441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-socket\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.322655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khjqx\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-kube-api-access-khjqx\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.322655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dfbea5e-193a-4813-874a-72df10c0406f-istiod-ca-cert\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.322655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-data\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.322655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-istio-token\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.322655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dfbea5e-193a-4813-874a-72df10c0406f-istio-podinfo\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.322655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-envoy\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.323048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-certs\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.323048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-credential-socket\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.323048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.322870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-socket\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.323219 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.323109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-credential-socket\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.323282 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.323218    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-data\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.323378 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.323357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-certs\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.323436 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.323362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dfbea5e-193a-4813-874a-72df10c0406f-istiod-ca-cert\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.325452 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.325429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-envoy\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.325590 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.325572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dfbea5e-193a-4813-874a-72df10c0406f-istio-podinfo\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.331255 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.331229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-istio-token\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.331375 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.331359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khjqx\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-kube-api-access-khjqx\") pod \"e2e-noten-6d1dae-openshift-default-d64794c46-c65n9\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") " pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.446039 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.445951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:07.735531 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.735503    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"]
Sep 11 19:51:07.736680 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:51:07.736656    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfbea5e_193a_4813_874a_72df10c0406f.slice/crio-e1e7dbef0b25374f58037740309ab66da5be50aa056288412a50d3932f7570f2 WatchSource:0}: Error finding container e1e7dbef0b25374f58037740309ab66da5be50aa056288412a50d3932f7570f2: Status 404 returned error can't find the container with id e1e7dbef0b25374f58037740309ab66da5be50aa056288412a50d3932f7570f2
Sep 11 19:51:07.738524 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.738498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:07.739587 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.739552    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:07.739675 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.739633    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:07.739721 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:07.739677    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:08.332946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.332911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:08.423341 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.423308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:08.496581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.496552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:08.623642 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.623565    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:08.704951 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.704911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9" event={"ID":"5dfbea5e-193a-4813-874a-72df10c0406f","Type":"ContainerStarted","Data":"62ddce07c8b6a7973dc3111d1f78ff0bb45997b0a069b3bd1ca1e406ac79ef1a"}
Sep 11 19:51:08.705135 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.704972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9" event={"ID":"5dfbea5e-193a-4813-874a-72df10c0406f","Type":"ContainerStarted","Data":"e1e7dbef0b25374f58037740309ab66da5be50aa056288412a50d3932f7570f2"}
Sep 11 19:51:08.727367 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.727315    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9" podStartSLOduration=1.7272998720000001 podStartE2EDuration="1.727299872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:51:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:51:08.724944387 +0000 UTC m=+1478.474199976" watchObservedRunningTime="2026-09-11 19:51:08.727299872 +0000 UTC m=+1478.476555446"
Sep 11 19:51:08.938863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:08.938778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:09.034824 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.034789    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:09.104537 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.104509    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:09.207261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.207171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:09.446507 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.446473    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:09.451594 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.451568    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:09.710591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.710560    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:09.711608 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.711587    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:51:09.936509 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:09.936477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:10.630802 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:10.630769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:11.535501 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:11.535471    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:12.406772 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.406730    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k" podUID="d2e0b567-af50-4b83-ac91-27e63efa8911" containerName="main" containerID="cri-o://91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed" gracePeriod=45
Sep 11 19:51:12.513681 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.513653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:12.658140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.658080    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:51:12.727055 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.727029    2576 generic.go:356] "Generic (PLEG): container finished" podID="d2e0b567-af50-4b83-ac91-27e63efa8911" containerID="91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed" exitCode=0
Sep 11 19:51:12.727194 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.727133    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"
Sep 11 19:51:12.728171 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.728153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k" event={"ID":"d2e0b567-af50-4b83-ac91-27e63efa8911","Type":"ContainerDied","Data":"91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed"}
Sep 11 19:51:12.728229 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.728186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k" event={"ID":"d2e0b567-af50-4b83-ac91-27e63efa8911","Type":"ContainerDied","Data":"151302b16e34d34ee35a720765f205691ac832c07039c62d895606135835a2f9"}
Sep 11 19:51:12.728229 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.728203    2576 scope.go:117] "RemoveContainer" containerID="91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed"
Sep 11 19:51:12.736966 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.736947    2576 scope.go:117] "RemoveContainer" containerID="91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed"
Sep 11 19:51:12.737268 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:51:12.737248    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed\": container with ID starting with 91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed not found: ID does not exist" containerID="91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed"
Sep 11 19:51:12.737336 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.737277    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed"} err="failed to get container status \"91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed\": rpc error: code = NotFound desc = could not find container \"91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed\": container with ID starting with 91f26eba224004781b9600bdba275623e434fa438479525a2889102b242b40ed not found: ID does not exist"
Sep 11 19:51:12.776256 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776234    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e0b567-af50-4b83-ac91-27e63efa8911-tls-certs\") pod \"d2e0b567-af50-4b83-ac91-27e63efa8911\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") "
Sep 11 19:51:12.776337 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-dshm\") pod \"d2e0b567-af50-4b83-ac91-27e63efa8911\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") "
Sep 11 19:51:12.776337 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776325    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-tmp-dir\") pod \"d2e0b567-af50-4b83-ac91-27e63efa8911\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") "
Sep 11 19:51:12.776446 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776349    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-model-cache\") pod \"d2e0b567-af50-4b83-ac91-27e63efa8911\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") "
Sep 11 19:51:12.776446 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776401    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-home\") pod \"d2e0b567-af50-4b83-ac91-27e63efa8911\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") "
Sep 11 19:51:12.776560 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776448    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz5ds\" (UniqueName: \"kubernetes.io/projected/d2e0b567-af50-4b83-ac91-27e63efa8911-kube-api-access-jz5ds\") pod \"d2e0b567-af50-4b83-ac91-27e63efa8911\" (UID: \"d2e0b567-af50-4b83-ac91-27e63efa8911\") "
Sep 11 19:51:12.776669 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776622    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2e0b567-af50-4b83-ac91-27e63efa8911" (UID: "d2e0b567-af50-4b83-ac91-27e63efa8911"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:12.776772 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776639    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2e0b567-af50-4b83-ac91-27e63efa8911" (UID: "d2e0b567-af50-4b83-ac91-27e63efa8911"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:12.776772 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776710    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-home" (OuterVolumeSpecName: "home") pod "d2e0b567-af50-4b83-ac91-27e63efa8911" (UID: "d2e0b567-af50-4b83-ac91-27e63efa8911"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:12.776880 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776850    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:12.776880 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776878    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:12.777238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.776891    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:12.778561 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.778542    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2e0b567-af50-4b83-ac91-27e63efa8911-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2e0b567-af50-4b83-ac91-27e63efa8911" (UID: "d2e0b567-af50-4b83-ac91-27e63efa8911"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:51:12.778639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.778569    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-dshm" (OuterVolumeSpecName: "dshm") pod "d2e0b567-af50-4b83-ac91-27e63efa8911" (UID: "d2e0b567-af50-4b83-ac91-27e63efa8911"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:12.778639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.778596    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2e0b567-af50-4b83-ac91-27e63efa8911-kube-api-access-jz5ds" (OuterVolumeSpecName: "kube-api-access-jz5ds") pod "d2e0b567-af50-4b83-ac91-27e63efa8911" (UID: "d2e0b567-af50-4b83-ac91-27e63efa8911"). InnerVolumeSpecName "kube-api-access-jz5ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:12.878095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.878066    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2e0b567-af50-4b83-ac91-27e63efa8911-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:12.878095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.878090    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2e0b567-af50-4b83-ac91-27e63efa8911-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:12.878213 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:12.878103    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz5ds\" (UniqueName: \"kubernetes.io/projected/d2e0b567-af50-4b83-ac91-27e63efa8911-kube-api-access-jz5ds\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:13.047483 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:13.047368    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"]
Sep 11 19:51:13.052868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:13.052846    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-872425/test-model-872425-kserve-74cdb59d5c-j8g7k"]
Sep 11 19:51:13.319944 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:13.319864    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:14.117968 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:14.117932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:14.224639 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:14.224552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:14.374609 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:14.374521    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:14.660258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:14.660186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:14.726272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:14.726246    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2e0b567-af50-4b83-ac91-27e63efa8911" path="/var/lib/kubelet/pods/d2e0b567-af50-4b83-ac91-27e63efa8911/volumes"
Sep 11 19:51:14.967179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:14.967132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:15.071225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:15.071186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:15.289674 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:15.289603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:15.894894 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:15.894860    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:15.997972 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:15.997943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:16.095725 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:16.095685    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:16.168377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:16.168288    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:17.126720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:17.126690    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:18.010520 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:18.010484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:18.112243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:18.112212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:18.216794 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:18.216763    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:19.043845 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:19.043811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:19.839952 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:19.839923    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:20.724418 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:20.724373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:21.441237 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:21.441205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:21.542257 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:21.542213    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:21.933388 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:21.933349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:22.031506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:22.031467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:22.110074 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:22.110027    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:22.487813 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:22.487774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:23.219230 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:23.219194    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:23.936235 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:23.936196    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:24.662102 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:24.662071    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 19:51:24.662272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:24.662133    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:51:24.830577 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:24.830541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:25.527305 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:25.527275    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:25.794929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:25.794859    2576 generic.go:356] "Generic (PLEG): container finished" podID="c76403f8-c234-4158-b368-8efdd870f10e" containerID="5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713" exitCode=0
Sep 11 19:51:25.795105 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:25.794934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" event={"ID":"c76403f8-c234-4158-b368-8efdd870f10e","Type":"ContainerDied","Data":"5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713"}
Sep 11 19:51:25.795399 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:25.795384    2576 scope.go:117] "RemoveContainer" containerID="5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713"
Sep 11 19:51:25.796571 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:25.796545    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:25.796623 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:25.796613    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:25.796658 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:25.796645    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:26.641044 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:26.641004    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:26.803666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:26.803632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" event={"ID":"c76403f8-c234-4158-b368-8efdd870f10e","Type":"ContainerStarted","Data":"2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e"}
Sep 11 19:51:27.208500 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.208467    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"]
Sep 11 19:51:27.208777 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.208712    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg" podUID="a8c9d563-71a8-4a7e-ad72-994eae429513" containerName="maas-api" containerID="cri-o://7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2" gracePeriod=30
Sep 11 19:51:27.236796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.236772    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:27.309016 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.308383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:27.420454 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.420423    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:27.531716 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.531692    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:51:27.532243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.532209    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:27.556919 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.556897    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:51:27.557094 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.557073    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 19:51:27.557153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.557119    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 19:51:27.627669 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.627643    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-metrics-certs\") pod \"a8c9d563-71a8-4a7e-ad72-994eae429513\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") "
Sep 11 19:51:27.627815 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.627726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls\") pod \"a8c9d563-71a8-4a7e-ad72-994eae429513\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") "
Sep 11 19:51:27.627815 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.627759    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c9d563-71a8-4a7e-ad72-994eae429513-openshift-service-ca\") pod \"a8c9d563-71a8-4a7e-ad72-994eae429513\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") "
Sep 11 19:51:27.627815 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.627806    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc7rm\" (UniqueName: \"kubernetes.io/projected/a8c9d563-71a8-4a7e-ad72-994eae429513-kube-api-access-zc7rm\") pod \"a8c9d563-71a8-4a7e-ad72-994eae429513\" (UID: \"a8c9d563-71a8-4a7e-ad72-994eae429513\") "
Sep 11 19:51:27.628209 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.628174    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8c9d563-71a8-4a7e-ad72-994eae429513-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8c9d563-71a8-4a7e-ad72-994eae429513" (UID: "a8c9d563-71a8-4a7e-ad72-994eae429513"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:27.630108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.630082    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a8c9d563-71a8-4a7e-ad72-994eae429513" (UID: "a8c9d563-71a8-4a7e-ad72-994eae429513"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:51:27.630108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.630104    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8c9d563-71a8-4a7e-ad72-994eae429513-kube-api-access-zc7rm" (OuterVolumeSpecName: "kube-api-access-zc7rm") pod "a8c9d563-71a8-4a7e-ad72-994eae429513" (UID: "a8c9d563-71a8-4a7e-ad72-994eae429513"). InnerVolumeSpecName "kube-api-access-zc7rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:27.630246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.630137    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8c9d563-71a8-4a7e-ad72-994eae429513" (UID: "a8c9d563-71a8-4a7e-ad72-994eae429513"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:51:27.729677 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.729644    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:27.729677 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.729677    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8c9d563-71a8-4a7e-ad72-994eae429513-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:27.730168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.729692    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8c9d563-71a8-4a7e-ad72-994eae429513-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:27.730168 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.729705    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc7rm\" (UniqueName: \"kubernetes.io/projected/a8c9d563-71a8-4a7e-ad72-994eae429513-kube-api-access-zc7rm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:27.810314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.810239    2576 generic.go:356] "Generic (PLEG): container finished" podID="a8c9d563-71a8-4a7e-ad72-994eae429513" containerID="7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2" exitCode=0
Sep 11 19:51:27.810314 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.810286    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"
Sep 11 19:51:27.810519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.810326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg" event={"ID":"a8c9d563-71a8-4a7e-ad72-994eae429513","Type":"ContainerDied","Data":"7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2"}
Sep 11 19:51:27.810519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.810380    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg" event={"ID":"a8c9d563-71a8-4a7e-ad72-994eae429513","Type":"ContainerDied","Data":"fc21064f9da95ba73d80dd1230e07c52b07b4ed613f8b4bf2917625c28adcf8d"}
Sep 11 19:51:27.810519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.810402    2576 scope.go:117] "RemoveContainer" containerID="7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2"
Sep 11 19:51:27.820588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.820572    2576 scope.go:117] "RemoveContainer" containerID="7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2"
Sep 11 19:51:27.820914 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:51:27.820896    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2\": container with ID starting with 7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2 not found: ID does not exist" containerID="7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2"
Sep 11 19:51:27.820978 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.820922    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2"} err="failed to get container status \"7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2\": rpc error: code = NotFound desc = could not find container \"7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2\": container with ID starting with 7ee8902d24b47f8fd614937cf98b7dae33144e8a3cba641ceb0b8d0acf0baef2 not found: ID does not exist"
Sep 11 19:51:27.834398 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.834375    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"]
Sep 11 19:51:27.840043 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.840019    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:27.840923 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.840900    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-872425-5b7455957-kb7xg"]
Sep 11 19:51:27.939827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:27.939792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:28.556920 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:28.556887    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 19:51:28.557128 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:28.556942    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 19:51:28.623013 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:28.622958    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:28.726210 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:28.726169    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8c9d563-71a8-4a7e-ad72-994eae429513" path="/var/lib/kubelet/pods/a8c9d563-71a8-4a7e-ad72-994eae429513/volumes"
Sep 11 19:51:29.470802 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:29.470762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:29.557796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:29.557764    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 19:51:29.557959 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:29.557826    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 19:51:30.451433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:30.451401    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:30.556950 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:30.556912    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 19:51:30.557350 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:30.556971    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 19:51:30.808106 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:30.808082    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:51:30.809783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:30.809756    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:51:30.815413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:30.815392    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:51:30.817112 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:30.817093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:51:31.377766 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:31.377702    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:31.557185 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:31.557151    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 11 19:51:31.557613 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:31.557228    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 11 19:51:32.561091 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:32.561061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:51:32.561476 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:32.561321    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:51:32.562165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:32.562147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:51:32.761115 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:32.761083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:32.861739 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:32.861650    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:33.858071 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:33.858038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:34.024600 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:34.024564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:34.273925 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:34.273881    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:34.321735 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:34.321700    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"]
Sep 11 19:51:34.321905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:34.321885    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy" containerID="cri-o://0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a" gracePeriod=30
Sep 11 19:51:34.343774 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:34.343746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:34.929801 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:34.929761    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:34.988295 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:34.988270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:35.222718 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:35.222690    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:35.428193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:35.428161    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:35.841182 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:35.841147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:36.143105 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.143030    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"]
Sep 11 19:51:36.143468 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.143453    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8c9d563-71a8-4a7e-ad72-994eae429513" containerName="maas-api"
Sep 11 19:51:36.143512 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.143470    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8c9d563-71a8-4a7e-ad72-994eae429513" containerName="maas-api"
Sep 11 19:51:36.143512 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.143480    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2e0b567-af50-4b83-ac91-27e63efa8911" containerName="main"
Sep 11 19:51:36.143512 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.143485    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2e0b567-af50-4b83-ac91-27e63efa8911" containerName="main"
Sep 11 19:51:36.143610 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.143550    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8c9d563-71a8-4a7e-ad72-994eae429513" containerName="maas-api"
Sep 11 19:51:36.143610 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.143560    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2e0b567-af50-4b83-ac91-27e63efa8911" containerName="main"
Sep 11 19:51:36.147743 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.147725    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.149904 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.149878    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"e2e-conflict-b-ccaf36e3-kserve-self-signed-certs\""
Sep 11 19:51:36.154971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.154901    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"]
Sep 11 19:51:36.217382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.217352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-model-cache\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.217516 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.217407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tls-certs\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.217516 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.217451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-home\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.217596 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.217550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rglls\" (UniqueName: \"kubernetes.io/projected/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-kube-api-access-rglls\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.217632 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.217593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-dshm\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.217632 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.217619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tmp-dir\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.318993 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.318956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-model-cache\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319120 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tls-certs\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319120 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-home\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319120 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rglls\" (UniqueName: \"kubernetes.io/projected/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-kube-api-access-rglls\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319120 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-dshm\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319300 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tmp-dir\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319388 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-model-cache\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319469 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-home\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.319591 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.319571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tmp-dir\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.321359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.321334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-dshm\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.321678 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.321659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tls-certs\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.329960 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.329937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rglls\" (UniqueName: \"kubernetes.io/projected/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-kube-api-access-rglls\") pod \"e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") " pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.458707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.458629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:36.551390 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.551362    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:36.734044 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.733978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"]
Sep 11 19:51:36.735085 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:51:36.735058    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a8224b4_aac4_42ae_a9aa_e88bed6a3662.slice/crio-a9866f26931fce7d2f575e82b2959007f0f9c61f61ed049063f68f156b7eec85 WatchSource:0}: Error finding container a9866f26931fce7d2f575e82b2959007f0f9c61f61ed049063f68f156b7eec85: Status 404 returned error can't find the container with id a9866f26931fce7d2f575e82b2959007f0f9c61f61ed049063f68f156b7eec85
Sep 11 19:51:36.843094 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.843058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:36.858362 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.858327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj" event={"ID":"2a8224b4-aac4-42ae-a9aa-e88bed6a3662","Type":"ContainerStarted","Data":"8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a"}
Sep 11 19:51:36.858472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:36.858368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj" event={"ID":"2a8224b4-aac4-42ae-a9aa-e88bed6a3662","Type":"ContainerStarted","Data":"a9866f26931fce7d2f575e82b2959007f0f9c61f61ed049063f68f156b7eec85"}
Sep 11 19:51:38.132140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:38.132106    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:38.779101 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:38.779072    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:38.890580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:38.890548    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:38.987675 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:38.987642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:39.579735 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.579711    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:51:39.605437 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.605302    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj" podStartSLOduration=3.605283579 podStartE2EDuration="3.605283579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:51:36.877482571 +0000 UTC m=+1506.626738144" watchObservedRunningTime="2026-09-11 19:51:39.605283579 +0000 UTC m=+1509.354539154"
Sep 11 19:51:39.658807 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.658782    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-certs\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.658914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.658841    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvgdw\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-kube-api-access-bvgdw\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.658914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.658865    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-token\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.658914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.658881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-envoy\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.658914 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.658900    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-data\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.659116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.658936    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457e450-32e8-451d-97c1-9cc285eda8d5-istiod-ca-cert\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.659116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659025    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-credential-socket\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.659116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659084    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-socket\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.659116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659082    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:39.659116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659108    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-podinfo\") pod \"4457e450-32e8-451d-97c1-9cc285eda8d5\" (UID: \"4457e450-32e8-451d-97c1-9cc285eda8d5\") "
Sep 11 19:51:39.659355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659293    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:39.659355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659317    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:39.659614 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659528    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.659614 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659561    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.659614 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659578    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.659614 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659522    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:39.660100 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.659644    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4457e450-32e8-451d-97c1-9cc285eda8d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:39.661292 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.661265    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:39.661393 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.661317    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-kube-api-access-bvgdw" (OuterVolumeSpecName: "kube-api-access-bvgdw") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "kube-api-access-bvgdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:39.661393 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.661325    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:39.661648 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.661633    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4457e450-32e8-451d-97c1-9cc285eda8d5" (UID: "4457e450-32e8-451d-97c1-9cc285eda8d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:51:39.760258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.760230    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.760258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.760256    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.760440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.760266    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvgdw\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-kube-api-access-bvgdw\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.760440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.760276    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.760440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.760288    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457e450-32e8-451d-97c1-9cc285eda8d5-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.760440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.760299    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457e450-32e8-451d-97c1-9cc285eda8d5-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:51:39.870133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.870070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:39.875179 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.875159    2576 generic.go:356] "Generic (PLEG): container finished" podID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerID="0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a" exitCode=0
Sep 11 19:51:39.875262 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.875207    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"
Sep 11 19:51:39.875262 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.875247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" event={"ID":"4457e450-32e8-451d-97c1-9cc285eda8d5","Type":"ContainerDied","Data":"0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a"}
Sep 11 19:51:39.875338 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.875298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx" event={"ID":"4457e450-32e8-451d-97c1-9cc285eda8d5","Type":"ContainerDied","Data":"aad147751acb1a5af48c9bc5b94d03558f179037096e284ee7d07344a7a21696"}
Sep 11 19:51:39.875338 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.875327    2576 scope.go:117] "RemoveContainer" containerID="0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a"
Sep 11 19:51:39.884781 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.884764    2576 scope.go:117] "RemoveContainer" containerID="955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c"
Sep 11 19:51:39.893015 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.892975    2576 scope.go:117] "RemoveContainer" containerID="0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a"
Sep 11 19:51:39.893292 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:51:39.893273    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a\": container with ID starting with 0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a not found: ID does not exist" containerID="0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a"
Sep 11 19:51:39.893358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.893299    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a"} err="failed to get container status \"0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a\": rpc error: code = NotFound desc = could not find container \"0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a\": container with ID starting with 0c9692389b50b834226ae31bbb448cd723a9bc4dbf129b95971e570d0a30f06a not found: ID does not exist"
Sep 11 19:51:39.893358 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.893316    2576 scope.go:117] "RemoveContainer" containerID="955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c"
Sep 11 19:51:39.893574 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:51:39.893560    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c\": container with ID starting with 955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c not found: ID does not exist" containerID="955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c"
Sep 11 19:51:39.893618 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.893577    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c"} err="failed to get container status \"955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c\": rpc error: code = NotFound desc = could not find container \"955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c\": container with ID starting with 955553073da57e21407d237075155dec206b74f509ee37fb8bb8c32e872e591c not found: ID does not exist"
Sep 11 19:51:39.897840 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.897819    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"]
Sep 11 19:51:39.901559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:39.901542    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-872425-openshift-default-b6d45746d-4mwlx"]
Sep 11 19:51:40.711237 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:40.711150    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:40.727244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:40.727218    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" path="/var/lib/kubelet/pods/4457e450-32e8-451d-97c1-9cc285eda8d5/volumes"
Sep 11 19:51:41.542400 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.542364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:41.642905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.642870    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:41.823783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.823686    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"]
Sep 11 19:51:41.824383 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.824351    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy"
Sep 11 19:51:41.824457 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.824385    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy"
Sep 11 19:51:41.824514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.824471    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy"
Sep 11 19:51:41.824514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.824481    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy"
Sep 11 19:51:41.829053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.829035    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.831433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.831416    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c0517f60-openshift-default-dockercfg-4hdmc\""
Sep 11 19:51:41.839843 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.839823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"]
Sep 11 19:51:41.850751 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.850712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:41.981910 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.981878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-token\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.981910 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.981916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-podinfo\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.982191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.981997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-socket\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.982191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.982052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-certs\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.982191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.982098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istiod-ca-cert\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.982191 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.982123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-data\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.982445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.982195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk842\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-kube-api-access-vk842\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.982445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.982265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-credential-socket\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:41.982445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:41.982286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-envoy\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk842\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-kube-api-access-vk842\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-credential-socket\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-envoy\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-token\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-podinfo\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-socket\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-certs\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istiod-ca-cert\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.083816 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-data\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.084196 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.083945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-credential-socket\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.084196 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.084076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-socket\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.084345 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.084318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-data\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.084404 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.084303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-certs\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.084484 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.084465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istiod-ca-cert\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.086023 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.086001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-envoy\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.086270 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.086250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-podinfo\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.090806 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.090784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-token\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.090956 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.090937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk842\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-kube-api-access-vk842\") pod \"e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") " pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.140444 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.140418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:42.284837 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.284799    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:42.391682 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.391601    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"]
Sep 11 19:51:42.392048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.392033    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy"
Sep 11 19:51:42.392048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.392048    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4457e450-32e8-451d-97c1-9cc285eda8d5" containerName="istio-proxy"
Sep 11 19:51:42.396241 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.396205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.398405 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.398379    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-58c78c-serving-cert\""
Sep 11 19:51:42.430237 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:51:42.430198    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1aa2d8b_2b83_4cdf_8fc5_7e37fae8f0e5.slice/crio-9367375f52e96f42c5e24e27bfa8e392d796ebb2d561b621dbfbca2aefd41eea WatchSource:0}: Error finding container 9367375f52e96f42c5e24e27bfa8e392d796ebb2d561b621dbfbca2aefd41eea: Status 404 returned error can't find the container with id 9367375f52e96f42c5e24e27bfa8e392d796ebb2d561b621dbfbca2aefd41eea
Sep 11 19:51:42.432672 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.432641    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:42.432768 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.432705    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:42.432768 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.432732    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:51:42.442641 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.442620    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:42.487638 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.487596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6147dd-60f2-4f55-9523-4eca54decf7d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.488419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.487703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.488419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.488260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdph7\" (UniqueName: \"kubernetes.io/projected/2b6147dd-60f2-4f55-9523-4eca54decf7d-kube-api-access-jdph7\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.488419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.488378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.491573 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.491550    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"]
Sep 11 19:51:42.499936 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.499913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"]
Sep 11 19:51:42.541565 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.541523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:42.589360 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.589323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.589541 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.589387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6147dd-60f2-4f55-9523-4eca54decf7d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.589541 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.589438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.589541 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.589501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdph7\" (UniqueName: \"kubernetes.io/projected/2b6147dd-60f2-4f55-9523-4eca54decf7d-kube-api-access-jdph7\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.590558 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.590488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6147dd-60f2-4f55-9523-4eca54decf7d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.593824 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.593246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.593824 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.593774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.599417 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.599382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdph7\" (UniqueName: \"kubernetes.io/projected/2b6147dd-60f2-4f55-9523-4eca54decf7d-kube-api-access-jdph7\") pod \"maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.646689 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.646527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:42.710728 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.710698    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:42.895756 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.895706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" event={"ID":"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5","Type":"ContainerStarted","Data":"a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10"}
Sep 11 19:51:42.896142 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.895789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" event={"ID":"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5","Type":"ContainerStarted","Data":"9367375f52e96f42c5e24e27bfa8e392d796ebb2d561b621dbfbca2aefd41eea"}
Sep 11 19:51:42.913315 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.913220    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podStartSLOduration=1.9132000260000002 podStartE2EDuration="1.913200026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:51:42.912232799 +0000 UTC m=+1512.661488407" watchObservedRunningTime="2026-09-11 19:51:42.913200026 +0000 UTC m=+1512.662455604"
Sep 11 19:51:42.913514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:42.913491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:43.003306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.003278    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"]
Sep 11 19:51:43.004497 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.004471    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:43.005941 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:51:43.005913    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6147dd_60f2_4f55_9523_4eca54decf7d.slice/crio-e3ffb900a096bcb20da652e6d71a3d462b2ff79fd48edf438c9c272cf12b2a6f WatchSource:0}: Error finding container e3ffb900a096bcb20da652e6d71a3d462b2ff79fd48edf438c9c272cf12b2a6f: Status 404 returned error can't find the container with id e3ffb900a096bcb20da652e6d71a3d462b2ff79fd48edf438c9c272cf12b2a6f
Sep 11 19:51:43.007751 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.007735    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:51:43.141266 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.141214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:43.162592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.162537    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:43.448586 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.448557    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:43.903241 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.903202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw" event={"ID":"2b6147dd-60f2-4f55-9523-4eca54decf7d","Type":"ContainerStarted","Data":"578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112"}
Sep 11 19:51:43.903671 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.903257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw" event={"ID":"2b6147dd-60f2-4f55-9523-4eca54decf7d","Type":"ContainerStarted","Data":"e3ffb900a096bcb20da652e6d71a3d462b2ff79fd48edf438c9c272cf12b2a6f"}
Sep 11 19:51:43.903671 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.903426    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:43.903671 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.903459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:43.904476 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.904454    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:51:43.920830 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:43.920787    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw" podStartSLOduration=1.573753505 podStartE2EDuration="1.920773218s" totalImagesPullingTime="347.019713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:51:43.918575157 +0000 UTC m=+1513.667830760" watchObservedRunningTime="2026-09-11 19:51:43.920773218 +0000 UTC m=+1513.670028793"
Sep 11 19:51:44.634702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:44.634664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:44.954330 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:44.954228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:45.049206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:45.049178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:45.541853 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:45.541818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:46.459605 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:46.459568    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:46.459605 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:46.459610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:46.472953 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:46.472929    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:46.647853 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:46.647811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:46.931242 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:46.931211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:51:47.451700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:47.451664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:48.202500 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:48.202467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:49.056101 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:49.056053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:49.733823 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:49.733791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:49.796863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:49.796821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:49.913550 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:49.913523    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 19:51:50.181580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:50.181496    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:50.283355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:50.283324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:50.358144 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:50.358106    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:51:50.676324 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:51:50.676279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:03.416810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:03.416742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:05.324761 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:05.324725    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:06.158160 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:06.158128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:06.965768 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:06.965739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:07.756667 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:07.756626    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:08.684647 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:08.684612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:08.834442 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:08.834408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:09.156638 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:09.156607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:09.452828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:09.452739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:09.530907 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:09.530877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:09.800172 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:09.800131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:09.962579 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:09.962550    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:10.048693 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:10.048665    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerID="a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10" exitCode=0
Sep 11 19:52:10.048872 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:10.048743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" event={"ID":"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5","Type":"ContainerDied","Data":"a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10"}
Sep 11 19:52:10.049335 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:10.049316    2576 scope.go:117] "RemoveContainer" containerID="a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10"
Sep 11 19:52:10.050732 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:10.050667    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:52:10.050836 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:10.050752    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:52:10.050836 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:10.050800    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:52:10.222298 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:10.222267    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:11.056594 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:11.056559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" event={"ID":"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5","Type":"ContainerStarted","Data":"95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93"}
Sep 11 19:52:11.134859 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:11.134811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:11.140582 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:11.140563    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:52:11.141672 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:11.141644    2576 patch_prober.go:28] interesting pod/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:52:11.141832 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:11.141701    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 19:52:11.866629 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:11.866593    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:12.141217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:12.141133    2576 patch_prober.go:28] interesting pod/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:52:12.141217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:12.141181    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 19:52:12.755500 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:12.755465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:13.081857 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:13.081764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:13.141692 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:13.141660    2576 patch_prober.go:28] interesting pod/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:52:13.142089 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:13.141726    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 19:52:13.169946 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:13.169921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:13.794269 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:13.794191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:13.903933 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:13.903903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:52:14.141297 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:14.141218    2576 patch_prober.go:28] interesting pod/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:52:14.141297 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:14.141276    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 19:52:14.762448 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:14.762410    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:15.141414 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:15.141336    2576 patch_prober.go:28] interesting pod/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:52:15.141555 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:15.141408    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 11 19:52:15.545429 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:15.545396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:16.144538 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:16.144506    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:52:16.145506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:16.145486    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:52:16.526812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:16.526777    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:17.336587 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:17.336556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:18.104653 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.104613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:18.907559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.907523    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"]
Sep 11 19:52:18.912870 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.912848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:18.916379 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.916358    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-ae268e-serving-cert\""
Sep 11 19:52:18.920221 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.920199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"]
Sep 11 19:52:18.942915 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.942888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:18.954886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.954851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdba8bbf-df63-4f82-aa74-c52eb19476da-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:18.955003 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.954911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:18.955074 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.955002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbwpx\" (UniqueName: \"kubernetes.io/projected/cdba8bbf-df63-4f82-aa74-c52eb19476da-kube-api-access-jbwpx\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:18.955140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:18.955071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.046764 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.046727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:19.055917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.055889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.056067 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.055972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdba8bbf-df63-4f82-aa74-c52eb19476da-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.056067 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.056039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.056186 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:52:19.056071    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-serving-cert: secret "maas-api-e2e-shared-b-w3-ae268e-serving-cert" not found
Sep 11 19:52:19.056186 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.056118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwpx\" (UniqueName: \"kubernetes.io/projected/cdba8bbf-df63-4f82-aa74-c52eb19476da-kube-api-access-jbwpx\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.056186 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:52:19.056168    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls podName:cdba8bbf-df63-4f82-aa74-c52eb19476da nodeName:}" failed. No retries permitted until 2026-09-11 19:52:19.556147594 +0000 UTC m=+1549.305403170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls") pod "maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv" (UID: "cdba8bbf-df63-4f82-aa74-c52eb19476da") : secret "maas-api-e2e-shared-b-w3-ae268e-serving-cert" not found
Sep 11 19:52:19.056740 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.056713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdba8bbf-df63-4f82-aa74-c52eb19476da-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.058783 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.058764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.065477 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.065456    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwpx\" (UniqueName: \"kubernetes.io/projected/cdba8bbf-df63-4f82-aa74-c52eb19476da-kube-api-access-jbwpx\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.201836 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.201752    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:19.424904 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.424863    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:19.520009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.519954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:19.559717 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.559687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.562205 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.562183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.828131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.828045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:19.895153 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.895097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:19.995028 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:19.994979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:20.118779 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:20.118703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"]
Sep 11 19:52:20.122475 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:52:20.122445    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdba8bbf_df63_4f82_aa74_c52eb19476da.slice/crio-7cc143ef2eff1731b7b04feab332e616173bf605a73aaac9f3abda876732b6be WatchSource:0}: Error finding container 7cc143ef2eff1731b7b04feab332e616173bf605a73aaac9f3abda876732b6be: Status 404 returned error can't find the container with id 7cc143ef2eff1731b7b04feab332e616173bf605a73aaac9f3abda876732b6be
Sep 11 19:52:21.113436 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:21.113397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv" event={"ID":"cdba8bbf-df63-4f82-aa74-c52eb19476da","Type":"ContainerStarted","Data":"327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28"}
Sep 11 19:52:21.113850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:21.113468    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:21.113850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:21.113485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv" event={"ID":"cdba8bbf-df63-4f82-aa74-c52eb19476da","Type":"ContainerStarted","Data":"7cc143ef2eff1731b7b04feab332e616173bf605a73aaac9f3abda876732b6be"}
Sep 11 19:52:21.132269 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:21.132223    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv" podStartSLOduration=2.71943701 podStartE2EDuration="3.132208303s" totalImagesPullingTime="412.771293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:52:21.129114172 +0000 UTC m=+1550.878369749" watchObservedRunningTime="2026-09-11 19:52:21.132208303 +0000 UTC m=+1550.881463876"
Sep 11 19:52:27.123195 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:27.123167    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 19:52:41.028285 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:41.028247    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:41.946849 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:41.946805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:42.829287 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:42.829241    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:43.066713 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:43.066682    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:43.603129 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:43.603092    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:44.551260 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:44.551218    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:45.348789 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:45.348754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:46.154228 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.154200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:46.654704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.654669    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"]
Sep 11 19:52:46.660155 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.660130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.662354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.662334    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-6d1dae\"/\"openshift-service-ca.crt\""
Sep 11 19:52:46.663090 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.663065    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-6d1dae\"/\"default-dockercfg-pvfk6\""
Sep 11 19:52:46.663207 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.663065    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-6d1dae\"/\"kube-root-ca.crt\""
Sep 11 19:52:46.663207 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.663073    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-6d1dae\"/\"noten-model-6d1dae-kserve-self-signed-certs\""
Sep 11 19:52:46.669546 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.669521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"]
Sep 11 19:52:46.677793 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.677770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:46.790619 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.790582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-model-cache\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.790796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.790627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-dshm\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.790796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.790667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5frt6\" (UniqueName: \"kubernetes.io/projected/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-kube-api-access-5frt6\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.790796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.790694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tmp-dir\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.790796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.790759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-home\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.790965 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.790809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tls-certs\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.891857 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.891825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-home\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892043 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.891864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tls-certs\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892043 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.891928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-model-cache\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892043 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.891947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-dshm\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892043 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.891964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5frt6\" (UniqueName: \"kubernetes.io/projected/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-kube-api-access-5frt6\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.892122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tmp-dir\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892243 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.892207    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-home\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892351 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.892320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-model-cache\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.892480 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.892456    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tmp-dir\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.894355 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.894334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-dshm\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.894607 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.894590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tls-certs\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.900726 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.900705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5frt6\" (UniqueName: \"kubernetes.io/projected/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-kube-api-access-5frt6\") pod \"noten-model-6d1dae-kserve-7d5c74d6d7-55xwg\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") " pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:46.971770 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:46.971746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:47.133926 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:47.133897    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:52:47.245519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:47.245489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"]
Sep 11 19:52:47.246780 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:52:47.246755    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdc2b730_a6fb_4276_a5e1_ba16b7a91619.slice/crio-828e428fc358dea2f479c09cb5e4cbe0e622eef30ecad7176f194f8d04372732 WatchSource:0}: Error finding container 828e428fc358dea2f479c09cb5e4cbe0e622eef30ecad7176f194f8d04372732: Status 404 returned error can't find the container with id 828e428fc358dea2f479c09cb5e4cbe0e622eef30ecad7176f194f8d04372732
Sep 11 19:52:47.261451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:47.261418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg" event={"ID":"bdc2b730-a6fb-4276-a5e1-ba16b7a91619","Type":"ContainerStarted","Data":"828e428fc358dea2f479c09cb5e4cbe0e622eef30ecad7176f194f8d04372732"}
Sep 11 19:52:48.268821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:48.268787    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg" event={"ID":"bdc2b730-a6fb-4276-a5e1-ba16b7a91619","Type":"ContainerStarted","Data":"e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919"}
Sep 11 19:52:48.284532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:48.284484    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg" podStartSLOduration=2.284465768 podStartE2EDuration="2.284465768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:52:48.283938093 +0000 UTC m=+1578.033193686" watchObservedRunningTime="2026-09-11 19:52:48.284465768 +0000 UTC m=+1578.033721366"
Sep 11 19:52:56.972320 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:56.972289    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:56.972786 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:56.972341    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:56.984341 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:56.984316    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:52:57.328797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:52:57.328731    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:53:02.445615 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.445579    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"]
Sep 11 19:53:02.449184 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.449164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.451304 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.451281    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10cc24\"/\"distinct-w0-10cc24-kserve-self-signed-certs\""
Sep 11 19:53:02.457874 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.457850    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"]
Sep 11 19:53:02.523296 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.523264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddzh\" (UniqueName: \"kubernetes.io/projected/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-kube-api-access-jddzh\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.523408 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.523353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tls-certs\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.523464 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.523409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-dshm\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.523507 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.523469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-home\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.523545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.523515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-model-cache\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.523545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.523534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tmp-dir\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624259 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tls-certs\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624356 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-dshm\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624489 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-home\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624612 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-model-cache\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624612 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tmp-dir\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624612 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddzh\" (UniqueName: \"kubernetes.io/projected/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-kube-api-access-jddzh\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624785 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-home\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.624875 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.624858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tmp-dir\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.625165 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.625113    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-model-cache\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.626702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.626684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-dshm\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.626869 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.626853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tls-certs\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.633467 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.633448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddzh\" (UniqueName: \"kubernetes.io/projected/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-kube-api-access-jddzh\") pod \"distinct-w0-10cc24-kserve-59f94fc59d-4qm8g\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") " pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:02.748248 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.748222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:53:02.760155 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:02.760133    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:03.049296 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:03.049272    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"]
Sep 11 19:53:03.050626 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:53:03.050601    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode54ac1f9_58d6_4cbc_a95b_f5559e5dc051.slice/crio-4c6c71dd54b8783567cb6bcc7a5c0aab50102bf54172d82e1dea55f750a43e4f WatchSource:0}: Error finding container 4c6c71dd54b8783567cb6bcc7a5c0aab50102bf54172d82e1dea55f750a43e4f: Status 404 returned error can't find the container with id 4c6c71dd54b8783567cb6bcc7a5c0aab50102bf54172d82e1dea55f750a43e4f
Sep 11 19:53:03.357680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:03.357594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g" event={"ID":"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051","Type":"ContainerStarted","Data":"842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5"}
Sep 11 19:53:03.357680 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:03.357644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g" event={"ID":"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051","Type":"ContainerStarted","Data":"4c6c71dd54b8783567cb6bcc7a5c0aab50102bf54172d82e1dea55f750a43e4f"}
Sep 11 19:53:03.379453 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:03.379400    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g" podStartSLOduration=1.379385247 podStartE2EDuration="1.379385247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:53:03.375748314 +0000 UTC m=+1593.125003907" watchObservedRunningTime="2026-09-11 19:53:03.379385247 +0000 UTC m=+1593.128640820"
Sep 11 19:53:12.760572 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:12.760543    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:12.761183 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:12.760588    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:12.773214 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:12.773185    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:13.426318 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:13.426287    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:53:18.216167 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:18.216129    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"]
Sep 11 19:53:18.216542 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:18.216373    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9" podUID="5dfbea5e-193a-4813-874a-72df10c0406f" containerName="istio-proxy" containerID="cri-o://62ddce07c8b6a7973dc3111d1f78ff0bb45997b0a069b3bd1ca1e406ac79ef1a" gracePeriod=30
Sep 11 19:53:18.232369 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:18.232339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:53:18.458936 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:18.458904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:53:18.578944 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:18.578845    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:53:23.468503 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.468473    2576 generic.go:356] "Generic (PLEG): container finished" podID="5dfbea5e-193a-4813-874a-72df10c0406f" containerID="62ddce07c8b6a7973dc3111d1f78ff0bb45997b0a069b3bd1ca1e406ac79ef1a" exitCode=0
Sep 11 19:53:23.468800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.468547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9" event={"ID":"5dfbea5e-193a-4813-874a-72df10c0406f","Type":"ContainerDied","Data":"62ddce07c8b6a7973dc3111d1f78ff0bb45997b0a069b3bd1ca1e406ac79ef1a"}
Sep 11 19:53:23.468800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.468602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9" event={"ID":"5dfbea5e-193a-4813-874a-72df10c0406f","Type":"ContainerDied","Data":"e1e7dbef0b25374f58037740309ab66da5be50aa056288412a50d3932f7570f2"}
Sep 11 19:53:23.468800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.468623    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1e7dbef0b25374f58037740309ab66da5be50aa056288412a50d3932f7570f2"
Sep 11 19:53:23.470397 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.470370    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:53:23.511206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-socket\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511256    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-istio-token\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511279    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-data\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511355    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khjqx\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-kube-api-access-khjqx\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:23.511440 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511417    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-envoy\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-certs\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511511    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dfbea5e-193a-4813-874a-72df10c0406f-istiod-ca-cert\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511542    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-credential-socket\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511599 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511582    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:23.511811 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dfbea5e-193a-4813-874a-72df10c0406f-istio-podinfo\") pod \"5dfbea5e-193a-4813-874a-72df10c0406f\" (UID: \"5dfbea5e-193a-4813-874a-72df10c0406f\") "
Sep 11 19:53:23.511811 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511765    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:23.511811 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:23.512158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.511890    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dfbea5e-193a-4813-874a-72df10c0406f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:53:23.512158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.512022    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.512158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.512044    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.512158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.512057    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5dfbea5e-193a-4813-874a-72df10c0406f-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.512158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.512070    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.512158 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.512110    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.513714 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.513687    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:23.514212 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.514188    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:23.514310 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.514268    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5dfbea5e-193a-4813-874a-72df10c0406f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:53:23.514501 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.514470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-kube-api-access-khjqx" (OuterVolumeSpecName: "kube-api-access-khjqx") pod "5dfbea5e-193a-4813-874a-72df10c0406f" (UID: "5dfbea5e-193a-4813-874a-72df10c0406f"). InnerVolumeSpecName "kube-api-access-khjqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:23.552083 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.552051    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"]
Sep 11 19:53:23.613254 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.613230    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5dfbea5e-193a-4813-874a-72df10c0406f-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.613254 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.613252    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.613382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.613263    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khjqx\" (UniqueName: \"kubernetes.io/projected/5dfbea5e-193a-4813-874a-72df10c0406f-kube-api-access-khjqx\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.613382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.613272    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5dfbea5e-193a-4813-874a-72df10c0406f-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:23.647768 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:23.647741    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:53:24.474782 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:24.474746    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"
Sep 11 19:53:24.500431 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:24.500398    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"]
Sep 11 19:53:24.505134 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:24.505112    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-6d1dae-openshift-default-d64794c46-c65n9"]
Sep 11 19:53:24.726866 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:24.726799    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dfbea5e-193a-4813-874a-72df10c0406f" path="/var/lib/kubelet/pods/5dfbea5e-193a-4813-874a-72df10c0406f/volumes"
Sep 11 19:53:38.572075 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.572037    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg" podUID="bdc2b730-a6fb-4276-a5e1-ba16b7a91619" containerName="main" containerID="cri-o://e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919" gracePeriod=45
Sep 11 19:53:38.827072 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.827020    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:53:38.939505 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-home\") pod \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") "
Sep 11 19:53:38.939698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939525    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5frt6\" (UniqueName: \"kubernetes.io/projected/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-kube-api-access-5frt6\") pod \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") "
Sep 11 19:53:38.939698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939585    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-model-cache\") pod \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") "
Sep 11 19:53:38.939698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-dshm\") pod \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") "
Sep 11 19:53:38.939698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939635    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tmp-dir\") pod \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") "
Sep 11 19:53:38.939698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tls-certs\") pod \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\" (UID: \"bdc2b730-a6fb-4276-a5e1-ba16b7a91619\") "
Sep 11 19:53:38.939934 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939777    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-home" (OuterVolumeSpecName: "home") pod "bdc2b730-a6fb-4276-a5e1-ba16b7a91619" (UID: "bdc2b730-a6fb-4276-a5e1-ba16b7a91619"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:38.939934 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939856    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-model-cache" (OuterVolumeSpecName: "model-cache") pod "bdc2b730-a6fb-4276-a5e1-ba16b7a91619" (UID: "bdc2b730-a6fb-4276-a5e1-ba16b7a91619"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:38.939934 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.939870    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bdc2b730-a6fb-4276-a5e1-ba16b7a91619" (UID: "bdc2b730-a6fb-4276-a5e1-ba16b7a91619"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:38.940112 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.940094    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:38.940112 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.940107    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:38.940227 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.940118    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:38.941885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.941859    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-dshm" (OuterVolumeSpecName: "dshm") pod "bdc2b730-a6fb-4276-a5e1-ba16b7a91619" (UID: "bdc2b730-a6fb-4276-a5e1-ba16b7a91619"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:53:38.942008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.941949    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bdc2b730-a6fb-4276-a5e1-ba16b7a91619" (UID: "bdc2b730-a6fb-4276-a5e1-ba16b7a91619"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:53:38.942008 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:38.941964    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-kube-api-access-5frt6" (OuterVolumeSpecName: "kube-api-access-5frt6") pod "bdc2b730-a6fb-4276-a5e1-ba16b7a91619" (UID: "bdc2b730-a6fb-4276-a5e1-ba16b7a91619"). InnerVolumeSpecName "kube-api-access-5frt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:53:39.041088 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.041047    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5frt6\" (UniqueName: \"kubernetes.io/projected/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-kube-api-access-5frt6\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:39.041088 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.041085    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:39.041088 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.041097    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc2b730-a6fb-4276-a5e1-ba16b7a91619-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:53:39.560481 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.560444    2576 generic.go:356] "Generic (PLEG): container finished" podID="bdc2b730-a6fb-4276-a5e1-ba16b7a91619" containerID="e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919" exitCode=0
Sep 11 19:53:39.560629 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.560492    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"
Sep 11 19:53:39.560629 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.560532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg" event={"ID":"bdc2b730-a6fb-4276-a5e1-ba16b7a91619","Type":"ContainerDied","Data":"e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919"}
Sep 11 19:53:39.560629 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.560580    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg" event={"ID":"bdc2b730-a6fb-4276-a5e1-ba16b7a91619","Type":"ContainerDied","Data":"828e428fc358dea2f479c09cb5e4cbe0e622eef30ecad7176f194f8d04372732"}
Sep 11 19:53:39.560629 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.560598    2576 scope.go:117] "RemoveContainer" containerID="e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919"
Sep 11 19:53:39.570739 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.570722    2576 scope.go:117] "RemoveContainer" containerID="e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919"
Sep 11 19:53:39.571057 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:53:39.571038    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919\": container with ID starting with e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919 not found: ID does not exist" containerID="e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919"
Sep 11 19:53:39.571136 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.571069    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919"} err="failed to get container status \"e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919\": rpc error: code = NotFound desc = could not find container \"e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919\": container with ID starting with e4b8cba338630ebc9759cf02689ce368368126f16a2bb3d28005bc08dd6dc919 not found: ID does not exist"
Sep 11 19:53:39.582793 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.582766    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"]
Sep 11 19:53:39.588899 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:39.588878    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-6d1dae/noten-model-6d1dae-kserve-7d5c74d6d7-55xwg"]
Sep 11 19:53:40.727231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:40.727198    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc2b730-a6fb-4276-a5e1-ba16b7a91619" path="/var/lib/kubelet/pods/bdc2b730-a6fb-4276-a5e1-ba16b7a91619/volumes"
Sep 11 19:53:46.665753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.665710    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"]
Sep 11 19:53:46.666325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.666169    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfbea5e-193a-4813-874a-72df10c0406f" containerName="istio-proxy"
Sep 11 19:53:46.666325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.666184    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfbea5e-193a-4813-874a-72df10c0406f" containerName="istio-proxy"
Sep 11 19:53:46.666325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.666196    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc2b730-a6fb-4276-a5e1-ba16b7a91619" containerName="main"
Sep 11 19:53:46.666325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.666201    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc2b730-a6fb-4276-a5e1-ba16b7a91619" containerName="main"
Sep 11 19:53:46.666325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.666272    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc2b730-a6fb-4276-a5e1-ba16b7a91619" containerName="main"
Sep 11 19:53:46.666325 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.666283    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dfbea5e-193a-4813-874a-72df10c0406f" containerName="istio-proxy"
Sep 11 19:53:46.670608 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.670581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.673418 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.673396    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c0517f60\"/\"e2e-lifecycle-model-c0517f60-kserve-self-signed-certs\""
Sep 11 19:53:46.673525 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.673417    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c0517f60\"/\"kube-root-ca.crt\""
Sep 11 19:53:46.673525 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.673419    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c0517f60\"/\"openshift-service-ca.crt\""
Sep 11 19:53:46.673636 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.673396    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c0517f60\"/\"default-dockercfg-gpwnd\""
Sep 11 19:53:46.681919 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.681894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"]
Sep 11 19:53:46.690317 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.690291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:53:46.816646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.815885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wml\" (UniqueName: \"kubernetes.io/projected/c54360ad-8e1e-4a7f-a664-98bb7253115b-kube-api-access-m4wml\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.816646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.815961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-dshm\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.816646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.816137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-model-cache\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.816646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.816240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-tmp-dir\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.816646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.816277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-home\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.816646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.816301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54360ad-8e1e-4a7f-a664-98bb7253115b-tls-certs\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.917982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.917888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-home\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.917982 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.917930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54360ad-8e1e-4a7f-a664-98bb7253115b-tls-certs\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.918239 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.918059    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wml\" (UniqueName: \"kubernetes.io/projected/c54360ad-8e1e-4a7f-a664-98bb7253115b-kube-api-access-m4wml\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.918239 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.918115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-dshm\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.918239 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.918196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-model-cache\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.918416 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.918289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-tmp-dir\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.918667 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.918630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-home\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.919013 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.918713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-model-cache\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.919013 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.918807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-tmp-dir\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.921052 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.921022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-dshm\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.921419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.921396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54360ad-8e1e-4a7f-a664-98bb7253115b-tls-certs\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.926594 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.926541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wml\" (UniqueName: \"kubernetes.io/projected/c54360ad-8e1e-4a7f-a664-98bb7253115b-kube-api-access-m4wml\") pod \"e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") " pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:46.982194 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:46.982173    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:47.254119 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:47.254089    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"]
Sep 11 19:53:47.255520 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:53:47.255492    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc54360ad_8e1e_4a7f_a664_98bb7253115b.slice/crio-97e1921cc14ec2fc7cc9081d9ae9da7df32a0a07c36c310ec66a9447f52b8373 WatchSource:0}: Error finding container 97e1921cc14ec2fc7cc9081d9ae9da7df32a0a07c36c310ec66a9447f52b8373: Status 404 returned error can't find the container with id 97e1921cc14ec2fc7cc9081d9ae9da7df32a0a07c36c310ec66a9447f52b8373
Sep 11 19:53:47.610098 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:47.610019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc" event={"ID":"c54360ad-8e1e-4a7f-a664-98bb7253115b","Type":"ContainerStarted","Data":"99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0"}
Sep 11 19:53:47.610098 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:47.610063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc" event={"ID":"c54360ad-8e1e-4a7f-a664-98bb7253115b","Type":"ContainerStarted","Data":"97e1921cc14ec2fc7cc9081d9ae9da7df32a0a07c36c310ec66a9447f52b8373"}
Sep 11 19:53:47.626683 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:47.626633    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc" podStartSLOduration=1.6266154739999998 podStartE2EDuration="1.626615474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:53:47.625731385 +0000 UTC m=+1637.374986975" watchObservedRunningTime="2026-09-11 19:53:47.626615474 +0000 UTC m=+1637.375871052"
Sep 11 19:53:56.983246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:56.983209    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:56.983649 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:56.983273    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:56.995974 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:56.995943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:57.674575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:57.674548    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:53:58.167052 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.167021    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"]
Sep 11 19:53:58.171056 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.171030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.176246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.176221    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-58c78c\"/\"kube-root-ca.crt\""
Sep 11 19:53:58.176906 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.176887    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-58c78c\"/\"openshift-service-ca.crt\""
Sep 11 19:53:58.177002 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.176920    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58c78c\"/\"default-dockercfg-pct5c\""
Sep 11 19:53:58.177002 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.176948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58c78c\"/\"auth-test-model-58c78c-kserve-self-signed-certs\""
Sep 11 19:53:58.183944 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.183913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"]
Sep 11 19:53:58.197181 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.197154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:53:58.214947 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.214923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-tmp-dir\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.215093 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.215068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-home\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.215163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.215115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5448fbce-6952-488b-af69-30c9c884bb77-tls-certs\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.215224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.215205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-model-cache\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.215286 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.215249    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk87l\" (UniqueName: \"kubernetes.io/projected/5448fbce-6952-488b-af69-30c9c884bb77-kube-api-access-fk87l\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.215334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.215288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-dshm\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.316698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.316660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-model-cache\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.316888 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.316706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk87l\" (UniqueName: \"kubernetes.io/projected/5448fbce-6952-488b-af69-30c9c884bb77-kube-api-access-fk87l\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.316888 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.316743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-dshm\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.316888 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.316792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-tmp-dir\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.317109 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.316887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-home\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.317109 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.316929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5448fbce-6952-488b-af69-30c9c884bb77-tls-certs\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.317109 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.317090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-model-cache\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.317261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.317227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-tmp-dir\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.317261 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.317241    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-home\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.319149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.319128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-dshm\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.319493 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.319473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5448fbce-6952-488b-af69-30c9c884bb77-tls-certs\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.327021 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.326977    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk87l\" (UniqueName: \"kubernetes.io/projected/5448fbce-6952-488b-af69-30c9c884bb77-kube-api-access-fk87l\") pod \"auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") " pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.482379 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.482338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:53:58.763059 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:58.763032    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"]
Sep 11 19:53:58.763690 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:53:58.763661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5448fbce_6952_488b_af69_30c9c884bb77.slice/crio-0e342a67b4eb58c40627e9278b7a51d6772cdaddb3992e89e4e2f2faf1cb6274 WatchSource:0}: Error finding container 0e342a67b4eb58c40627e9278b7a51d6772cdaddb3992e89e4e2f2faf1cb6274: Status 404 returned error can't find the container with id 0e342a67b4eb58c40627e9278b7a51d6772cdaddb3992e89e4e2f2faf1cb6274
Sep 11 19:53:59.678728 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:59.678683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg" event={"ID":"5448fbce-6952-488b-af69-30c9c884bb77","Type":"ContainerStarted","Data":"074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32"}
Sep 11 19:53:59.678728 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:59.678733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg" event={"ID":"5448fbce-6952-488b-af69-30c9c884bb77","Type":"ContainerStarted","Data":"0e342a67b4eb58c40627e9278b7a51d6772cdaddb3992e89e4e2f2faf1cb6274"}
Sep 11 19:53:59.716568 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:53:59.716514    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg" podStartSLOduration=1.716499433 podStartE2EDuration="1.716499433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:53:59.713808767 +0000 UTC m=+1649.463064357" watchObservedRunningTime="2026-09-11 19:53:59.716499433 +0000 UTC m=+1649.465755007"
Sep 11 19:54:00.798208 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:00.798172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:01.079925 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:01.079843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:08.483075 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:08.483029    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:54:08.483075 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:08.483084    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:54:08.495864 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:08.495833    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:54:08.740129 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:08.740052    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 19:54:11.203049 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:11.203008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"]
Sep 11 19:54:11.233024 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:11.232973    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:17.875094 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:17.875064    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:26.222939 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.222874    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj" podUID="2a8224b4-aac4-42ae-a9aa-e88bed6a3662" containerName="main" containerID="cri-o://8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a" gracePeriod=45
Sep 11 19:54:26.468562 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.468540    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:54:26.585424 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585361    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-home\") pod \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") "
Sep 11 19:54:26.585424 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585413    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tmp-dir\") pod \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") "
Sep 11 19:54:26.585588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585450    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-model-cache\") pod \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") "
Sep 11 19:54:26.585588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-dshm\") pod \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") "
Sep 11 19:54:26.585588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585490    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rglls\" (UniqueName: \"kubernetes.io/projected/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-kube-api-access-rglls\") pod \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") "
Sep 11 19:54:26.585588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585517    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tls-certs\") pod \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\" (UID: \"2a8224b4-aac4-42ae-a9aa-e88bed6a3662\") "
Sep 11 19:54:26.585810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585654    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-home" (OuterVolumeSpecName: "home") pod "2a8224b4-aac4-42ae-a9aa-e88bed6a3662" (UID: "2a8224b4-aac4-42ae-a9aa-e88bed6a3662"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:26.585810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585687    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a8224b4-aac4-42ae-a9aa-e88bed6a3662" (UID: "2a8224b4-aac4-42ae-a9aa-e88bed6a3662"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:26.585810 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585774    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a8224b4-aac4-42ae-a9aa-e88bed6a3662" (UID: "2a8224b4-aac4-42ae-a9aa-e88bed6a3662"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:26.585977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585885    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:54:26.585977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585898    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:54:26.585977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.585908    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:54:26.588003 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.587967    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-dshm" (OuterVolumeSpecName: "dshm") pod "2a8224b4-aac4-42ae-a9aa-e88bed6a3662" (UID: "2a8224b4-aac4-42ae-a9aa-e88bed6a3662"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:26.588104 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.588084    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a8224b4-aac4-42ae-a9aa-e88bed6a3662" (UID: "2a8224b4-aac4-42ae-a9aa-e88bed6a3662"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:54:26.588184 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.588165    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-kube-api-access-rglls" (OuterVolumeSpecName: "kube-api-access-rglls") pod "2a8224b4-aac4-42ae-a9aa-e88bed6a3662" (UID: "2a8224b4-aac4-42ae-a9aa-e88bed6a3662"). InnerVolumeSpecName "kube-api-access-rglls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:54:26.687277 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.687257    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:54:26.687277 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.687279    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rglls\" (UniqueName: \"kubernetes.io/projected/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-kube-api-access-rglls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:54:26.687419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.687289    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8224b4-aac4-42ae-a9aa-e88bed6a3662-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:54:26.825398 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.825376    2576 generic.go:356] "Generic (PLEG): container finished" podID="2a8224b4-aac4-42ae-a9aa-e88bed6a3662" containerID="8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a" exitCode=0
Sep 11 19:54:26.825497 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.825420    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"
Sep 11 19:54:26.825497 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.825432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj" event={"ID":"2a8224b4-aac4-42ae-a9aa-e88bed6a3662","Type":"ContainerDied","Data":"8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a"}
Sep 11 19:54:26.825497 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.825458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj" event={"ID":"2a8224b4-aac4-42ae-a9aa-e88bed6a3662","Type":"ContainerDied","Data":"a9866f26931fce7d2f575e82b2959007f0f9c61f61ed049063f68f156b7eec85"}
Sep 11 19:54:26.826351 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.825479    2576 scope.go:117] "RemoveContainer" containerID="8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a"
Sep 11 19:54:26.835361 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.835343    2576 scope.go:117] "RemoveContainer" containerID="8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a"
Sep 11 19:54:26.835642 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:54:26.835601    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a\": container with ID starting with 8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a not found: ID does not exist" containerID="8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a"
Sep 11 19:54:26.835642 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.835627    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a"} err="failed to get container status \"8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a\": rpc error: code = NotFound desc = could not find container \"8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a\": container with ID starting with 8eed8c5ecf50762561e172f822fb3f9dc80e65e54eefa4cbaca49de5f9c6122a not found: ID does not exist"
Sep 11 19:54:26.846541 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.846515    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"]
Sep 11 19:54:26.850091 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:26.850064    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/e2e-conflict-b-ccaf36e3-kserve-6798bcdd55-bwbzj"]
Sep 11 19:54:28.727107 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:28.727064    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a8224b4-aac4-42ae-a9aa-e88bed6a3662" path="/var/lib/kubelet/pods/2a8224b4-aac4-42ae-a9aa-e88bed6a3662/volumes"
Sep 11 19:54:37.758762 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:37.758723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:38.628107 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:38.628070    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:39.532679 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:39.532629    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:40.595646 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:40.595560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:41.666640 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:41.666603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:42.846490 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:42.846457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:43.324800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:43.324760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:44.033467 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:44.033424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:44.940476 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:44.940423    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:45.956698 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:45.956661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:46.966720 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:46.966683    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:53.115193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:53.115088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:53.214485 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:53.214446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:53.316075 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:53.316034    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:53.400443 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:53.400367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:53.899087 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:53.899057    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:54.769709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:54.769674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:55.648094 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:55.648054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:56.427262 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:56.427224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:56.524383 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:56.524351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:57.205798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:57.205765    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:58.172132 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:58.172103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:54:58.941681 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:54:58.941651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:01.473102 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:01.473066    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"]
Sep 11 19:55:01.538860 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:01.538826    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:07.399763 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:07.399730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:16.496827 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.496783    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc" podUID="c54360ad-8e1e-4a7f-a664-98bb7253115b" containerName="main" containerID="cri-o://99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0" gracePeriod=45
Sep 11 19:55:16.750829 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.750767    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:55:16.926272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926239    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54360ad-8e1e-4a7f-a664-98bb7253115b-tls-certs\") pod \"c54360ad-8e1e-4a7f-a664-98bb7253115b\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") "
Sep 11 19:55:16.926272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-tmp-dir\") pod \"c54360ad-8e1e-4a7f-a664-98bb7253115b\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") "
Sep 11 19:55:16.926524 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926309    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-dshm\") pod \"c54360ad-8e1e-4a7f-a664-98bb7253115b\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") "
Sep 11 19:55:16.926524 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-home\") pod \"c54360ad-8e1e-4a7f-a664-98bb7253115b\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") "
Sep 11 19:55:16.926524 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926442    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-model-cache\") pod \"c54360ad-8e1e-4a7f-a664-98bb7253115b\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") "
Sep 11 19:55:16.926524 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4wml\" (UniqueName: \"kubernetes.io/projected/c54360ad-8e1e-4a7f-a664-98bb7253115b-kube-api-access-m4wml\") pod \"c54360ad-8e1e-4a7f-a664-98bb7253115b\" (UID: \"c54360ad-8e1e-4a7f-a664-98bb7253115b\") "
Sep 11 19:55:16.926753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926587    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c54360ad-8e1e-4a7f-a664-98bb7253115b" (UID: "c54360ad-8e1e-4a7f-a664-98bb7253115b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:55:16.926753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-home" (OuterVolumeSpecName: "home") pod "c54360ad-8e1e-4a7f-a664-98bb7253115b" (UID: "c54360ad-8e1e-4a7f-a664-98bb7253115b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:55:16.926863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926780    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-model-cache" (OuterVolumeSpecName: "model-cache") pod "c54360ad-8e1e-4a7f-a664-98bb7253115b" (UID: "c54360ad-8e1e-4a7f-a664-98bb7253115b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:55:16.927095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926956    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:55:16.927095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.926978    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:55:16.927095 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.927074    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:55:16.928756 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.928720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-dshm" (OuterVolumeSpecName: "dshm") pod "c54360ad-8e1e-4a7f-a664-98bb7253115b" (UID: "c54360ad-8e1e-4a7f-a664-98bb7253115b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:55:16.929234 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.929205    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c54360ad-8e1e-4a7f-a664-98bb7253115b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c54360ad-8e1e-4a7f-a664-98bb7253115b" (UID: "c54360ad-8e1e-4a7f-a664-98bb7253115b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:55:16.929368 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:16.929343    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54360ad-8e1e-4a7f-a664-98bb7253115b-kube-api-access-m4wml" (OuterVolumeSpecName: "kube-api-access-m4wml") pod "c54360ad-8e1e-4a7f-a664-98bb7253115b" (UID: "c54360ad-8e1e-4a7f-a664-98bb7253115b"). InnerVolumeSpecName "kube-api-access-m4wml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:55:17.028058 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.028005    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c54360ad-8e1e-4a7f-a664-98bb7253115b-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:55:17.028058 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.028026    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c54360ad-8e1e-4a7f-a664-98bb7253115b-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:55:17.028058 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.028035    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4wml\" (UniqueName: \"kubernetes.io/projected/c54360ad-8e1e-4a7f-a664-98bb7253115b-kube-api-access-m4wml\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:55:17.104344 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.104316    2576 generic.go:356] "Generic (PLEG): container finished" podID="c54360ad-8e1e-4a7f-a664-98bb7253115b" containerID="99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0" exitCode=0
Sep 11 19:55:17.104434 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.104351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc" event={"ID":"c54360ad-8e1e-4a7f-a664-98bb7253115b","Type":"ContainerDied","Data":"99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0"}
Sep 11 19:55:17.104434 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.104359    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"
Sep 11 19:55:17.104434 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.104377    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc" event={"ID":"c54360ad-8e1e-4a7f-a664-98bb7253115b","Type":"ContainerDied","Data":"97e1921cc14ec2fc7cc9081d9ae9da7df32a0a07c36c310ec66a9447f52b8373"}
Sep 11 19:55:17.104434 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.104393    2576 scope.go:117] "RemoveContainer" containerID="99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0"
Sep 11 19:55:17.114097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.114080    2576 scope.go:117] "RemoveContainer" containerID="99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0"
Sep 11 19:55:17.114355 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:55:17.114337    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0\": container with ID starting with 99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0 not found: ID does not exist" containerID="99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0"
Sep 11 19:55:17.114407 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.114363    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0"} err="failed to get container status \"99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0\": rpc error: code = NotFound desc = could not find container \"99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0\": container with ID starting with 99abc82f78402a447bf365432470d0f299bc984db319042d4d05654d7377ccb0 not found: ID does not exist"
Sep 11 19:55:17.126702 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.126681    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"]
Sep 11 19:55:17.130439 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:17.130416    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c0517f60/e2e-lifecycle-model-c0517f60-kserve-c789b8d6c-cmvrc"]
Sep 11 19:55:18.727211 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:18.727174    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c54360ad-8e1e-4a7f-a664-98bb7253115b" path="/var/lib/kubelet/pods/c54360ad-8e1e-4a7f-a664-98bb7253115b/volumes"
Sep 11 19:55:21.680498 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:21.680461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:27.759904 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.759867    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"]
Sep 11 19:55:27.760302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.760275    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c54360ad-8e1e-4a7f-a664-98bb7253115b" containerName="main"
Sep 11 19:55:27.760302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.760287    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54360ad-8e1e-4a7f-a664-98bb7253115b" containerName="main"
Sep 11 19:55:27.760302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.760296    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8224b4-aac4-42ae-a9aa-e88bed6a3662" containerName="main"
Sep 11 19:55:27.760302 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.760301    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8224b4-aac4-42ae-a9aa-e88bed6a3662" containerName="main"
Sep 11 19:55:27.760435 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.760372    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c54360ad-8e1e-4a7f-a664-98bb7253115b" containerName="main"
Sep 11 19:55:27.760435 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.760382    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8224b4-aac4-42ae-a9aa-e88bed6a3662" containerName="main"
Sep 11 19:55:27.765069 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.765053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.767333 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.767308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"kube-root-ca.crt\""
Sep 11 19:55:27.768117 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.768091    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"openshift-service-ca.crt\""
Sep 11 19:55:27.768222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.768091    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"auth-test-model-ae268e-kserve-self-signed-certs\""
Sep 11 19:55:27.768222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.768101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"default-dockercfg-prcsz\""
Sep 11 19:55:27.774039 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.774021    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"]
Sep 11 19:55:27.822604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.822576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tmp-dir\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.822760 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.822620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-dshm\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.822837 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.822756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5fq\" (UniqueName: \"kubernetes.io/projected/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-kube-api-access-8x5fq\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.822837 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.822810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-home\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.822961 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.822841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-model-cache\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.822961 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.822872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tls-certs\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.854728 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.854697    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:27.923714 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.923690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tls-certs\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.923850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.923744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tmp-dir\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.923850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.923772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-dshm\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.923850 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.923840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5fq\" (UniqueName: \"kubernetes.io/projected/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-kube-api-access-8x5fq\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.924073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.923872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-home\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.924073 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.923890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-model-cache\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.924274 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.924249    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tmp-dir\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.924319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.924277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-home\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.924375 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.924338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-model-cache\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.926379 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.926350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-dshm\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.926588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.926568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tls-certs\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:27.938595 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:27.938565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5fq\" (UniqueName: \"kubernetes.io/projected/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-kube-api-access-8x5fq\") pod \"auth-test-model-ae268e-kserve-85f88c68c-v6mxc\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:28.075699 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:28.075605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:28.349881 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:28.349791    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"]
Sep 11 19:55:28.352323 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:55:28.352301    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podade7ee5d_c179_42a1_9ef0_eba38cd70cbd.slice/crio-c6a60fa0996d6da4ccd5b14f74e570ab4d3de9a9f0baa5b31c11cf7ee67d62c5 WatchSource:0}: Error finding container c6a60fa0996d6da4ccd5b14f74e570ab4d3de9a9f0baa5b31c11cf7ee67d62c5: Status 404 returned error can't find the container with id c6a60fa0996d6da4ccd5b14f74e570ab4d3de9a9f0baa5b31c11cf7ee67d62c5
Sep 11 19:55:29.170235 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:29.170200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc" event={"ID":"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd","Type":"ContainerStarted","Data":"7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2"}
Sep 11 19:55:29.170603 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:29.170243    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc" event={"ID":"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd","Type":"ContainerStarted","Data":"c6a60fa0996d6da4ccd5b14f74e570ab4d3de9a9f0baa5b31c11cf7ee67d62c5"}
Sep 11 19:55:29.188873 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:29.188825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc" podStartSLOduration=2.188811272 podStartE2EDuration="2.188811272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:55:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:55:29.186790085 +0000 UTC m=+1738.936045673" watchObservedRunningTime="2026-09-11 19:55:29.188811272 +0000 UTC m=+1738.938066845"
Sep 11 19:55:37.825151 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:37.825109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:38.075939 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:38.075856    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:38.075939 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:38.075900    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:38.088391 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:38.088365    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:38.231518 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:38.231489    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 19:55:38.696182 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:38.696134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:42.649379 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:42.649340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:42.750651 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:42.750608    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:55:44.603384 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:55:44.603345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:08.031065 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:08.031021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:09.342564 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:09.342522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:20.834131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:20.834087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:26.228200 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:26.228111    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:26.702097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:26.702022    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"]
Sep 11 19:56:26.702335 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:26.702283    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy" containerID="cri-o://95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93" gracePeriod=30
Sep 11 19:56:26.716924 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:26.716889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:27.943794 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:27.943737    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:28.039995 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:28.039967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:28.141790 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:28.141738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:28.706829 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:28.706791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:28.797150 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:28.797114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:28.898347 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:28.898322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:30.094677 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:30.094643    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:30.848097 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:30.848072    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:56:30.850676 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:30.850653    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 19:56:30.854267 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:30.854242    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:56:30.856778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:30.856755    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 19:56:31.147383 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:31.147297    2576 patch_prober.go:28] interesting pod/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:56:31.147383 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:31.147351    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:56:31.954518 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:31.954495    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:56:32.098205 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098165    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-data\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098381 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098292    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-credential-socket\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098381 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098328    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-podinfo\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098381 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098360    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-socket\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098388    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-token\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098425    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-envoy\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-certs\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:56:32.098515 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk842\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-kube-api-access-vk842\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098534    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istiod-ca-cert\") pod \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\" (UID: \"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5\") "
Sep 11 19:56:32.098771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098583    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:56:32.098771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098710    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:56:32.098771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.098728    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:56:32.099032 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.099012    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:56:32.099032 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.099021    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.099320 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.099045    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.099320 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.099055    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.099320 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.099063    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.100764 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.100740    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:56:32.100901 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.100770    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:56:32.101206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.101184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-kube-api-access-vk842" (OuterVolumeSpecName: "kube-api-access-vk842") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "kube-api-access-vk842". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:56:32.101274 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.101187    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" (UID: "b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:56:32.199918 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.199882    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.199918 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.199915    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.200281 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.199939    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.200281 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.199951    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk842\" (UniqueName: \"kubernetes.io/projected/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-kube-api-access-vk842\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.200281 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.199964    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:56:32.516031 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.515975    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerID="95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93" exitCode=0
Sep 11 19:56:32.516152 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.516060    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"
Sep 11 19:56:32.516152 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.516097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" event={"ID":"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5","Type":"ContainerDied","Data":"95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93"}
Sep 11 19:56:32.516229 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.516156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk" event={"ID":"b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5","Type":"ContainerDied","Data":"9367375f52e96f42c5e24e27bfa8e392d796ebb2d561b621dbfbca2aefd41eea"}
Sep 11 19:56:32.516229 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.516179    2576 scope.go:117] "RemoveContainer" containerID="95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93"
Sep 11 19:56:32.526873 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.526852    2576 scope.go:117] "RemoveContainer" containerID="a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10"
Sep 11 19:56:32.536128 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.536110    2576 scope.go:117] "RemoveContainer" containerID="95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93"
Sep 11 19:56:32.536432 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:56:32.536413    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93\": container with ID starting with 95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93 not found: ID does not exist" containerID="95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93"
Sep 11 19:56:32.536483 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.536450    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93"} err="failed to get container status \"95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93\": rpc error: code = NotFound desc = could not find container \"95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93\": container with ID starting with 95726f23d00ceae32b8c0ad0f03b0f3f6ef924dc1790d49cb5ca1209da338e93 not found: ID does not exist"
Sep 11 19:56:32.536483 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.536468    2576 scope.go:117] "RemoveContainer" containerID="a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10"
Sep 11 19:56:32.536754 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:56:32.536735    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10\": container with ID starting with a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10 not found: ID does not exist" containerID="a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10"
Sep 11 19:56:32.536860 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.536764    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10"} err="failed to get container status \"a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10\": rpc error: code = NotFound desc = could not find container \"a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10\": container with ID starting with a73f184e07e3f92d4a69c53093ee9a5f8edc42f6d694bf9525a0ec38de349a10 not found: ID does not exist"
Sep 11 19:56:32.542544 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.542518    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"]
Sep 11 19:56:32.547737 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.547704    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c0517f60-openshift-default-8498b464d8-cpvhk"]
Sep 11 19:56:32.726359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:32.726330    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" path="/var/lib/kubelet/pods/b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5/volumes"
Sep 11 19:56:33.645828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:33.645793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:33.745800 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:33.745771    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:35.715475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:35.715432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:35.813581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:35.813553    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:36.363768 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:36.363740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:42.266510 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.266479    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"]
Sep 11 19:56:42.266918 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.266902    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy"
Sep 11 19:56:42.266971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.266920    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy"
Sep 11 19:56:42.267042 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.267016    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy"
Sep 11 19:56:42.267042 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.267027    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy"
Sep 11 19:56:42.271413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.271391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.273575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.273557    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c7766c\"/\"distinct-2-w4-c7766c-kserve-self-signed-certs\""
Sep 11 19:56:42.280836 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.280814    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"]
Sep 11 19:56:42.286685 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.286659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:42.357472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.357446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:42.386811 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.386774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-tmp-dir\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.386977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.386825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-model-cache\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.386977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.386885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-dshm\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.386977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.386931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zqx7\" (UniqueName: \"kubernetes.io/projected/af61f4c3-7d66-4d16-8219-a0508b52e996-kube-api-access-9zqx7\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.386977 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.386970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af61f4c3-7d66-4d16-8219-a0508b52e996-tls-certs\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.387184 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.387078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-home\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.468000 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.467962    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:42.488246 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-home\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-tmp-dir\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-model-cache\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-dshm\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488510 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zqx7\" (UniqueName: \"kubernetes.io/projected/af61f4c3-7d66-4d16-8219-a0508b52e996-kube-api-access-9zqx7\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488510 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af61f4c3-7d66-4d16-8219-a0508b52e996-tls-certs\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488669 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-home\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488733 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-tmp-dir\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.488786 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.488740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-model-cache\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.490772 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.490751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-dshm\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.491231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.491212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af61f4c3-7d66-4d16-8219-a0508b52e996-tls-certs\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.496825 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.496802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zqx7\" (UniqueName: \"kubernetes.io/projected/af61f4c3-7d66-4d16-8219-a0508b52e996-kube-api-access-9zqx7\") pod \"distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") " pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.581420 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.581340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:42.857475 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:42.857448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"]
Sep 11 19:56:42.858539 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:56:42.858512    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf61f4c3_7d66_4d16_8219_a0508b52e996.slice/crio-e19d249b840bae8c18c562aabbb40a395eb25693b9485d3e22de76fa0e0d5e28 WatchSource:0}: Error finding container e19d249b840bae8c18c562aabbb40a395eb25693b9485d3e22de76fa0e0d5e28: Status 404 returned error can't find the container with id e19d249b840bae8c18c562aabbb40a395eb25693b9485d3e22de76fa0e0d5e28
Sep 11 19:56:43.577868 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:43.577828    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb" event={"ID":"af61f4c3-7d66-4d16-8219-a0508b52e996","Type":"ContainerStarted","Data":"e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03"}
Sep 11 19:56:43.578264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:43.577880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb" event={"ID":"af61f4c3-7d66-4d16-8219-a0508b52e996","Type":"ContainerStarted","Data":"e19d249b840bae8c18c562aabbb40a395eb25693b9485d3e22de76fa0e0d5e28"}
Sep 11 19:56:43.596044 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:43.595982    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb" podStartSLOduration=1.5959672299999998 podStartE2EDuration="1.59596723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:56:43.59367962 +0000 UTC m=+1813.342935218" watchObservedRunningTime="2026-09-11 19:56:43.59596723 +0000 UTC m=+1813.345222803"
Sep 11 19:56:44.610488 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:44.610446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:52.581893 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:52.581851    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:52.582452 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:52.581918    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:52.594456 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:52.594420    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:52.638160 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:52.638132    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:56:52.931601 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:52.931516    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:56:53.148604 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:56:53.148570    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:04.249905 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:04.249865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:14.093384 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:14.093342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:20.139231 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.139191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:20.240034 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.239968    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:20.459684 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.459591    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:20.736769 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.736731    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"]
Sep 11 19:57:20.737428 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.737409    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy"
Sep 11 19:57:20.737428 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.737430    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1aa2d8b-2b83-4cdf-8fc5-7e37fae8f0e5" containerName="istio-proxy"
Sep 11 19:57:20.741310 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.741284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.744370 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.744348    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d88566-openshift-default-dockercfg-qnvvn\""
Sep 11 19:57:20.750709 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.750685    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"]
Sep 11 19:57:20.764528 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.764502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:20.845418 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-envoy\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-credential-socket\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-certs\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6msjc\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-kube-api-access-6msjc\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845666 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-socket\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845912 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-data\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845912 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istiod-ca-cert\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845912 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-podinfo\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.845912 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.845808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-token\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.946697 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.946662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-socket\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.946922 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.946722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-data\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.946922 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.946766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istiod-ca-cert\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.946922 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.946806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-podinfo\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.946940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-token\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-socket\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-envoy\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-data\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-credential-socket\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-certs\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6msjc\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-kube-api-access-6msjc\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947531 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947425    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-credential-socket\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947588 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istiod-ca-cert\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.947807 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.947652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-certs\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.949820 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.949795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-envoy\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.949961 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.949943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-podinfo\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.955667 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.955605    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-token\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.956413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.956388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6msjc\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-kube-api-access-6msjc\") pod \"e2e-api-a-d88566-openshift-default-697cd4cb66-46clv\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") " pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:20.999861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:20.999769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:21.058145 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.058054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:21.337906 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.337879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"]
Sep 11 19:57:21.339100 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:57:21.339075    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36689aa0_4bf0_4904_b4c8_ca3d1cc8f35c.slice/crio-f43c3c856cf495fbc5f3b27fb854bf7a0d78920ec87d742df170e9944d7cd768 WatchSource:0}: Error finding container f43c3c856cf495fbc5f3b27fb854bf7a0d78920ec87d742df170e9944d7cd768: Status 404 returned error can't find the container with id f43c3c856cf495fbc5f3b27fb854bf7a0d78920ec87d742df170e9944d7cd768
Sep 11 19:57:21.341536 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.341495    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:57:21.341627 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.341609    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:57:21.341669 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.341657    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:57:21.790293 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.790256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" event={"ID":"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c","Type":"ContainerStarted","Data":"07968163b40f272bde002cf901c9e3595e41a627989678d24be00d2ace4609af"}
Sep 11 19:57:21.790469 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.790313    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" event={"ID":"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c","Type":"ContainerStarted","Data":"f43c3c856cf495fbc5f3b27fb854bf7a0d78920ec87d742df170e9944d7cd768"}
Sep 11 19:57:21.808981 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:21.808929    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podStartSLOduration=1.80891204 podStartE2EDuration="1.80891204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:57:21.807688619 +0000 UTC m=+1851.556944199" watchObservedRunningTime="2026-09-11 19:57:21.80891204 +0000 UTC m=+1851.558167614"
Sep 11 19:57:22.059279 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:22.059180    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:22.063903 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:22.063880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:22.795668 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:22.795636    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:22.796716 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:22.796698    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:57:23.631824 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:23.631788    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:23.731656 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:23.731627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:23.832587 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:23.832549    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:24.590378 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:24.590342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:25.542414 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:25.542378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:26.268335 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:26.268304    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:27.019754 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:27.019707    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:27.945061 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:27.945022    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:28.651433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:28.651401    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:28.752707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:28.752674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:28.865214 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:28.865170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:29.159116 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:29.159076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:29.258267 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:29.258234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:30.891828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:30.891795    2576 scope.go:117] "RemoveContainer" containerID="62ddce07c8b6a7973dc3111d1f78ff0bb45997b0a069b3bd1ca1e406ac79ef1a"
Sep 11 19:57:40.030788 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:40.030754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:40.397839 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:40.397746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:40.554137 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:40.554102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:48.071788 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:48.071755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:48.131616 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:48.131573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:49.594306 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:49.594272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:51.027135 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:51.027095    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:51.733858 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:51.733772    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:52.397700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:52.397629    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:53.334624 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:53.334590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:53.716000 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:53.715894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:54.030797 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.030762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:54.144749 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.144711    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:54.424941 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.424861    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"]
Sep 11 19:57:54.429055 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.429032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.431641 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.431618    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6b3e57-openshift-default-dockercfg-fpbk9\""
Sep 11 19:57:54.441911 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.441889    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"]
Sep 11 19:57:54.465284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.465247    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:54.488354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-credential-socket\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488494 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-socket\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488494 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-token\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488494 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-podinfo\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488494 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istiod-ca-cert\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wstj8\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-kube-api-access-wstj8\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-data\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-envoy\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.488750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.488729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-certs\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.589706 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.589673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-certs\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.589898 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.589721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-credential-socket\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.589898 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.589737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-socket\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.589898 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.589767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-token\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.589898 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.589796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-podinfo\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.589898 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.589832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istiod-ca-cert\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.589968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wstj8\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-kube-api-access-wstj8\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.590099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-data\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.590167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-envoy\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.590173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-certs\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.590217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-socket\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590473 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.590452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-credential-socket\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590577 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.590555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-data\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.590930 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.590908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istiod-ca-cert\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.592580 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.592559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-envoy\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.592682 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.592632    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-podinfo\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.602433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.602403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wstj8\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-kube-api-access-wstj8\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.602532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.602509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-token\") pod \"e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") " pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.637098 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.637062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:54.740734 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.740706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:54.840605 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:54.840575    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:55.022510 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:55.022480    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"]
Sep 11 19:57:55.023936 ip-10-0-130-171 kubenswrapper[2576]: W0911 19:57:55.023902    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0a1e18_2f3b_41b8_a6ad_c6adcef72876.slice/crio-db99879202e7ab5ea38bca12edd801d64df77c9c872914f596c2c985055a2bb1 WatchSource:0}: Error finding container db99879202e7ab5ea38bca12edd801d64df77c9c872914f596c2c985055a2bb1: Status 404 returned error can't find the container with id db99879202e7ab5ea38bca12edd801d64df77c9c872914f596c2c985055a2bb1
Sep 11 19:57:55.026451 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:55.026415    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:57:55.026559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:55.026499    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:57:55.026559 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:55.026546    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:57:55.894250 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:55.894205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:55.977546 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:55.977508    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" event={"ID":"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876","Type":"ContainerStarted","Data":"ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8"}
Sep 11 19:57:55.977742 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:55.977564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" event={"ID":"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876","Type":"ContainerStarted","Data":"db99879202e7ab5ea38bca12edd801d64df77c9c872914f596c2c985055a2bb1"}
Sep 11 19:57:56.003258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:56.003205    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podStartSLOduration=2.003187639 podStartE2EDuration="2.003187639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:57:56.001972613 +0000 UTC m=+1885.751228214" watchObservedRunningTime="2026-09-11 19:57:56.003187639 +0000 UTC m=+1885.752443214"
Sep 11 19:57:56.602630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:56.602597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:56.741888 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:56.741855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:56.747230 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:56.747204    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:56.985951 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:56.985915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:56.995564 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:56.995521    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:57:57.481365 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:57.481325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:57.908548 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:57.908438    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:58.002729 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:58.002694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:58.316882 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:58.316843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:59.128053 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:59.128016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:57:59.899124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:57:59.899067    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:00.572776 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:00.572740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:01.421041 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:01.421007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:02.230020 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:02.229965    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:03.019384 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:03.019333    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:03.845840 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:03.845804    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:04.003364 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:04.003322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:04.400917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:04.400888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:04.506903 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:04.506867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:06.043519 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:06.043492    2576 generic.go:356] "Generic (PLEG): container finished" podID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerID="07968163b40f272bde002cf901c9e3595e41a627989678d24be00d2ace4609af" exitCode=0
Sep 11 19:58:06.044059 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:06.043565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" event={"ID":"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c","Type":"ContainerDied","Data":"07968163b40f272bde002cf901c9e3595e41a627989678d24be00d2ace4609af"}
Sep 11 19:58:06.044140 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:06.044068    2576 scope.go:117] "RemoveContainer" containerID="07968163b40f272bde002cf901c9e3595e41a627989678d24be00d2ace4609af"
Sep 11 19:58:06.045239 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:06.045206    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:58:06.045323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:06.045276    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:58:06.045323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:06.045315    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:58:07.050715 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:07.050682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" event={"ID":"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c","Type":"ContainerStarted","Data":"46d3f592610814deac326b03e9937f69cd16c44b05d3833676f0912823721217"}
Sep 11 19:58:07.058382 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:07.058360    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:58:07.059188 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:07.059163    2576 patch_prober.go:28] interesting pod/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:58:07.059305 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:07.059217    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 19:58:07.795737 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:07.795698    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:58:08.058967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:08.058879    2576 patch_prober.go:28] interesting pod/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:58:08.058967 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:08.058939    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 19:58:09.058725 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:09.058691    2576 patch_prober.go:28] interesting pod/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:58:09.058921 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:09.058744    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 19:58:10.058917 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:10.058880    2576 patch_prober.go:28] interesting pod/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:58:10.059327 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:10.058934    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 19:58:11.058593 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:11.058559    2576 patch_prober.go:28] interesting pod/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:58:11.058773 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:11.058613    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 19:58:12.058619 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:12.058588    2576 patch_prober.go:28] interesting pod/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:58:12.059050 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:12.058642    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 11 19:58:13.063561 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:13.063527    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:58:13.064750 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:13.064728    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:58:26.022630 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:26.022596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:27.032139 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:27.032108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:27.715242 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:27.715201    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:27.917022 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:27.916970    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:28.028164 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:28.028121    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 19:58:28.028342 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:28.028213    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:58:28.492222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:28.492179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:29.345775 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:29.345738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:30.061864 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.061824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:30.211970 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.211943    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerID="ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8" exitCode=0
Sep 11 19:58:30.212159 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.212011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" event={"ID":"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876","Type":"ContainerDied","Data":"ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8"}
Sep 11 19:58:30.214738 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.213083    2576 scope.go:117] "RemoveContainer" containerID="ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8"
Sep 11 19:58:30.219836 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.219786    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:58:30.220410 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.220327    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:58:30.220907 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.220878    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 19:58:30.922264 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:30.922232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:31.219362 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:31.219327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" event={"ID":"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876","Type":"ContainerStarted","Data":"358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a"}
Sep 11 19:58:31.741352 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:31.741319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:58:31.741564 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:31.741542    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:58:31.741611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:31.741592    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 19:58:31.753802 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:31.753778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:32.553540 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:32.553501    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:32.741396 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:32.741361    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:58:32.741557 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:32.741409    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 19:58:33.399349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:33.399311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:33.741369 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:33.741335    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:58:33.741734 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:33.741391    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 19:58:34.245376 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:34.245346    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:34.741070 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:34.741038    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:58:34.741260 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:34.741095    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 19:58:34.944942 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:34.944910    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:35.727334 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:35.727292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:35.741915 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:35.741885    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:58:35.742072 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:35.741938    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 19:58:36.418788 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:36.418754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:36.741812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:36.741778    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:58:36.742037 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:36.741842    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 11 19:58:37.131472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:37.131361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:37.746046 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:37.746010    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:58:37.746511 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:37.746359    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:58:37.747111 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:37.747090    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:58:37.936216 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:37.936184    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:40.819531 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:40.819486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:43.730378 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:43.730348    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:46.443707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:46.443669    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:46.513427 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:46.513396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:46.576012 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:46.575946    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:46.646434 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:46.646396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:46.710422 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:46.710322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:46.992532 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:46.992493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:47.111133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:47.111094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:47.921617 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:47.921578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:48.738701 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:48.738672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:49.733117 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:49.733084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:50.639218 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:50.639186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:51.322893 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:51.322861    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:52.117854 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:52.117820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:52.916284 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:52.916240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:53.056407 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:53.056364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:53.157834 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:53.157789    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:53.305704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:53.305672    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"]
Sep 11 19:58:53.305919 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:53.305894    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" containerID="cri-o://46d3f592610814deac326b03e9937f69cd16c44b05d3833676f0912823721217" gracePeriod=30
Sep 11 19:58:53.323210 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:53.323179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:54.019403 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:54.019367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:54.986509 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:54.986467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:55.705682 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:55.705649    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:56.433998 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:56.433948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:57.334568 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:57.334535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:58.065957 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.065921    2576 patch_prober.go:28] interesting pod/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:58:58.066147 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.066004    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:58:58.223947 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.223915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:58.370354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.370321    2576 generic.go:356] "Generic (PLEG): container finished" podID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerID="46d3f592610814deac326b03e9937f69cd16c44b05d3833676f0912823721217" exitCode=0
Sep 11 19:58:58.370834 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.370364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" event={"ID":"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c","Type":"ContainerDied","Data":"46d3f592610814deac326b03e9937f69cd16c44b05d3833676f0912823721217"}
Sep 11 19:58:58.370834 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.370431    2576 scope.go:117] "RemoveContainer" containerID="07968163b40f272bde002cf901c9e3595e41a627989678d24be00d2ace4609af"
Sep 11 19:58:58.476052 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.476029    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:58:58.569851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.569768    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-credential-socket\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.569851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.569801    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-certs\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.569851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.569841    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6msjc\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-kube-api-access-6msjc\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.570193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.569860    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-data\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.570193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.569942    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-podinfo\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.570193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.569969    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-token\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.570193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570041    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:58:58.570193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570063    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istiod-ca-cert\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.570193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-envoy\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.570506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570205    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:58:58.570506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570270    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-data" (OuterVolumeSpecName: "istio-data") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:58:58.570506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570303    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-socket\") pod \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\" (UID: \"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c\") "
Sep 11 19:58:58.570506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570457    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:58:58.570506 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570497    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:58:58.570929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570728    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.570929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570750    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.570929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570762    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.570929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570771    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.570929 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.570779    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.572453 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.572430    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-kube-api-access-6msjc" (OuterVolumeSpecName: "kube-api-access-6msjc") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "kube-api-access-6msjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:58:58.572567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.572490    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:58:58.572713 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.572694    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-token" (OuterVolumeSpecName: "istio-token") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:58:58.572758 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.572720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" (UID: "36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:58:58.672377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.672341    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.672377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.672372    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6msjc\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-kube-api-access-6msjc\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.672377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.672382    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:58.672613 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:58.672392    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:58:59.023291 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.023252    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:59.377279 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.377189    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"
Sep 11 19:58:59.377279 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.377212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv" event={"ID":"36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c","Type":"ContainerDied","Data":"f43c3c856cf495fbc5f3b27fb854bf7a0d78920ec87d742df170e9944d7cd768"}
Sep 11 19:58:59.377799 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.377295    2576 scope.go:117] "RemoveContainer" containerID="46d3f592610814deac326b03e9937f69cd16c44b05d3833676f0912823721217"
Sep 11 19:58:59.394615 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.394590    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"]
Sep 11 19:58:59.398635 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.398613    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d88566-openshift-default-697cd4cb66-46clv"]
Sep 11 19:58:59.661461 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.661378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:59.762195 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.762164    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:58:59.970972 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:58:59.970938    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:00.727069 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:00.727036    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" path="/var/lib/kubelet/pods/36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c/volumes"
Sep 11 19:59:00.785283 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:00.785241    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:01.462963 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:01.462925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:02.347453 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:02.347421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:03.171557 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:03.171525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:04.001221 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:04.001191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:04.654270 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:04.654233    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"]
Sep 11 19:59:04.689812 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:04.689774    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"]
Sep 11 19:59:04.776949 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:04.776913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:04.953042 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:04.952940    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"]
Sep 11 19:59:04.967225 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:04.967197    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"]
Sep 11 19:59:05.044631 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:05.044596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:05.145312 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:05.145280    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:05.856272 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:05.856238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:06.721359 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:06.721321    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:09.950771 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:09.950734    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:12.419592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:12.419561    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:12.498169 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:12.498142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:12.562420 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:12.562384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:12.658589 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:12.658562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:12.769394 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:12.769356    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:13.009898 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.009863    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:13.109873 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.109774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:13.702719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.702682    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:13.710851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.710804    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"]
Sep 11 19:59:13.713514 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.713493    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c7766c-29819265-6wp8w"]
Sep 11 19:59:13.778918 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.778888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:13.840844 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.840812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:13.941612 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:13.941579    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:14.090099 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:14.090055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:14.166372 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:14.166340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:14.439419 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:14.439339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:14.727187 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:14.727157    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8939c546-7efa-496f-b312-8f85b420a28a" path="/var/lib/kubelet/pods/8939c546-7efa-496f-b312-8f85b420a28a/volumes"
Sep 11 19:59:15.204490 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:15.204389    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:15.941950 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:15.941909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:16.654556 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:16.654518    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:17.282070 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.282032    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"]
Sep 11 19:59:17.282482 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.282285    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp" podUID="d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" containerName="maas-api" containerID="cri-o://743d8675a450f5488c499100856eb69d9ef680fa6e8a3e22f9967d44be1f6fba" gracePeriod=30
Sep 11 19:59:17.317592 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.317559    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:17.392640 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.392599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:17.457425 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.457325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:17.481831 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.481794    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" containerID="743d8675a450f5488c499100856eb69d9ef680fa6e8a3e22f9967d44be1f6fba" exitCode=0
Sep 11 19:59:17.482025 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.481930    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp" event={"ID":"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc","Type":"ContainerDied","Data":"743d8675a450f5488c499100856eb69d9ef680fa6e8a3e22f9967d44be1f6fba"}
Sep 11 19:59:17.542088 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.542031    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:59:17.556034 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.555981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:17.654691 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.654654    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:17.664707 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.664669    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-openshift-service-ca\") pod \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") "
Sep 11 19:59:17.664875 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.664732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87m8r\" (UniqueName: \"kubernetes.io/projected/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-kube-api-access-87m8r\") pod \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") "
Sep 11 19:59:17.664875 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.664822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-metrics-certs\") pod \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") "
Sep 11 19:59:17.665016 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.664915    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-maas-api-tls\") pod \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\" (UID: \"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc\") "
Sep 11 19:59:17.665109 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.665083    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" (UID: "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:59:17.665339 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.665321    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:17.667124 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.667101    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" (UID: "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:59:17.667245 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.667225    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-kube-api-access-87m8r" (OuterVolumeSpecName: "kube-api-access-87m8r") pod "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" (UID: "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc"). InnerVolumeSpecName "kube-api-access-87m8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:17.667291 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.667263    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" (UID: "d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:59:17.766596 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.766564    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87m8r\" (UniqueName: \"kubernetes.io/projected/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-kube-api-access-87m8r\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:17.766596 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.766596    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:17.766596 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.766605    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:17.943960 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:17.943865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:18.448950 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:18.448914    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:18.490076 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:18.490045    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"
Sep 11 19:59:18.490076 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:18.490071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp" event={"ID":"d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc","Type":"ContainerDied","Data":"77a634c3dfe63b6c73c5f5be825e6b0b3bc2c6f83e1297c8af265783e8e2124d"}
Sep 11 19:59:18.490280 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:18.490136    2576 scope.go:117] "RemoveContainer" containerID="743d8675a450f5488c499100856eb69d9ef680fa6e8a3e22f9967d44be1f6fba"
Sep 11 19:59:18.517427 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:18.517389    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"]
Sep 11 19:59:18.520123 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:18.520104    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-10cc24-846fdbf878-zg9zp"]
Sep 11 19:59:18.727149 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:18.727120    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" path="/var/lib/kubelet/pods/d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc/volumes"
Sep 11 19:59:19.285793 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.285762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:19.674578 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.674487    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g" podUID="e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" containerName="main" containerID="cri-o://842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5" gracePeriod=45
Sep 11 19:59:19.699190 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.699160    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:19.709026 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.708982    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45" podUID="c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" containerName="main" containerID="cri-o://a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664" gracePeriod=45
Sep 11 19:59:19.800232 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.800199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:19.945919 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.945836    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"]
Sep 11 19:59:19.946444 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.946403    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" containerID="cri-o://358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a" gracePeriod=30
Sep 11 19:59:19.973718 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.973679    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb" podUID="af61f4c3-7d66-4d16-8219-a0508b52e996" containerName="main" containerID="cri-o://e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03" gracePeriod=45
Sep 11 19:59:19.976893 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.976868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:19.987511 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.987477    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:59:19.989704 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:19.989604    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc" podUID="a7d34ea6-30dc-4793-9d80-8bd27588293b" containerName="main" containerID="cri-o://a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64" gracePeriod=45
Sep 11 19:59:20.094291 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094249    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-dshm\") pod \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") "
Sep 11 19:59:20.094481 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094307    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tmp-dir\") pod \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") "
Sep 11 19:59:20.094481 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094341    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-home\") pod \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") "
Sep 11 19:59:20.094481 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094405    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-model-cache\") pod \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") "
Sep 11 19:59:20.094481 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tls-certs\") pod \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") "
Sep 11 19:59:20.094719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094534    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" (UID: "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.094719 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094627    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jddzh\" (UniqueName: \"kubernetes.io/projected/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-kube-api-access-jddzh\") pod \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\" (UID: \"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051\") "
Sep 11 19:59:20.094829 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094770    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-model-cache" (OuterVolumeSpecName: "model-cache") pod "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" (UID: "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.094884 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.094832    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-home" (OuterVolumeSpecName: "home") pod "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" (UID: "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.095123 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.095067    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.095123 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.095095    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.095123 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.095107    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.097036 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.096972    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-dshm" (OuterVolumeSpecName: "dshm") pod "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" (UID: "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.097356 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.097312    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-kube-api-access-jddzh" (OuterVolumeSpecName: "kube-api-access-jddzh") pod "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" (UID: "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051"). InnerVolumeSpecName "kube-api-access-jddzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:20.097505 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.097482    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" (UID: "e54ac1f9-58d6-4cbc-a95b-f5559e5dc051"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:59:20.105587 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.105564    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:59:20.195787 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.195741    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tls-certs\") pod \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") "
Sep 11 19:59:20.196017 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.195829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tmp-dir\") pod \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") "
Sep 11 19:59:20.196017 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.195869    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-home\") pod \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") "
Sep 11 19:59:20.196017 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.195916    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7r55\" (UniqueName: \"kubernetes.io/projected/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-kube-api-access-s7r55\") pod \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") "
Sep 11 19:59:20.196433 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.196403    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-home" (OuterVolumeSpecName: "home") pod "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" (UID: "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.196518 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.196427    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" (UID: "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.196611 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.196585    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-model-cache\") pod \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") "
Sep 11 19:59:20.196882 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.196752    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-dshm\") pod \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\" (UID: \"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57\") "
Sep 11 19:59:20.197074 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.196936    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-model-cache" (OuterVolumeSpecName: "model-cache") pod "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" (UID: "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.197895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.197327    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.197895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.197376    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.197895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.197390    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.197895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.197401    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.197895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.197441    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jddzh\" (UniqueName: \"kubernetes.io/projected/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-kube-api-access-jddzh\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.197895 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.197457    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.199209 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.198790    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-kube-api-access-s7r55" (OuterVolumeSpecName: "kube-api-access-s7r55") pod "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" (UID: "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57"). InnerVolumeSpecName "kube-api-access-s7r55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:20.199209 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.198875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" (UID: "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:59:20.199280 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.199212    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-dshm" (OuterVolumeSpecName: "dshm") pod "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" (UID: "c7d254f7-d5e5-488e-8bbc-dd9918c0ff57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.251163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.251133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:20.259470 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.259443    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:59:20.264203 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.264177    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.298441    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-home\") pod \"af61f4c3-7d66-4d16-8219-a0508b52e996\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") "
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.299492    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-model-cache\") pod \"af61f4c3-7d66-4d16-8219-a0508b52e996\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") "
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.299566    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af61f4c3-7d66-4d16-8219-a0508b52e996-tls-certs\") pod \"af61f4c3-7d66-4d16-8219-a0508b52e996\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") "
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.299591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-dshm\") pod \"af61f4c3-7d66-4d16-8219-a0508b52e996\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") "
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.299639    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zqx7\" (UniqueName: \"kubernetes.io/projected/af61f4c3-7d66-4d16-8219-a0508b52e996-kube-api-access-9zqx7\") pod \"af61f4c3-7d66-4d16-8219-a0508b52e996\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") "
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.299675    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-tmp-dir\") pod \"af61f4c3-7d66-4d16-8219-a0508b52e996\" (UID: \"af61f4c3-7d66-4d16-8219-a0508b52e996\") "
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.299830    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-model-cache" (OuterVolumeSpecName: "model-cache") pod "af61f4c3-7d66-4d16-8219-a0508b52e996" (UID: "af61f4c3-7d66-4d16-8219-a0508b52e996"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.299952    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-home" (OuterVolumeSpecName: "home") pod "af61f4c3-7d66-4d16-8219-a0508b52e996" (UID: "af61f4c3-7d66-4d16-8219-a0508b52e996"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.300212    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.300235    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7r55\" (UniqueName: \"kubernetes.io/projected/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-kube-api-access-s7r55\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.300251    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.300267    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.300280    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.300723 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.300470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af61f4c3-7d66-4d16-8219-a0508b52e996" (UID: "af61f4c3-7d66-4d16-8219-a0508b52e996"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.303253 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.303221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-dshm" (OuterVolumeSpecName: "dshm") pod "af61f4c3-7d66-4d16-8219-a0508b52e996" (UID: "af61f4c3-7d66-4d16-8219-a0508b52e996"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.303838 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.303799    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af61f4c3-7d66-4d16-8219-a0508b52e996-kube-api-access-9zqx7" (OuterVolumeSpecName: "kube-api-access-9zqx7") pod "af61f4c3-7d66-4d16-8219-a0508b52e996" (UID: "af61f4c3-7d66-4d16-8219-a0508b52e996"). InnerVolumeSpecName "kube-api-access-9zqx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:20.304133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.304108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af61f4c3-7d66-4d16-8219-a0508b52e996-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af61f4c3-7d66-4d16-8219-a0508b52e996" (UID: "af61f4c3-7d66-4d16-8219-a0508b52e996"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:59:20.401581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.401544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-dshm\") pod \"a7d34ea6-30dc-4793-9d80-8bd27588293b\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") "
Sep 11 19:59:20.401778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.401608    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-home\") pod \"a7d34ea6-30dc-4793-9d80-8bd27588293b\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") "
Sep 11 19:59:20.401778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.401665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzttw\" (UniqueName: \"kubernetes.io/projected/a7d34ea6-30dc-4793-9d80-8bd27588293b-kube-api-access-dzttw\") pod \"a7d34ea6-30dc-4793-9d80-8bd27588293b\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") "
Sep 11 19:59:20.401778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.401715    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-tmp-dir\") pod \"a7d34ea6-30dc-4793-9d80-8bd27588293b\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") "
Sep 11 19:59:20.401778 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.401758    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d34ea6-30dc-4793-9d80-8bd27588293b-tls-certs\") pod \"a7d34ea6-30dc-4793-9d80-8bd27588293b\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") "
Sep 11 19:59:20.402030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.401802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-model-cache\") pod \"a7d34ea6-30dc-4793-9d80-8bd27588293b\" (UID: \"a7d34ea6-30dc-4793-9d80-8bd27588293b\") "
Sep 11 19:59:20.402030 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.401863    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-home" (OuterVolumeSpecName: "home") pod "a7d34ea6-30dc-4793-9d80-8bd27588293b" (UID: "a7d34ea6-30dc-4793-9d80-8bd27588293b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.402130 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402061    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a7d34ea6-30dc-4793-9d80-8bd27588293b" (UID: "a7d34ea6-30dc-4793-9d80-8bd27588293b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.402130 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402090    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a7d34ea6-30dc-4793-9d80-8bd27588293b" (UID: "a7d34ea6-30dc-4793-9d80-8bd27588293b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.402222 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402212    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zqx7\" (UniqueName: \"kubernetes.io/projected/af61f4c3-7d66-4d16-8219-a0508b52e996-kube-api-access-9zqx7\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.402258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402228    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.402258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402243    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.402258 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402254    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.402354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402265    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.402354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402280    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af61f4c3-7d66-4d16-8219-a0508b52e996-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.402354 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.402291    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af61f4c3-7d66-4d16-8219-a0508b52e996-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.403913 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.403893    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-dshm" (OuterVolumeSpecName: "dshm") pod "a7d34ea6-30dc-4793-9d80-8bd27588293b" (UID: "a7d34ea6-30dc-4793-9d80-8bd27588293b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:20.404009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.403937    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7d34ea6-30dc-4793-9d80-8bd27588293b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a7d34ea6-30dc-4793-9d80-8bd27588293b" (UID: "a7d34ea6-30dc-4793-9d80-8bd27588293b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:59:20.404009 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.403977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7d34ea6-30dc-4793-9d80-8bd27588293b-kube-api-access-dzttw" (OuterVolumeSpecName: "kube-api-access-dzttw") pod "a7d34ea6-30dc-4793-9d80-8bd27588293b" (UID: "a7d34ea6-30dc-4793-9d80-8bd27588293b"). InnerVolumeSpecName "kube-api-access-dzttw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:20.503092 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.503056    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7d34ea6-30dc-4793-9d80-8bd27588293b-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.503092 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.503092    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzttw\" (UniqueName: \"kubernetes.io/projected/a7d34ea6-30dc-4793-9d80-8bd27588293b-kube-api-access-dzttw\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.503353 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.503105    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7d34ea6-30dc-4793-9d80-8bd27588293b-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:20.508521 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.508482    2576 generic.go:356] "Generic (PLEG): container finished" podID="af61f4c3-7d66-4d16-8219-a0508b52e996" containerID="e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03" exitCode=0
Sep 11 19:59:20.508521 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.508533    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"
Sep 11 19:59:20.508753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.508607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb" event={"ID":"af61f4c3-7d66-4d16-8219-a0508b52e996","Type":"ContainerDied","Data":"e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03"}
Sep 11 19:59:20.508753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.508647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb" event={"ID":"af61f4c3-7d66-4d16-8219-a0508b52e996","Type":"ContainerDied","Data":"e19d249b840bae8c18c562aabbb40a395eb25693b9485d3e22de76fa0e0d5e28"}
Sep 11 19:59:20.508753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.508670    2576 scope.go:117] "RemoveContainer" containerID="e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03"
Sep 11 19:59:20.514010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.510653    2576 generic.go:356] "Generic (PLEG): container finished" podID="e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" containerID="842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5" exitCode=0
Sep 11 19:59:20.514010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.510744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g" event={"ID":"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051","Type":"ContainerDied","Data":"842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5"}
Sep 11 19:59:20.514010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.510774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g" event={"ID":"e54ac1f9-58d6-4cbc-a95b-f5559e5dc051","Type":"ContainerDied","Data":"4c6c71dd54b8783567cb6bcc7a5c0aab50102bf54172d82e1dea55f750a43e4f"}
Sep 11 19:59:20.514010 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.510835    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"
Sep 11 19:59:20.522886 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.522852    2576 generic.go:356] "Generic (PLEG): container finished" podID="a7d34ea6-30dc-4793-9d80-8bd27588293b" containerID="a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64" exitCode=0
Sep 11 19:59:20.523042 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.523026    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"
Sep 11 19:59:20.523864 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.523646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc" event={"ID":"a7d34ea6-30dc-4793-9d80-8bd27588293b","Type":"ContainerDied","Data":"a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64"}
Sep 11 19:59:20.523864 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.523695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc" event={"ID":"a7d34ea6-30dc-4793-9d80-8bd27588293b","Type":"ContainerDied","Data":"26c626e16dcb8907edca3d3e70124cf7383a6e3ae592322f74864adcbfe23f0d"}
Sep 11 19:59:20.529567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.527597    2576 scope.go:117] "RemoveContainer" containerID="e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03"
Sep 11 19:59:20.529567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.527816    2576 generic.go:356] "Generic (PLEG): container finished" podID="c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" containerID="a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664" exitCode=0
Sep 11 19:59:20.529567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.527933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45" event={"ID":"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57","Type":"ContainerDied","Data":"a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664"}
Sep 11 19:59:20.529567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.527967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45" event={"ID":"c7d254f7-d5e5-488e-8bbc-dd9918c0ff57","Type":"ContainerDied","Data":"19dfcce41dd5614972d5ade5538d53c145d9e819d8c1a35b2dfcfcbe42789bff"}
Sep 11 19:59:20.529567 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.528048    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"
Sep 11 19:59:20.530654 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:20.530632    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03\": container with ID starting with e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03 not found: ID does not exist" containerID="e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03"
Sep 11 19:59:20.530831 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.530805    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03"} err="failed to get container status \"e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03\": rpc error: code = NotFound desc = could not find container \"e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03\": container with ID starting with e37cba5901a04c888fcc71825bd14c78eba252bcb50444e8c03308bf81c95d03 not found: ID does not exist"
Sep 11 19:59:20.530941 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.530931    2576 scope.go:117] "RemoveContainer" containerID="842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5"
Sep 11 19:59:20.545976 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.545957    2576 scope.go:117] "RemoveContainer" containerID="842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5"
Sep 11 19:59:20.546365 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:20.546345    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5\": container with ID starting with 842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5 not found: ID does not exist" containerID="842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5"
Sep 11 19:59:20.546444 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.546377    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5"} err="failed to get container status \"842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5\": rpc error: code = NotFound desc = could not find container \"842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5\": container with ID starting with 842c8d15cd4be0bfdf9960c7c30fa47173d9c81bbd8562bb32f2f03e6f1111d5 not found: ID does not exist"
Sep 11 19:59:20.546444 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.546400    2576 scope.go:117] "RemoveContainer" containerID="a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64"
Sep 11 19:59:20.554863 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.554837    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"]
Sep 11 19:59:20.558753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.558732    2576 scope.go:117] "RemoveContainer" containerID="a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64"
Sep 11 19:59:20.559192 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:20.559170    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64\": container with ID starting with a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64 not found: ID does not exist" containerID="a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64"
Sep 11 19:59:20.559262 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.559200    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64"} err="failed to get container status \"a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64\": rpc error: code = NotFound desc = could not find container \"a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64\": container with ID starting with a2212a2aa5602eb762641850a6a3303588459c0b97ddf2bb8c6981ae928f8b64 not found: ID does not exist"
Sep 11 19:59:20.559262 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.559221    2576 scope.go:117] "RemoveContainer" containerID="a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664"
Sep 11 19:59:20.560145 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.560122    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/distinct-2-w4-c7766c-kserve-74dbdd78f6-8dxhb"]
Sep 11 19:59:20.564718 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.564694    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"]
Sep 11 19:59:20.568193 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.568173    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/distinct-w0-10cc24-kserve-59f94fc59d-4qm8g"]
Sep 11 19:59:20.568275 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.568179    2576 scope.go:117] "RemoveContainer" containerID="a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664"
Sep 11 19:59:20.568514 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:20.568494    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664\": container with ID starting with a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664 not found: ID does not exist" containerID="a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664"
Sep 11 19:59:20.568583 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.568526    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664"} err="failed to get container status \"a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664\": rpc error: code = NotFound desc = could not find container \"a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664\": container with ID starting with a08aed2ab63b971130a14c0edd642c102ad325e9c948c33fe061342b58a54664 not found: ID does not exist"
Sep 11 19:59:20.578350 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.578324    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"]
Sep 11 19:59:20.581924 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.581902    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-10cc24/premium-w0-10cc24-kserve-7476b4449f-vhn45"]
Sep 11 19:59:20.592319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.592297    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"]
Sep 11 19:59:20.597048 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.597027    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c7766c/premium-w4-c7766c-kserve-6d47f9bc96-g9rwc"]
Sep 11 19:59:20.728108 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.728075    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7d34ea6-30dc-4793-9d80-8bd27588293b" path="/var/lib/kubelet/pods/a7d34ea6-30dc-4793-9d80-8bd27588293b/volumes"
Sep 11 19:59:20.728492 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.728478    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af61f4c3-7d66-4d16-8219-a0508b52e996" path="/var/lib/kubelet/pods/af61f4c3-7d66-4d16-8219-a0508b52e996/volumes"
Sep 11 19:59:20.728821 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.728810    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" path="/var/lib/kubelet/pods/c7d254f7-d5e5-488e-8bbc-dd9918c0ff57/volumes"
Sep 11 19:59:20.729458 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:20.729442    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" path="/var/lib/kubelet/pods/e54ac1f9-58d6-4cbc-a95b-f5559e5dc051/volumes"
Sep 11 19:59:21.130838 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:21.130801    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:21.772545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:21.772463    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:21.869319 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:21.869284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:22.009082 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:22.009044    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"]
Sep 11 19:59:22.009375 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:22.009323    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy" containerID="cri-o://5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c" gracePeriod=30
Sep 11 19:59:22.011150 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:22.011128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:22.152449 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:22.152358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:22.749267 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:22.749227    2576 patch_prober.go:28] interesting pod/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:59:22.749413 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:22.749298    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:59:22.899216 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:22.899181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:23.742389 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:23.742359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:24.330809 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:24.330779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:24.432377 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:24.432339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:24.596453 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:24.596366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:24.691798 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:24.691769    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:25.203311 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.203288    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:59:25.352722 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.352676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-token\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.352722 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.352734    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-credential-socket\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.352777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-envoy\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.352952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-data\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-certs\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353086    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-socket\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353149    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istiod-ca-cert\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353140    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:25.353349 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353301    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:25.353717 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353199    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-podinfo\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353717 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353452    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:25.353717 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wstj8\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-kube-api-access-wstj8\") pod \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\" (UID: \"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876\") "
Sep 11 19:59:25.353717 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.353669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:25.354064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.354017    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.354064 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.354044    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.354224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.354058    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.354224 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.354155    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.354539 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.354443    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:59:25.355581 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.355547    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:25.355725 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.355706    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:25.355861 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.355837    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:59:25.356062 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.356038    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-kube-api-access-wstj8" (OuterVolumeSpecName: "kube-api-access-wstj8") pod "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" (UID: "9e0a1e18-2f3b-41b8-a6ad-c6adcef72876"). InnerVolumeSpecName "kube-api-access-wstj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:25.454828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.454790    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wstj8\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-kube-api-access-wstj8\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.454828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.454824    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.454828 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.454833    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.455085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.454840    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.455085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.454849    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:25.563013 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.562952    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerID="358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a" exitCode=0
Sep 11 19:59:25.563217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.563023    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"
Sep 11 19:59:25.563217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.563050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" event={"ID":"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876","Type":"ContainerDied","Data":"358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a"}
Sep 11 19:59:25.563217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.563123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl" event={"ID":"9e0a1e18-2f3b-41b8-a6ad-c6adcef72876","Type":"ContainerDied","Data":"db99879202e7ab5ea38bca12edd801d64df77c9c872914f596c2c985055a2bb1"}
Sep 11 19:59:25.563217 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.563154    2576 scope.go:117] "RemoveContainer" containerID="358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a"
Sep 11 19:59:25.573545 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.573523    2576 scope.go:117] "RemoveContainer" containerID="ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8"
Sep 11 19:59:25.582194 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.582178    2576 scope.go:117] "RemoveContainer" containerID="358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a"
Sep 11 19:59:25.582550 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:25.582521    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a\": container with ID starting with 358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a not found: ID does not exist" containerID="358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a"
Sep 11 19:59:25.582655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.582584    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a"} err="failed to get container status \"358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a\": rpc error: code = NotFound desc = could not find container \"358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a\": container with ID starting with 358351cd6e146a714d0e853c611cea9510f38a2c8689c63f4b5c4421f364278a not found: ID does not exist"
Sep 11 19:59:25.582655 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.582609    2576 scope.go:117] "RemoveContainer" containerID="ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8"
Sep 11 19:59:25.583911 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:25.583876    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8\": container with ID starting with ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8 not found: ID does not exist" containerID="ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8"
Sep 11 19:59:25.584068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.583922    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8"} err="failed to get container status \"ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8\": rpc error: code = NotFound desc = could not find container \"ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8\": container with ID starting with ea69fe3411a4564a66b8ef90c5084ddfb93bb80ca838d7a7e4ff371f8293d5c8 not found: ID does not exist"
Sep 11 19:59:25.592769 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.592206    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"]
Sep 11 19:59:25.595445 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:25.595421    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6b3e57-openshift-default-694bffbd5d-8wkcl"]
Sep 11 19:59:26.725622 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:26.725586    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" path="/var/lib/kubelet/pods/9e0a1e18-2f3b-41b8-a6ad-c6adcef72876/volumes"
Sep 11 19:59:27.256212 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.256188    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:59:27.374163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafdff16-c931-4653-b1e1-03b48f75175a-istio-podinfo\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374127    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-istio-token\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374163 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374156    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-credential-socket\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374340    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx5jx\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-kube-api-access-gx5jx\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-envoy\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374441 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:27.374622 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374461    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafdff16-c931-4653-b1e1-03b48f75175a-istiod-ca-cert\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374622 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374507    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-certs\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374622 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374526    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-data\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374622 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374565    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-socket\") pod \"fafdff16-c931-4653-b1e1-03b48f75175a\" (UID: \"fafdff16-c931-4653-b1e1-03b48f75175a\") "
Sep 11 19:59:27.374826 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374765    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:27.374885 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fafdff16-c931-4653-b1e1-03b48f75175a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:59:27.374966 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.374946    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:27.375085 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.375059    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:27.375133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.375094    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafdff16-c931-4653-b1e1-03b48f75175a-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.375133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.375110    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.375133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.375118    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.375133 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.375127    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.377068 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.377044    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:27.377177 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.377084    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fafdff16-c931-4653-b1e1-03b48f75175a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:59:27.377237 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.377213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-kube-api-access-gx5jx" (OuterVolumeSpecName: "kube-api-access-gx5jx") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "kube-api-access-gx5jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:27.377237 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.377215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fafdff16-c931-4653-b1e1-03b48f75175a" (UID: "fafdff16-c931-4653-b1e1-03b48f75175a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:27.475737 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.475698    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.475737 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.475732    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafdff16-c931-4653-b1e1-03b48f75175a-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.475737 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.475746    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.475974 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.475759    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx5jx\" (UniqueName: \"kubernetes.io/projected/fafdff16-c931-4653-b1e1-03b48f75175a-kube-api-access-gx5jx\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.475974 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.475771    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafdff16-c931-4653-b1e1-03b48f75175a-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:27.576557 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.576522    2576 generic.go:356] "Generic (PLEG): container finished" podID="fafdff16-c931-4653-b1e1-03b48f75175a" containerID="5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c" exitCode=0
Sep 11 19:59:27.576753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.576570    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"
Sep 11 19:59:27.576753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.576603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" event={"ID":"fafdff16-c931-4653-b1e1-03b48f75175a","Type":"ContainerDied","Data":"5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c"}
Sep 11 19:59:27.576753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.576664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b" event={"ID":"fafdff16-c931-4653-b1e1-03b48f75175a","Type":"ContainerDied","Data":"929102c583ab0548e86c49797fe256f597d78f3e3394e75a60ee4b8753466621"}
Sep 11 19:59:27.576753 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.576695    2576 scope.go:117] "RemoveContainer" containerID="5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c"
Sep 11 19:59:27.586208 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.586190    2576 scope.go:117] "RemoveContainer" containerID="e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de"
Sep 11 19:59:27.594840 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.594819    2576 scope.go:117] "RemoveContainer" containerID="5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c"
Sep 11 19:59:27.595141 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:27.595122    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c\": container with ID starting with 5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c not found: ID does not exist" containerID="5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c"
Sep 11 19:59:27.595209 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.595152    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c"} err="failed to get container status \"5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c\": rpc error: code = NotFound desc = could not find container \"5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c\": container with ID starting with 5ce99b4ee6927242f674e809c4a07505c7bf454a5085e43f05ac00993106619c not found: ID does not exist"
Sep 11 19:59:27.595209 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.595169    2576 scope.go:117] "RemoveContainer" containerID="e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de"
Sep 11 19:59:27.595450 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:27.595431    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de\": container with ID starting with e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de not found: ID does not exist" containerID="e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de"
Sep 11 19:59:27.595497 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.595456    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de"} err="failed to get container status \"e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de\": rpc error: code = NotFound desc = could not find container \"e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de\": container with ID starting with e44c06266ea814c0610010d698d45a6802fbedebfa067343699958265e1d25de not found: ID does not exist"
Sep 11 19:59:27.599826 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.599805    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"]
Sep 11 19:59:27.603956 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:27.603935    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c7766c-openshift-default-7bb98d8d96-jmd2b"]
Sep 11 19:59:28.726796 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:28.726761    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" path="/var/lib/kubelet/pods/fafdff16-c931-4653-b1e1-03b48f75175a/volumes"
Sep 11 19:59:30.429131 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:30.429100    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:30.926715 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:30.926685    2576 scope.go:117] "RemoveContainer" containerID="98524497f0928afcf5f45637853927ae52f87b3d9a29249b8b2ea36309a82051"
Sep 11 19:59:31.015461 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:31.015433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:31.115681 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:31.115646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:31.205572 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:31.205474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:31.271825 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:31.271791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:31.567634 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:31.567601    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:31.637662 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:31.637475    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:32.357945 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:32.357908    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:33.201283 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:33.201240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:34.023173 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:34.023134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:37.413700 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:37.413662    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:37.470457 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:37.470420    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:37.637206 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:37.637172    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"]
Sep 11 19:59:37.637512 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:37.637486    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy" containerID="cri-o://2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e" gracePeriod=30
Sep 11 19:59:37.660110 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:37.660080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:38.324067 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:38.323981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:39.022638 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:39.022603    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:39.940028 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:39.939949    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:40.630381 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:40.630292    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:41.527043 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:41.527006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:42.890851 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.890828    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:59:42.922755 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.922684    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76403f8-c234-4158-b368-8efdd870f10e-istio-podinfo\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.922755 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.922716    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdsj7\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-kube-api-access-qdsj7\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.922755 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.922746    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-certs\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.923051 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.922774    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-data\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.923051 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.922896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-socket\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.923051 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923013    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-istio-token\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.923238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923051    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-envoy\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.923238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923077    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-data" (OuterVolumeSpecName: "istio-data") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:42.923238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-credential-socket\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.923238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923093    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:42.923238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76403f8-c234-4158-b368-8efdd870f10e-istiod-ca-cert\") pod \"c76403f8-c234-4158-b368-8efdd870f10e\" (UID: \"c76403f8-c234-4158-b368-8efdd870f10e\") "
Sep 11 19:59:42.923238 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923191    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:42.923757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923397    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:42.923757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923513    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:42.923757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923533    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:42.923757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923547    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:42.923757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923561    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:42.923757 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.923563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76403f8-c234-4158-b368-8efdd870f10e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:59:42.925341 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.925312    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c76403f8-c234-4158-b368-8efdd870f10e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:59:42.925450 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.925407    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-kube-api-access-qdsj7" (OuterVolumeSpecName: "kube-api-access-qdsj7") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "kube-api-access-qdsj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:42.925718 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.925694    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:59:42.925718 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:42.925704    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-istio-token" (OuterVolumeSpecName: "istio-token") pod "c76403f8-c234-4158-b368-8efdd870f10e" (UID: "c76403f8-c234-4158-b368-8efdd870f10e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:59:43.010379 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.010343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:43.024323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.024290    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c76403f8-c234-4158-b368-8efdd870f10e-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:43.024323 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.024321    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c76403f8-c234-4158-b368-8efdd870f10e-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:43.024504 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.024334    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c76403f8-c234-4158-b368-8efdd870f10e-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:43.024504 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.024347    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdsj7\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-kube-api-access-qdsj7\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:43.024504 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.024365    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c76403f8-c234-4158-b368-8efdd870f10e-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 19:59:43.073770 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.073725    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:43.144521 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.144491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:43.300114 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.300085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:43.401197 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.401159    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:43.622244 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.622149    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:43.660955 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.660917    2576 generic.go:356] "Generic (PLEG): container finished" podID="c76403f8-c234-4158-b368-8efdd870f10e" containerID="2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e" exitCode=0
Sep 11 19:59:43.660955 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.660952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" event={"ID":"c76403f8-c234-4158-b368-8efdd870f10e","Type":"ContainerDied","Data":"2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e"}
Sep 11 19:59:43.661201 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.660971    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"
Sep 11 19:59:43.661201 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.661032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc" event={"ID":"c76403f8-c234-4158-b368-8efdd870f10e","Type":"ContainerDied","Data":"4a919bcbb5a7221c13625e794b9018ff084361985eafa03bdd934d4da517503f"}
Sep 11 19:59:43.661201 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.661057    2576 scope.go:117] "RemoveContainer" containerID="2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e"
Sep 11 19:59:43.670734 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.670715    2576 scope.go:117] "RemoveContainer" containerID="5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713"
Sep 11 19:59:43.678614 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.678600    2576 scope.go:117] "RemoveContainer" containerID="2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e"
Sep 11 19:59:43.678875 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:43.678852    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e\": container with ID starting with 2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e not found: ID does not exist" containerID="2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e"
Sep 11 19:59:43.678971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.678880    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e"} err="failed to get container status \"2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e\": rpc error: code = NotFound desc = could not find container \"2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e\": container with ID starting with 2603255453ee962a5ed1cba506344189528741c94e45a74dd5907abe9267e55e not found: ID does not exist"
Sep 11 19:59:43.678971 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.678898    2576 scope.go:117] "RemoveContainer" containerID="5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713"
Sep 11 19:59:43.679138 ip-10-0-130-171 kubenswrapper[2576]: E0911 19:59:43.679124    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713\": container with ID starting with 5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713 not found: ID does not exist" containerID="5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713"
Sep 11 19:59:43.679176 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.679141    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713"} err="failed to get container status \"5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713\": rpc error: code = NotFound desc = could not find container \"5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713\": container with ID starting with 5916c1e6e6e501ab5f7190f762431af06728a34a77ee5f91febefea3ca9f2713 not found: ID does not exist"
Sep 11 19:59:43.683809 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.683786    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"]
Sep 11 19:59:43.688126 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:43.688104    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d14d7e-openshift-default-54c7fd85d8-pkhgc"]
Sep 11 19:59:44.726470 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:44.726432    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c76403f8-c234-4158-b368-8efdd870f10e" path="/var/lib/kubelet/pods/c76403f8-c234-4158-b368-8efdd870f10e/volumes"
Sep 11 19:59:48.774501 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:48.774472    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:48.857472 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:48.857433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:48.964658 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:48.964629    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:49.061012 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:49.060895    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:49.340280 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:49.340189    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:49.440435 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:49.440403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:50.148230 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:50.148191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:51.005283 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:51.005243    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:55.203575 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:55.203540    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:55.304958 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:55.304927    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:55.468892 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:55.468859    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:58.280247 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:58.280205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 19:59:59.098066 ip-10-0-130-171 kubenswrapper[2576]: I0911 19:59:59.098027    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:01.046113 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:01.046076    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"]
Sep 11 20:00:01.065378 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:01.065351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:02.896213 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:02.896179    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"]
Sep 11 20:00:02.960160 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:02.960121    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:12.590712 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:12.590676    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:16.065929 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.065890    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg" podUID="5448fbce-6952-488b-af69-30c9c884bb77" containerName="main" containerID="cri-o://074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32" gracePeriod=45
Sep 11 20:00:16.317126 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.317070    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 20:00:16.434387 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434356    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-tmp-dir\") pod \"5448fbce-6952-488b-af69-30c9c884bb77\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") "
Sep 11 20:00:16.434548 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-home\") pod \"5448fbce-6952-488b-af69-30c9c884bb77\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") "
Sep 11 20:00:16.434548 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434419    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5448fbce-6952-488b-af69-30c9c884bb77-tls-certs\") pod \"5448fbce-6952-488b-af69-30c9c884bb77\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") "
Sep 11 20:00:16.434548 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434451    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-dshm\") pod \"5448fbce-6952-488b-af69-30c9c884bb77\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") "
Sep 11 20:00:16.434666 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434550    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk87l\" (UniqueName: \"kubernetes.io/projected/5448fbce-6952-488b-af69-30c9c884bb77-kube-api-access-fk87l\") pod \"5448fbce-6952-488b-af69-30c9c884bb77\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") "
Sep 11 20:00:16.434666 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-model-cache\") pod \"5448fbce-6952-488b-af69-30c9c884bb77\" (UID: \"5448fbce-6952-488b-af69-30c9c884bb77\") "
Sep 11 20:00:16.434751 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434660    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-home" (OuterVolumeSpecName: "home") pod "5448fbce-6952-488b-af69-30c9c884bb77" (UID: "5448fbce-6952-488b-af69-30c9c884bb77"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:16.434751 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434676    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5448fbce-6952-488b-af69-30c9c884bb77" (UID: "5448fbce-6952-488b-af69-30c9c884bb77"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:16.434868 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434851    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-model-cache" (OuterVolumeSpecName: "model-cache") pod "5448fbce-6952-488b-af69-30c9c884bb77" (UID: "5448fbce-6952-488b-af69-30c9c884bb77"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:16.435028 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.434981    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:16.435088 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.435038    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:16.435088 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.435053    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:16.436837 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.436812    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-dshm" (OuterVolumeSpecName: "dshm") pod "5448fbce-6952-488b-af69-30c9c884bb77" (UID: "5448fbce-6952-488b-af69-30c9c884bb77"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:16.436944 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.436871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5448fbce-6952-488b-af69-30c9c884bb77-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5448fbce-6952-488b-af69-30c9c884bb77" (UID: "5448fbce-6952-488b-af69-30c9c884bb77"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:00:16.436944 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.436879    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5448fbce-6952-488b-af69-30c9c884bb77-kube-api-access-fk87l" (OuterVolumeSpecName: "kube-api-access-fk87l") pod "5448fbce-6952-488b-af69-30c9c884bb77" (UID: "5448fbce-6952-488b-af69-30c9c884bb77"). InnerVolumeSpecName "kube-api-access-fk87l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:00:16.535867 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.535825    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk87l\" (UniqueName: \"kubernetes.io/projected/5448fbce-6952-488b-af69-30c9c884bb77-kube-api-access-fk87l\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:16.535867 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.535860    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5448fbce-6952-488b-af69-30c9c884bb77-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:16.535867 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.535871    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5448fbce-6952-488b-af69-30c9c884bb77-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:16.818574 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.818544    2576 generic.go:356] "Generic (PLEG): container finished" podID="5448fbce-6952-488b-af69-30c9c884bb77" containerID="074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32" exitCode=0
Sep 11 20:00:16.818748 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.818598    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"
Sep 11 20:00:16.818748 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.818636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg" event={"ID":"5448fbce-6952-488b-af69-30c9c884bb77","Type":"ContainerDied","Data":"074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32"}
Sep 11 20:00:16.818748 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.818682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg" event={"ID":"5448fbce-6952-488b-af69-30c9c884bb77","Type":"ContainerDied","Data":"0e342a67b4eb58c40627e9278b7a51d6772cdaddb3992e89e4e2f2faf1cb6274"}
Sep 11 20:00:16.818748 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.818698    2576 scope.go:117] "RemoveContainer" containerID="074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32"
Sep 11 20:00:16.828112 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.828088    2576 scope.go:117] "RemoveContainer" containerID="074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32"
Sep 11 20:00:16.828409 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:00:16.828379    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32\": container with ID starting with 074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32 not found: ID does not exist" containerID="074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32"
Sep 11 20:00:16.828483 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.828406    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32"} err="failed to get container status \"074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32\": rpc error: code = NotFound desc = could not find container \"074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32\": container with ID starting with 074aa9f8d565099e1f12bc3540090a8cac0d01618f1660d81378721e6387fc32 not found: ID does not exist"
Sep 11 20:00:16.835629 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.835603    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"]
Sep 11 20:00:16.839328 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:16.839297    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58c78c/auth-test-model-58c78c-kserve-6c54d6f44c-4z7hg"]
Sep 11 20:00:17.918213 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:17.918177    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc" podUID="ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" containerName="main" containerID="cri-o://7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2" gracePeriod=45
Sep 11 20:00:18.163241 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.163215    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 20:00:18.353032 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.352974    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tls-certs\") pod \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") "
Sep 11 20:00:18.353256 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-model-cache\") pod \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") "
Sep 11 20:00:18.353256 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-home\") pod \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") "
Sep 11 20:00:18.353256 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353150    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x5fq\" (UniqueName: \"kubernetes.io/projected/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-kube-api-access-8x5fq\") pod \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") "
Sep 11 20:00:18.353256 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353167    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-dshm\") pod \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") "
Sep 11 20:00:18.353256 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353221    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tmp-dir\") pod \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\" (UID: \"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd\") "
Sep 11 20:00:18.353539 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-model-cache" (OuterVolumeSpecName: "model-cache") pod "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" (UID: "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:18.353539 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353437    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-home" (OuterVolumeSpecName: "home") pod "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" (UID: "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:18.353539 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353504    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" (UID: "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:18.353683 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353545    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:18.353683 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.353559    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:18.355547 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.355513    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-dshm" (OuterVolumeSpecName: "dshm") pod "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" (UID: "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:00:18.355660 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.355540    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-kube-api-access-8x5fq" (OuterVolumeSpecName: "kube-api-access-8x5fq") pod "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" (UID: "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd"). InnerVolumeSpecName "kube-api-access-8x5fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:00:18.355660 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.355616    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" (UID: "ade7ee5d-c179-42a1-9ef0-eba38cd70cbd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:00:18.454415 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.454379    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:18.454415 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.454409    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x5fq\" (UniqueName: \"kubernetes.io/projected/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-kube-api-access-8x5fq\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:18.454415 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.454421    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:18.454656 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.454432    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:00:18.727476 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.727445    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5448fbce-6952-488b-af69-30c9c884bb77" path="/var/lib/kubelet/pods/5448fbce-6952-488b-af69-30c9c884bb77/volumes"
Sep 11 20:00:18.830068 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.830033    2576 generic.go:356] "Generic (PLEG): container finished" podID="ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" containerID="7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2" exitCode=0
Sep 11 20:00:18.830251 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.830080    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"
Sep 11 20:00:18.830251 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.830126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc" event={"ID":"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd","Type":"ContainerDied","Data":"7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2"}
Sep 11 20:00:18.830251 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.830172    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc" event={"ID":"ade7ee5d-c179-42a1-9ef0-eba38cd70cbd","Type":"ContainerDied","Data":"c6a60fa0996d6da4ccd5b14f74e570ab4d3de9a9f0baa5b31c11cf7ee67d62c5"}
Sep 11 20:00:18.830251 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.830196    2576 scope.go:117] "RemoveContainer" containerID="7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2"
Sep 11 20:00:18.838725 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.838708    2576 scope.go:117] "RemoveContainer" containerID="7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2"
Sep 11 20:00:18.839018 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:00:18.838979    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2\": container with ID starting with 7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2 not found: ID does not exist" containerID="7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2"
Sep 11 20:00:18.839064 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.839028    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2"} err="failed to get container status \"7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2\": rpc error: code = NotFound desc = could not find container \"7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2\": container with ID starting with 7e15ee8a3940d7538a7c219c1bcd33a1321ad68b5eb0ada335db503fbe478fd2 not found: ID does not exist"
Sep 11 20:00:18.846011 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.845972    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"]
Sep 11 20:00:18.853402 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:18.853380    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/auth-test-model-ae268e-kserve-85f88c68c-v6mxc"]
Sep 11 20:00:20.727089 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:20.727056    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" path="/var/lib/kubelet/pods/ade7ee5d-c179-42a1-9ef0-eba38cd70cbd/volumes"
Sep 11 20:00:59.073581 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073492    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"]
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073866    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" containerName="maas-api"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073878    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" containerName="maas-api"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073886    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5448fbce-6952-488b-af69-30c9c884bb77" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073892    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5448fbce-6952-488b-af69-30c9c884bb77" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073900    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073905    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073911    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073916    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073926    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af61f4c3-7d66-4d16-8219-a0508b52e996" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073931    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af61f4c3-7d66-4d16-8219-a0508b52e996" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073937    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073942    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073948    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073953    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073962    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073967    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073973    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.073978    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074001    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074006    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074013    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074017    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074030    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074036    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074042    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d34ea6-30dc-4793-9d80-8bd27588293b" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074046    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d34ea6-30dc-4793-9d80-8bd27588293b" containerName="main"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074056    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy"
Sep 11 20:00:59.074059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074061    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074111    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af61f4c3-7d66-4d16-8219-a0508b52e996" containerName="main"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074119    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d34ea6-30dc-4793-9d80-8bd27588293b" containerName="main"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074124    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074129    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074135    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074140    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade7ee5d-c179-42a1-9ef0-eba38cd70cbd" containerName="main"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074146    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6e8f7f7-c7a9-49c9-87d1-1f5eac3901bc" containerName="maas-api"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074150    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fafdff16-c931-4653-b1e1-03b48f75175a" containerName="istio-proxy"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074155    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074159    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5448fbce-6952-488b-af69-30c9c884bb77" containerName="main"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074165    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d254f7-d5e5-488e-8bbc-dd9918c0ff57" containerName="main"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074170    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e54ac1f9-58d6-4cbc-a95b-f5559e5dc051" containerName="main"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074174    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36689aa0-4bf0-4904-b4c8-ca3d1cc8f35c" containerName="istio-proxy"
Sep 11 20:00:59.074999 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.074180    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy"
Sep 11 20:00:59.076952 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.076937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.079918 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.079893    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"kube-root-ca.crt\""
Sep 11 20:00:59.079918 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.079903    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"default-dockercfg-prcsz\""
Sep 11 20:00:59.080132 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.079907    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"sub-test-model-ae268e-kserve-self-signed-certs\""
Sep 11 20:00:59.080132 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.079935    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"openshift-service-ca.crt\""
Sep 11 20:00:59.087823 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.087799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"]
Sep 11 20:00:59.119654 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.119615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-model-cache\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.119816 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.119688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-home\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.119816 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.119723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tls-certs\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.119912 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.119833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-dshm\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.119912 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.119871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tmp-dir\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.119912 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.119901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5fnj\" (UniqueName: \"kubernetes.io/projected/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-kube-api-access-k5fnj\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.155470 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.155431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:00:59.220349 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-model-cache\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-home\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tls-certs\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-dshm\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tmp-dir\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5fnj\" (UniqueName: \"kubernetes.io/projected/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-kube-api-access-k5fnj\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220789 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-model-cache\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220789 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-home\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.220900 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.220809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tmp-dir\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.222816 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.222796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-dshm\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.223125 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.223107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tls-certs\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.228034 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.227976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5fnj\" (UniqueName: \"kubernetes.io/projected/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-kube-api-access-k5fnj\") pod \"sub-test-model-ae268e-kserve-6fcc654fc7-4nx82\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.387908 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.387823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:00:59.661516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:00:59.661435    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"]
Sep 11 20:00:59.665239 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:00:59.665214    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d6db728_bd58_43aa_aff1_ba1e9aa23bc7.slice/crio-c1e599f403f9bf3527d54e762ec3d27ac2ab30087142fdbbfbf7042110a906e7 WatchSource:0}: Error finding container c1e599f403f9bf3527d54e762ec3d27ac2ab30087142fdbbfbf7042110a906e7: Status 404 returned error can't find the container with id c1e599f403f9bf3527d54e762ec3d27ac2ab30087142fdbbfbf7042110a906e7
Sep 11 20:01:00.022706 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:00.022671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82" event={"ID":"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7","Type":"ContainerStarted","Data":"44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9"}
Sep 11 20:01:00.022885 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:00.022715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82" event={"ID":"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7","Type":"ContainerStarted","Data":"c1e599f403f9bf3527d54e762ec3d27ac2ab30087142fdbbfbf7042110a906e7"}
Sep 11 20:01:00.040734 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:00.040686    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82" podStartSLOduration=1.040672242 podStartE2EDuration="1.040672242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:01:00.039411738 +0000 UTC m=+2069.788667329" watchObservedRunningTime="2026-09-11 20:01:00.040672242 +0000 UTC m=+2069.789927815"
Sep 11 20:01:09.389072 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:09.389016    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:01:09.389508 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:09.389099    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:01:09.401598 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:09.401575    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:01:10.079672 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:10.079639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:01:16.688459 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:16.688414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:01:30.878514 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:30.878488    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 20:01:30.880461 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:30.880438    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 20:01:30.893636 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:30.893600    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 20:01:30.896339 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:30.896320    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 20:01:33.969183 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:33.969147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:01:34.951444 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:34.951414    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"]
Sep 11 20:01:34.973764 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:34.973733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:01:41.620548 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:41.620512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:01:49.970898 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:49.970853    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82" podUID="0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" containerName="main" containerID="cri-o://44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9" gracePeriod=45
Sep 11 20:01:50.069173 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.069138    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82" podUID="0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": dial tcp 10.134.0.62:8000: connect: connection refused"
Sep 11 20:01:50.220285 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.220263    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:01:50.260643 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.260571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tls-certs\") pod \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") "
Sep 11 20:01:50.260786 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.260644    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-dshm\") pod \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") "
Sep 11 20:01:50.260786 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.260692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-home\") pod \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") "
Sep 11 20:01:50.260786 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.260736    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tmp-dir\") pod \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") "
Sep 11 20:01:50.260972 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.260788    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5fnj\" (UniqueName: \"kubernetes.io/projected/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-kube-api-access-k5fnj\") pod \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") "
Sep 11 20:01:50.260972 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.260814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-model-cache\") pod \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\" (UID: \"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7\") "
Sep 11 20:01:50.261122 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.261013    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-home" (OuterVolumeSpecName: "home") pod "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" (UID: "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:50.261122 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.261068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" (UID: "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:50.261242 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.261144    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:01:50.261399 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.261373    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" (UID: "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:50.263273 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.263242    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" (UID: "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:01:50.263633 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.263608    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-dshm" (OuterVolumeSpecName: "dshm") pod "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" (UID: "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:01:50.263773 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.263752    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-kube-api-access-k5fnj" (OuterVolumeSpecName: "kube-api-access-k5fnj") pod "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" (UID: "0d6db728-bd58-43aa-aff1-ba1e9aa23bc7"). InnerVolumeSpecName "kube-api-access-k5fnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:01:50.266593 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.266566    2576 generic.go:356] "Generic (PLEG): container finished" podID="0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" containerID="44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9" exitCode=0
Sep 11 20:01:50.266688 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.266611    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"
Sep 11 20:01:50.266752 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.266609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82" event={"ID":"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7","Type":"ContainerDied","Data":"44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9"}
Sep 11 20:01:50.266752 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.266725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82" event={"ID":"0d6db728-bd58-43aa-aff1-ba1e9aa23bc7","Type":"ContainerDied","Data":"c1e599f403f9bf3527d54e762ec3d27ac2ab30087142fdbbfbf7042110a906e7"}
Sep 11 20:01:50.266752 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.266749    2576 scope.go:117] "RemoveContainer" containerID="44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9"
Sep 11 20:01:50.281083 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.281064    2576 scope.go:117] "RemoveContainer" containerID="44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9"
Sep 11 20:01:50.281370 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:01:50.281352    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9\": container with ID starting with 44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9 not found: ID does not exist" containerID="44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9"
Sep 11 20:01:50.281455 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.281382    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9"} err="failed to get container status \"44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9\": rpc error: code = NotFound desc = could not find container \"44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9\": container with ID starting with 44f8850316a75fe35115d6d4d47481e504c89dbdd9fc5b967fa5f8d012e953d9 not found: ID does not exist"
Sep 11 20:01:50.291951 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.291927    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"]
Sep 11 20:01:50.296495 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.296476    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/sub-test-model-ae268e-kserve-6fcc654fc7-4nx82"]
Sep 11 20:01:50.362519 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.362477    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5fnj\" (UniqueName: \"kubernetes.io/projected/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-kube-api-access-k5fnj\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:01:50.362519 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.362512    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:01:50.362519 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.362524    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:01:50.362747 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.362537    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:01:50.362747 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.362547    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:01:50.727307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:01:50.727268    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" path="/var/lib/kubelet/pods/0d6db728-bd58-43aa-aff1-ba1e9aa23bc7/volumes"
Sep 11 20:02:04.765877 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.765840    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"]
Sep 11 20:02:04.766479 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.766458    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy"
Sep 11 20:02:04.766546 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.766483    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76403f8-c234-4158-b368-8efdd870f10e" containerName="istio-proxy"
Sep 11 20:02:04.766546 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.766498    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" containerName="main"
Sep 11 20:02:04.766546 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.766507    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" containerName="main"
Sep 11 20:02:04.766649 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.766631    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d6db728-bd58-43aa-aff1-ba1e9aa23bc7" containerName="main"
Sep 11 20:02:04.766649 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.766645    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e0a1e18-2f3b-41b8-a6ad-c6adcef72876" containerName="istio-proxy"
Sep 11 20:02:04.769588 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.769568    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.772823 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.772779    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"kube-root-ca.crt\""
Sep 11 20:02:04.773086 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.773063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"openshift-service-ca.crt\""
Sep 11 20:02:04.773699 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.773507    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"default-dockercfg-prcsz\""
Sep 11 20:02:04.773699 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.773558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ae268e\"/\"rate-test-model-ae268e-kserve-self-signed-certs\""
Sep 11 20:02:04.777384 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.777356    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"]
Sep 11 20:02:04.883157 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.883123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-home\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.883305 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.883159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-model-cache\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.883305 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.883245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twktb\" (UniqueName: \"kubernetes.io/projected/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-kube-api-access-twktb\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.883305 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.883292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-dshm\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.883461 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.883359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tmp-dir\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.883461 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.883395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tls-certs\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.957920 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.957885    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:04.983966 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.983941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twktb\" (UniqueName: \"kubernetes.io/projected/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-kube-api-access-twktb\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984053 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.983972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-dshm\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984053 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.984043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tmp-dir\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984144 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.984058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tls-certs\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984144 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.984103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-home\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984144 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.984125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-model-cache\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984508 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.984475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tmp-dir\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984608 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.984560    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-home\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.984608 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.984572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-model-cache\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.986387 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.986367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-dshm\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.986799 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.986780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tls-certs\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:04.991661 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:04.991637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twktb\" (UniqueName: \"kubernetes.io/projected/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-kube-api-access-twktb\") pod \"rate-test-model-ae268e-kserve-db68c8b7-zvqxg\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") " pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:05.055569 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:05.055497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:05.082506 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:05.082485    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:05.360525 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:05.360502    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"]
Sep 11 20:02:05.363106 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:02:05.363077    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99ebdd9f_4ca2_4edc_bcfe_b491f91172f3.slice/crio-067483082e48206d8fc3dd99ba9b44d32de64c659d85a20e5e6d2089375b4b8f WatchSource:0}: Error finding container 067483082e48206d8fc3dd99ba9b44d32de64c659d85a20e5e6d2089375b4b8f: Status 404 returned error can't find the container with id 067483082e48206d8fc3dd99ba9b44d32de64c659d85a20e5e6d2089375b4b8f
Sep 11 20:02:06.348563 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:06.348520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg" event={"ID":"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3","Type":"ContainerStarted","Data":"617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450"}
Sep 11 20:02:06.348941 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:06.348571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg" event={"ID":"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3","Type":"ContainerStarted","Data":"067483082e48206d8fc3dd99ba9b44d32de64c659d85a20e5e6d2089375b4b8f"}
Sep 11 20:02:06.365609 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:06.365563    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg" podStartSLOduration=2.365547438 podStartE2EDuration="2.365547438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:02:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:02:06.364375395 +0000 UTC m=+2136.113630989" watchObservedRunningTime="2026-09-11 20:02:06.365547438 +0000 UTC m=+2136.114803059"
Sep 11 20:02:15.083568 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:15.083528    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:15.084129 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:15.083587    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:15.096379 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:15.096346    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:15.403708 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:15.403629    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:32.062909 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:32.062874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:41.153464 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:41.153424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:43.176075 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:43.176043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:44.178559 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:44.178522    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"]
Sep 11 20:02:44.202301 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:44.202264    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:44.617592 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:44.617556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:44.915785 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:44.915689    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:45.098732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:45.098696    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:46.919376 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:46.919338    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:47.589810 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:47.589754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:47.687738 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:47.687703    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:48.735931 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:48.735898    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:49.463713 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:49.463675    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:49.565126 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:49.565082    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:49.667169 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:49.667135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:49.961261 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:49.961233    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:50.024253 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:50.024211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:02:59.198635 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.198574    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg" podUID="99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" containerName="main" containerID="cri-o://617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450" gracePeriod=45
Sep 11 20:02:59.446623 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.446592    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:59.517456 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-dshm\") pod \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") "
Sep 11 20:02:59.517587 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tls-certs\") pod \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") "
Sep 11 20:02:59.517587 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517560    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twktb\" (UniqueName: \"kubernetes.io/projected/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-kube-api-access-twktb\") pod \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") "
Sep 11 20:02:59.517587 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517584    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-home\") pod \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") "
Sep 11 20:02:59.517696 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tmp-dir\") pod \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") "
Sep 11 20:02:59.517740 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517696    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-model-cache\") pod \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\" (UID: \"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3\") "
Sep 11 20:02:59.517961 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517933    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-home" (OuterVolumeSpecName: "home") pod "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" (UID: "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:02:59.517961 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.517949    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" (UID: "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:02:59.518189 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.518048    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" (UID: "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:02:59.518189 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.518077    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:02:59.518189 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.518097    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:02:59.519735 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.519717    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" (UID: "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:02:59.520184 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.520167    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-kube-api-access-twktb" (OuterVolumeSpecName: "kube-api-access-twktb") pod "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" (UID: "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3"). InnerVolumeSpecName "kube-api-access-twktb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:02:59.520241 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.520185    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-dshm" (OuterVolumeSpecName: "dshm") pod "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" (UID: "99ebdd9f-4ca2-4edc-bcfe-b491f91172f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:02:59.618743 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.618719    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:02:59.618743 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.618740    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:02:59.618891 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.618749    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:02:59.618891 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.618759    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twktb\" (UniqueName: \"kubernetes.io/projected/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3-kube-api-access-twktb\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:02:59.629298 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.629275    2576 generic.go:356] "Generic (PLEG): container finished" podID="99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" containerID="617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450" exitCode=0
Sep 11 20:02:59.629407 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.629336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg" event={"ID":"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3","Type":"ContainerDied","Data":"617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450"}
Sep 11 20:02:59.629407 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.629370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg" event={"ID":"99ebdd9f-4ca2-4edc-bcfe-b491f91172f3","Type":"ContainerDied","Data":"067483082e48206d8fc3dd99ba9b44d32de64c659d85a20e5e6d2089375b4b8f"}
Sep 11 20:02:59.629407 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.629379    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"
Sep 11 20:02:59.629407 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.629391    2576 scope.go:117] "RemoveContainer" containerID="617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450"
Sep 11 20:02:59.638713 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.638696    2576 scope.go:117] "RemoveContainer" containerID="617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450"
Sep 11 20:02:59.638973 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:02:59.638954    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450\": container with ID starting with 617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450 not found: ID does not exist" containerID="617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450"
Sep 11 20:02:59.639051 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.638982    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450"} err="failed to get container status \"617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450\": rpc error: code = NotFound desc = could not find container \"617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450\": container with ID starting with 617c2dbbd3f9645db9f9d1f523b05ab75ef44da4c425bdaa613fd86f8fe4f450 not found: ID does not exist"
Sep 11 20:02:59.649860 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.649834    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"]
Sep 11 20:02:59.653661 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:02:59.653642    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ae268e/rate-test-model-ae268e-kserve-db68c8b7-zvqxg"]
Sep 11 20:03:00.726336 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:00.726296    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" path="/var/lib/kubelet/pods/99ebdd9f-4ca2-4edc-bcfe-b491f91172f3/volumes"
Sep 11 20:03:12.448430 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:12.448396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:12.548878 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:12.548842    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:13.199070 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.199037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:13.342589 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.342549    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:13.467649 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.467618    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"]
Sep 11 20:03:13.468177 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.468161    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" containerName="main"
Sep 11 20:03:13.468229 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.468180    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" containerName="main"
Sep 11 20:03:13.468307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.468296    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="99ebdd9f-4ca2-4edc-bcfe-b491f91172f3" containerName="main"
Sep 11 20:03:13.471564 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.471544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.473913 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.473888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5df0d4-openshift-default-dockercfg-ztbnd\""
Sep 11 20:03:13.482203 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.482178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"]
Sep 11 20:03:13.495419 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.495376    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:13.535887 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.535862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcscx\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-kube-api-access-xcscx\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536042 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.535899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-istio-token\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536042 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.535919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-certs\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536042 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.536028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-envoy\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536203 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.536068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-socket\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536203 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.536090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-credential-socket\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536203 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.536168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-data\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536361 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.536260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d492f47c-42de-4218-b753-b1c4d855f383-istio-podinfo\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.536361 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.536309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d492f47c-42de-4218-b753-b1c4d855f383-istiod-ca-cert\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.637530 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.637491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-envoy\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.637737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.637546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-socket\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.637737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.637566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-credential-socket\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.637737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.637589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-data\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.637737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.637626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d492f47c-42de-4218-b753-b1c4d855f383-istio-podinfo\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.637737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.637653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d492f47c-42de-4218-b753-b1c4d855f383-istiod-ca-cert\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.637737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.637671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcscx\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-kube-api-access-xcscx\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.638112 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.638081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-credential-socket\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.638112 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.638098    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-data\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.638397 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.638373    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-socket\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.638695 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.638671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d492f47c-42de-4218-b753-b1c4d855f383-istiod-ca-cert\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.638742 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.638042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-istio-token\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.638784 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.638771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-certs\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.639040 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.639024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-certs\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.640345 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.640319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d492f47c-42de-4218-b753-b1c4d855f383-istio-podinfo\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.640449 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.640361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-envoy\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.644973 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.644945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-istio-token\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.645289 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.645268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcscx\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-kube-api-access-xcscx\") pod \"e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") " pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:13.786132 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:13.786046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:14.034154 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.034110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:14.065064 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.065041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"]
Sep 11 20:03:14.067556 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:03:14.067529    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd492f47c_42de_4218_b753_b1c4d855f383.slice/crio-d54c171667b0a481e4b5f1006e0c9b10c1f8dcb71d3148125c6e580d8f911250 WatchSource:0}: Error finding container d54c171667b0a481e4b5f1006e0c9b10c1f8dcb71d3148125c6e580d8f911250: Status 404 returned error can't find the container with id d54c171667b0a481e4b5f1006e0c9b10c1f8dcb71d3148125c6e580d8f911250
Sep 11 20:03:14.070166 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.070131    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:03:14.070256 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.070196    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:03:14.070256 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.070227    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:03:14.708455 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.708406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" event={"ID":"d492f47c-42de-4218-b753-b1c4d855f383","Type":"ContainerStarted","Data":"e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1"}
Sep 11 20:03:14.708955 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.708500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" event={"ID":"d492f47c-42de-4218-b753-b1c4d855f383","Type":"ContainerStarted","Data":"d54c171667b0a481e4b5f1006e0c9b10c1f8dcb71d3148125c6e580d8f911250"}
Sep 11 20:03:14.730808 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.730757    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podStartSLOduration=1.730740234 podStartE2EDuration="1.730740234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:03:14.728578782 +0000 UTC m=+2204.477834367" watchObservedRunningTime="2026-09-11 20:03:14.730740234 +0000 UTC m=+2204.479995808"
Sep 11 20:03:14.786581 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.786545    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:14.803027 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:14.802974    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:15.003320 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:15.003282    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:15.791779 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:15.791744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:16.428087 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:16.428054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:16.647442 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:16.647408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:16.718049 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:16.718021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:16.719106 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:16.719085    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:16.743572 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:16.743544    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:17.427371 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:17.427325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:18.236425 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:18.236382    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:19.049612 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:19.049571    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:19.108294 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:19.108250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:19.475561 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:19.475525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:19.650225 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:19.650190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:19.750540 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:19.750436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:32.760184 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:32.760137    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 20:03:32.760625 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:32.760213    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 20:03:34.808722 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:34.808687    2576 generic.go:356] "Generic (PLEG): container finished" podID="d492f47c-42de-4218-b753-b1c4d855f383" containerID="e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1" exitCode=0
Sep 11 20:03:34.809190 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:34.808727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" event={"ID":"d492f47c-42de-4218-b753-b1c4d855f383","Type":"ContainerDied","Data":"e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1"}
Sep 11 20:03:34.809235 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:34.809199    2576 scope.go:117] "RemoveContainer" containerID="e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1"
Sep 11 20:03:34.810304 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:34.810269    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:03:34.810424 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:34.810360    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:03:34.810424 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:34.810408    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:03:35.816668 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:35.816636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" event={"ID":"d492f47c-42de-4218-b753-b1c4d855f383","Type":"ContainerStarted","Data":"4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c"}
Sep 11 20:03:36.787136 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:36.787095    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:36.787716 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:36.787689    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 20:03:36.787917 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:36.787893    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 20:03:37.786973 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:37.786929    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 20:03:37.787484 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:37.787032    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 20:03:38.786771 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:38.786720    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 20:03:38.787018 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:38.786796    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 20:03:39.787011 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:39.786943    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 20:03:39.787504 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:39.787037    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 20:03:40.787052 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:40.787012    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 11 20:03:40.787647 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:40.787614    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 11 20:03:41.790593 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:41.790563    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:41.791043 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:41.790927    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:41.791659 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:41.791641    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:03:42.339629 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:42.339587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:43.138439 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:43.138403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:43.863861 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:43.863816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:44.689791 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:44.689745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:45.414646 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:45.414612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:46.732304 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:46.732271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:47.307079 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:47.307041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:49.239764 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:49.239732    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:03:49.341846 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:03:49.341806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:21.651067 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.651034    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"]
Sep 11 20:04:21.654541 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.654524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.659158 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.659131    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-81ca1f\"/\"kube-root-ca.crt\""
Sep 11 20:04:21.659306 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.659271    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-81ca1f\"/\"ipp-route-81ca1f-kserve-self-signed-certs\""
Sep 11 20:04:21.659884 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.659856    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-81ca1f\"/\"openshift-service-ca.crt\""
Sep 11 20:04:21.660045 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.659905    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-81ca1f\"/\"default-dockercfg-ck7vm\""
Sep 11 20:04:21.667765 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.667715    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"]
Sep 11 20:04:21.680413 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.680385    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:21.685006 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.684970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299a76ae-4a3b-4576-87f0-4624805b3bf7-tls-certs\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.685110 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.685076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh7xh\" (UniqueName: \"kubernetes.io/projected/299a76ae-4a3b-4576-87f0-4624805b3bf7-kube-api-access-xh7xh\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.685165 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.685133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-home\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.685209 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.685165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-dshm\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.685209 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.685179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-tmp-dir\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.685209 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.685208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-model-cache\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786151 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-model-cache\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786352 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299a76ae-4a3b-4576-87f0-4624805b3bf7-tls-certs\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786352 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh7xh\" (UniqueName: \"kubernetes.io/projected/299a76ae-4a3b-4576-87f0-4624805b3bf7-kube-api-access-xh7xh\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786488 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-home\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786488 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-dshm\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786488 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-tmp-dir\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786656 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-model-cache\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.786829 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-home\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.787003 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.786902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-tmp-dir\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.788803 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.788782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-dshm\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.788942 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.788925    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299a76ae-4a3b-4576-87f0-4624805b3bf7-tls-certs\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.794758 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.794736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh7xh\" (UniqueName: \"kubernetes.io/projected/299a76ae-4a3b-4576-87f0-4624805b3bf7-kube-api-access-xh7xh\") pod \"ipp-route-81ca1f-kserve-67b4b5f875-b6qh6\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") " pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:21.968066 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:21.968030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:22.247591 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:22.247566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"]
Sep 11 20:04:22.249658 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:04:22.249631    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod299a76ae_4a3b_4576_87f0_4624805b3bf7.slice/crio-18570208d4f09c6f3e201c503feab01048f08f106fdd135e2246cf3be23a28ed WatchSource:0}: Error finding container 18570208d4f09c6f3e201c503feab01048f08f106fdd135e2246cf3be23a28ed: Status 404 returned error can't find the container with id 18570208d4f09c6f3e201c503feab01048f08f106fdd135e2246cf3be23a28ed
Sep 11 20:04:23.051688 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:23.051655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6" event={"ID":"299a76ae-4a3b-4576-87f0-4624805b3bf7","Type":"ContainerStarted","Data":"91793ead1f680da7ddf9bb35cb297dbf479cd67118155280d253c8eca00e244e"}
Sep 11 20:04:23.052103 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:23.051699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6" event={"ID":"299a76ae-4a3b-4576-87f0-4624805b3bf7","Type":"ContainerStarted","Data":"18570208d4f09c6f3e201c503feab01048f08f106fdd135e2246cf3be23a28ed"}
Sep 11 20:04:23.069420 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:23.069371    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6" podStartSLOduration=2.069353386 podStartE2EDuration="2.069353386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:04:23.067640272 +0000 UTC m=+2272.816895858" watchObservedRunningTime="2026-09-11 20:04:23.069353386 +0000 UTC m=+2272.818608960"
Sep 11 20:04:31.968774 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:31.968732    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:31.969272 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:31.968793    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:31.981501 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:31.981473    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:32.105849 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:32.105819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:04:32.153383 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:32.153349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:53.627449 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:53.627411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:53.900133 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:53.900040    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"]
Sep 11 20:04:53.903552 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:53.903529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:53.905974 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:53.905953    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3d4be6-openshift-default-dockercfg-lb6kz\""
Sep 11 20:04:53.915448 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:53.915423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"]
Sep 11 20:04:53.929974 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:53.929943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:54.030817 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.030781    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:54.088614 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-data\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.088795 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-credential-socket\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.088795 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-socket\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.088795 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-envoy\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.088795 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlhz\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-kube-api-access-9dlhz\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.089010 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.089010 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-token\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.089010 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-podinfo\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.089010 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.088945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-certs\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190486 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190486 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-token\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190695 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-podinfo\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190695 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-certs\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190695 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-data\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190695 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-credential-socket\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190695 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-socket\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190930 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-envoy\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.190930 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.190786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlhz\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-kube-api-access-9dlhz\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.191097 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.191064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-certs\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.191160 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.191103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-socket\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.191223 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.191160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-credential-socket\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.191295 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.191276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.191340 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.191319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-data\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.193194 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.193173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-podinfo\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.193287 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.193238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-envoy\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.198752 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.198731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-token\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.198974 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.198954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlhz\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-kube-api-access-9dlhz\") pod \"e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") " pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.216088 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.216062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:54.495319 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.495288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"]
Sep 11 20:04:54.496746 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:04:54.496716    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09fa510_fb97_41f3_be22_63e2d7bb6bf9.slice/crio-448ada25c310982f4bd9bffb97d3e3b3e086a4ce762a13129860598eeeef5f5c WatchSource:0}: Error finding container 448ada25c310982f4bd9bffb97d3e3b3e086a4ce762a13129860598eeeef5f5c: Status 404 returned error can't find the container with id 448ada25c310982f4bd9bffb97d3e3b3e086a4ce762a13129860598eeeef5f5c
Sep 11 20:04:54.498884 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.498849    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:04:54.498948 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.498920    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:04:54.499006 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:54.498947    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:04:55.213009 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:55.212953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" event={"ID":"f09fa510-fb97-41f3-be22-63e2d7bb6bf9","Type":"ContainerStarted","Data":"460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0"}
Sep 11 20:04:55.213485 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:55.213027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" event={"ID":"f09fa510-fb97-41f3-be22-63e2d7bb6bf9","Type":"ContainerStarted","Data":"448ada25c310982f4bd9bffb97d3e3b3e086a4ce762a13129860598eeeef5f5c"}
Sep 11 20:04:55.216194 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:55.216174    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:55.221128 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:55.221106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:55.234584 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:55.234540    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" podStartSLOduration=2.234523149 podStartE2EDuration="2.234523149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:04:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:04:55.23149036 +0000 UTC m=+2304.980745963" watchObservedRunningTime="2026-09-11 20:04:55.234523149 +0000 UTC m=+2304.983778956"
Sep 11 20:04:56.218263 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:56.218229    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:56.219334 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:56.219312    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:04:56.438570 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:56.438530    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:57.223031 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:57.222998    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:57.315701 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:57.315659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:58.231555 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:58.231513    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:59.135983 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:59.135950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:04:59.830858 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:04:59.830825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:00.499019 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.498794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"]
Sep 11 20:05:00.504712 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.504629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.507779 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.507751    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-3d4be6-serving-cert\""
Sep 11 20:05:00.508132 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.508112    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"]
Sep 11 20:05:00.527945 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.527911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:00.550673 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.550644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82rb7\" (UniqueName: \"kubernetes.io/projected/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-kube-api-access-82rb7\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.550807 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.550686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.550875 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.550813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.550944 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.550926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.629412 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.629378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:00.651612 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.651580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.651749 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.651671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.651749 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.651696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82rb7\" (UniqueName: \"kubernetes.io/projected/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-kube-api-access-82rb7\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.651749 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.651715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.652424 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.652402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.654461 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.654436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.654627 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.654513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.659338 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.659318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82rb7\" (UniqueName: \"kubernetes.io/projected/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-kube-api-access-82rb7\") pod \"maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:00.728959 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.728930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:00.820593 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:00.820511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:01.007239 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:01.007209    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:01.105925 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:01.105895    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"]
Sep 11 20:05:01.108200 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:05:01.108171    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7eb81b0_6cb6_4671_b0c4_a8b71c7aafae.slice/crio-ab498d6e2fd28f279622fea2e56aaac5d00ca4c4fcaf8a08f6168d1e439e50cb WatchSource:0}: Error finding container ab498d6e2fd28f279622fea2e56aaac5d00ca4c4fcaf8a08f6168d1e439e50cb: Status 404 returned error can't find the container with id ab498d6e2fd28f279622fea2e56aaac5d00ca4c4fcaf8a08f6168d1e439e50cb
Sep 11 20:05:01.110193 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:01.110171    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:05:01.122401 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:01.122370    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:01.244303 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:01.244266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm" event={"ID":"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae","Type":"ContainerStarted","Data":"ab498d6e2fd28f279622fea2e56aaac5d00ca4c4fcaf8a08f6168d1e439e50cb"}
Sep 11 20:05:02.250405 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:02.250362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm" event={"ID":"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae","Type":"ContainerStarted","Data":"262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2"}
Sep 11 20:05:02.250828 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:02.250463    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:05.668637 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:05.668595    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:08.261330 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:08.261300    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:08.282597 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:08.282546    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm" podStartSLOduration=7.563417854 podStartE2EDuration="8.282531385s" totalImagesPullingTime="719.113531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:05:02.266661778 +0000 UTC m=+2312.015917377" watchObservedRunningTime="2026-09-11 20:05:08.282531385 +0000 UTC m=+2318.031786970"
Sep 11 20:05:18.338103 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:18.338066    2576 generic.go:356] "Generic (PLEG): container finished" podID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerID="460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0" exitCode=0
Sep 11 20:05:18.338537 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:18.338140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" event={"ID":"f09fa510-fb97-41f3-be22-63e2d7bb6bf9","Type":"ContainerDied","Data":"460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0"}
Sep 11 20:05:18.338583 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:18.338545    2576 scope.go:117] "RemoveContainer" containerID="460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0"
Sep 11 20:05:18.339730 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:18.339703    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:05:18.339788 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:18.339776    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:05:18.339825 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:18.339811    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 20:05:19.345732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:19.345690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" event={"ID":"f09fa510-fb97-41f3-be22-63e2d7bb6bf9","Type":"ContainerStarted","Data":"89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230"}
Sep 11 20:05:20.216741 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:20.216701    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:05:20.216959 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:20.216937    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 20:05:20.217043 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:20.217022    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 20:05:21.216579 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:21.216543    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 20:05:21.216967 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:21.216614    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 20:05:22.216854 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:22.216819    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 20:05:22.217262 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:22.216887    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 20:05:22.788797 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:22.788758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:23.217085 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:23.217052    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 20:05:23.217458 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:23.217123    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 20:05:23.736275 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:23.736238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:24.217072 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:24.217039    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 11 20:05:24.217249 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:24.217098    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 11 20:05:24.571861 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:24.571717    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:25.220962 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:25.220930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:05:25.221504 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:25.221252    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:05:25.222011 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:25.221969    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:05:25.490134 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:25.490038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:26.294486 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:26.294452    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:27.027168 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:27.027134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:27.221967 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:27.221928    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:29.037924 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:29.037889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:29.711765 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:29.711732    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:30.420809 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:30.420770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:31.355330 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:31.355275    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:32.084915 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:32.084884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:32.931100 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:32.931058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:38.880490 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:38.880454    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"]
Sep 11 20:05:38.881020 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:38.880668    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm" podUID="b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" containerName="maas-api" containerID="cri-o://262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2" gracePeriod=30
Sep 11 20:05:38.918139 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:38.918108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:38.995081 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:38.994973    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:39.073697 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.073662    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:39.134667 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.134613    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:39.160183 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.160153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:39.218941 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.218905    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:39.239094 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.239073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82rb7\" (UniqueName: \"kubernetes.io/projected/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-kube-api-access-82rb7\") pod \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") "
Sep 11 20:05:39.239191 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.239102    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-openshift-service-ca\") pod \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") "
Sep 11 20:05:39.239191 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.239185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-maas-api-tls\") pod \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") "
Sep 11 20:05:39.239295 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.239203    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-metrics-certs\") pod \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\" (UID: \"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae\") "
Sep 11 20:05:39.239592 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.239558    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" (UID: "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:05:39.241412 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.241380    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" (UID: "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:05:39.241533 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.241514    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" (UID: "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:05:39.241586 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.241564    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-kube-api-access-82rb7" (OuterVolumeSpecName: "kube-api-access-82rb7") pod "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" (UID: "b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae"). InnerVolumeSpecName "kube-api-access-82rb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:05:39.340010 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.339963    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82rb7\" (UniqueName: \"kubernetes.io/projected/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-kube-api-access-82rb7\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:39.340010 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.340012    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:39.340219 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.340023    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:39.340219 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.340032    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:39.462077 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.461954    2576 generic.go:356] "Generic (PLEG): container finished" podID="b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" containerID="262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2" exitCode=0
Sep 11 20:05:39.462077 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.462032    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"
Sep 11 20:05:39.462307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.462027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm" event={"ID":"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae","Type":"ContainerDied","Data":"262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2"}
Sep 11 20:05:39.462307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.462149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm" event={"ID":"b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae","Type":"ContainerDied","Data":"ab498d6e2fd28f279622fea2e56aaac5d00ca4c4fcaf8a08f6168d1e439e50cb"}
Sep 11 20:05:39.462307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.462170    2576 scope.go:117] "RemoveContainer" containerID="262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2"
Sep 11 20:05:39.472062 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.471969    2576 scope.go:117] "RemoveContainer" containerID="262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2"
Sep 11 20:05:39.472317 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:05:39.472295    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2\": container with ID starting with 262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2 not found: ID does not exist" containerID="262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2"
Sep 11 20:05:39.472394 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.472331    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2"} err="failed to get container status \"262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2\": rpc error: code = NotFound desc = could not find container \"262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2\": container with ID starting with 262ad3483bb7c4626ebfc806116644bd40efef701dad573fde2f16dcb7fbc8e2 not found: ID does not exist"
Sep 11 20:05:39.483861 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.483838    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"]
Sep 11 20:05:39.488897 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.488875    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3d4be6-6b68d9b879-xrznm"]
Sep 11 20:05:39.522769 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.522745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:39.625183 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:39.625147    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:40.339413 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:40.339368    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:40.727905 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:40.727873    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" path="/var/lib/kubelet/pods/b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae/volumes"
Sep 11 20:05:41.160395 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:41.160295    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:42.043226 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:42.043191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:42.761191 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:42.761154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:45.332109 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:45.332073    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:45.570969 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:45.570931    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:45.650842 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:45.650762    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"]
Sep 11 20:05:45.651041 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:45.651020    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy" containerID="cri-o://89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230" gracePeriod=30
Sep 11 20:05:45.668375 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:45.668345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:49.434275 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:49.434236    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:50.333250 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.333210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:50.894050 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.894021    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:05:50.952542 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952453    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-data\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952542 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-token\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952542 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952540    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-envoy\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952820 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-credential-socket\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952820 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952599    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dlhz\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-kube-api-access-9dlhz\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952820 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istiod-ca-cert\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952820 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952679    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-podinfo\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952820 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952700    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-certs\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.952820 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-data" (OuterVolumeSpecName: "istio-data") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:05:50.953136 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952825    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-socket\") pod \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\" (UID: \"f09fa510-fb97-41f3-be22-63e2d7bb6bf9\") "
Sep 11 20:05:50.953136 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.952886    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:05:50.953252 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.953133    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:05:50.953252 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.953067    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:05:50.953252 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.953188    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:50.953252 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.953207    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:50.953252 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.953214    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:05:50.955074 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.955047    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:05:50.955074 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.955067    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-token" (OuterVolumeSpecName: "istio-token") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:05:50.955248 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.955087    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-kube-api-access-9dlhz" (OuterVolumeSpecName: "kube-api-access-9dlhz") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "kube-api-access-9dlhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:05:50.955248 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:50.955232    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f09fa510-fb97-41f3-be22-63e2d7bb6bf9" (UID: "f09fa510-fb97-41f3-be22-63e2d7bb6bf9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:05:51.030164 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.030135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:51.054511 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.054480    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:51.054511 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.054508    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:51.054511 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.054518    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:51.054720 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.054526    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dlhz\" (UniqueName: \"kubernetes.io/projected/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-kube-api-access-9dlhz\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:51.054720 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.054535    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:51.054720 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.054543    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:51.054720 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.054550    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09fa510-fb97-41f3-be22-63e2d7bb6bf9-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:05:51.530115 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.530079    2576 generic.go:356] "Generic (PLEG): container finished" podID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerID="89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230" exitCode=0
Sep 11 20:05:51.530331 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.530132    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"
Sep 11 20:05:51.530331 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.530164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" event={"ID":"f09fa510-fb97-41f3-be22-63e2d7bb6bf9","Type":"ContainerDied","Data":"89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230"}
Sep 11 20:05:51.530331 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.530214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr" event={"ID":"f09fa510-fb97-41f3-be22-63e2d7bb6bf9","Type":"ContainerDied","Data":"448ada25c310982f4bd9bffb97d3e3b3e086a4ce762a13129860598eeeef5f5c"}
Sep 11 20:05:51.530331 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.530237    2576 scope.go:117] "RemoveContainer" containerID="89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230"
Sep 11 20:05:51.539927 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.539907    2576 scope.go:117] "RemoveContainer" containerID="460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0"
Sep 11 20:05:51.547807 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.547786    2576 scope.go:117] "RemoveContainer" containerID="89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230"
Sep 11 20:05:51.548091 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:05:51.548067    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230\": container with ID starting with 89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230 not found: ID does not exist" containerID="89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230"
Sep 11 20:05:51.548138 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.548101    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230"} err="failed to get container status \"89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230\": rpc error: code = NotFound desc = could not find container \"89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230\": container with ID starting with 89a7640c7ba04c21ed7569c391d463646d7d8bcec9df3448375a4230aa736230 not found: ID does not exist"
Sep 11 20:05:51.548138 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.548118    2576 scope.go:117] "RemoveContainer" containerID="460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0"
Sep 11 20:05:51.548430 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:05:51.548411    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0\": container with ID starting with 460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0 not found: ID does not exist" containerID="460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0"
Sep 11 20:05:51.548505 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.548434    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0"} err="failed to get container status \"460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0\": rpc error: code = NotFound desc = could not find container \"460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0\": container with ID starting with 460604101a1b147d74b661403216902d400ed7a6f4e78c67a52772f304cd95d0 not found: ID does not exist"
Sep 11 20:05:51.552223 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.552202    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"]
Sep 11 20:05:51.556171 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.556151    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d4be6-openshift-default-6d9b99d668-pctvr"]
Sep 11 20:05:51.825678 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:51.825585    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:52.560424 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:52.560384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:05:52.726685 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:52.726649    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" path="/var/lib/kubelet/pods/f09fa510-fb97-41f3-be22-63e2d7bb6bf9/volumes"
Sep 11 20:05:53.260958 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:05:53.260919    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:04.911782 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:04.911740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:05.014802 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:05.014761    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:05.115689 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:05.115645    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:05.181048 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:05.180932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:05.532263 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:05.532214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:05.718667 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:05.718625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:06.486529 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:06.486491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:07.320270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:07.320227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:08.057169 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:08.057130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:10.510194 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:10.510161    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"]
Sep 11 20:06:10.577531 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:10.577494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:25.529935 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.529890    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6" podUID="299a76ae-4a3b-4576-87f0-4624805b3bf7" containerName="main" containerID="cri-o://91793ead1f680da7ddf9bb35cb297dbf479cd67118155280d253c8eca00e244e" gracePeriod=45
Sep 11 20:06:25.699922 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.699891    2576 generic.go:356] "Generic (PLEG): container finished" podID="299a76ae-4a3b-4576-87f0-4624805b3bf7" containerID="91793ead1f680da7ddf9bb35cb297dbf479cd67118155280d253c8eca00e244e" exitCode=0
Sep 11 20:06:25.700103 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.699971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6" event={"ID":"299a76ae-4a3b-4576-87f0-4624805b3bf7","Type":"ContainerDied","Data":"91793ead1f680da7ddf9bb35cb297dbf479cd67118155280d253c8eca00e244e"}
Sep 11 20:06:25.773263 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.773238    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:06:25.881378 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881286    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-model-cache\") pod \"299a76ae-4a3b-4576-87f0-4624805b3bf7\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") "
Sep 11 20:06:25.881378 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881320    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-tmp-dir\") pod \"299a76ae-4a3b-4576-87f0-4624805b3bf7\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") "
Sep 11 20:06:25.881378 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881345    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh7xh\" (UniqueName: \"kubernetes.io/projected/299a76ae-4a3b-4576-87f0-4624805b3bf7-kube-api-access-xh7xh\") pod \"299a76ae-4a3b-4576-87f0-4624805b3bf7\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") "
Sep 11 20:06:25.881664 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881413    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299a76ae-4a3b-4576-87f0-4624805b3bf7-tls-certs\") pod \"299a76ae-4a3b-4576-87f0-4624805b3bf7\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") "
Sep 11 20:06:25.881664 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881437    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-home\") pod \"299a76ae-4a3b-4576-87f0-4624805b3bf7\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") "
Sep 11 20:06:25.881664 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881505    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-dshm\") pod \"299a76ae-4a3b-4576-87f0-4624805b3bf7\" (UID: \"299a76ae-4a3b-4576-87f0-4624805b3bf7\") "
Sep 11 20:06:25.881664 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881577    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-model-cache" (OuterVolumeSpecName: "model-cache") pod "299a76ae-4a3b-4576-87f0-4624805b3bf7" (UID: "299a76ae-4a3b-4576-87f0-4624805b3bf7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:06:25.881664 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881595    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "299a76ae-4a3b-4576-87f0-4624805b3bf7" (UID: "299a76ae-4a3b-4576-87f0-4624805b3bf7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:06:25.881892 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881780    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-home" (OuterVolumeSpecName: "home") pod "299a76ae-4a3b-4576-87f0-4624805b3bf7" (UID: "299a76ae-4a3b-4576-87f0-4624805b3bf7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:06:25.881892 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881886    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:06:25.882025 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881900    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:06:25.882025 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.881911    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:06:25.883767 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.883737    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299a76ae-4a3b-4576-87f0-4624805b3bf7-kube-api-access-xh7xh" (OuterVolumeSpecName: "kube-api-access-xh7xh") pod "299a76ae-4a3b-4576-87f0-4624805b3bf7" (UID: "299a76ae-4a3b-4576-87f0-4624805b3bf7"). InnerVolumeSpecName "kube-api-access-xh7xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:06:25.883767 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.883760    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/299a76ae-4a3b-4576-87f0-4624805b3bf7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "299a76ae-4a3b-4576-87f0-4624805b3bf7" (UID: "299a76ae-4a3b-4576-87f0-4624805b3bf7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:06:25.883918 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.883757    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-dshm" (OuterVolumeSpecName: "dshm") pod "299a76ae-4a3b-4576-87f0-4624805b3bf7" (UID: "299a76ae-4a3b-4576-87f0-4624805b3bf7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:06:25.982437 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.982403    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh7xh\" (UniqueName: \"kubernetes.io/projected/299a76ae-4a3b-4576-87f0-4624805b3bf7-kube-api-access-xh7xh\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:06:25.982437 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.982432    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299a76ae-4a3b-4576-87f0-4624805b3bf7-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:06:25.982437 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:25.982444    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/299a76ae-4a3b-4576-87f0-4624805b3bf7-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:06:26.706254 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:26.706218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6" event={"ID":"299a76ae-4a3b-4576-87f0-4624805b3bf7","Type":"ContainerDied","Data":"18570208d4f09c6f3e201c503feab01048f08f106fdd135e2246cf3be23a28ed"}
Sep 11 20:06:26.706707 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:26.706265    2576 scope.go:117] "RemoveContainer" containerID="91793ead1f680da7ddf9bb35cb297dbf479cd67118155280d253c8eca00e244e"
Sep 11 20:06:26.706707 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:26.706231    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"
Sep 11 20:06:26.727504 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:26.727478    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"]
Sep 11 20:06:26.729694 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:26.729675    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-81ca1f/ipp-route-81ca1f-kserve-67b4b5f875-b6qh6"]
Sep 11 20:06:27.638087 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:27.638051    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:28.725878 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:28.725844    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299a76ae-4a3b-4576-87f0-4624805b3bf7" path="/var/lib/kubelet/pods/299a76ae-4a3b-4576-87f0-4624805b3bf7/volumes"
Sep 11 20:06:30.920876 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:30.920836    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 20:06:30.925725 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:30.925695    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 20:06:30.928293 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:30.928269    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 20:06:30.932489 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:30.932471    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 20:06:31.787791 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:31.787759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:31.848008 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:31.847930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:47.257882 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:47.257849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:47.934569 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:47.934529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:53.592234 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:53.592145    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:53.663601 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:53.663554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:53.868828 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:53.868735    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:54.583396 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:54.583361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:55.329687 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:55.329655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:56.203973 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:56.203938    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:56.924016 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:56.923952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:06:57.652951 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:06:57.652921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:04.863716 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:04.863671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:04.932683 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:04.932649    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:04.996662 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:04.996622    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:05.084559 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:05.084522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:05.155621 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:05.155524    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:05.559300 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:05.559261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:05.631205 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:05.631173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:06.365737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:06.365704    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:07.247544 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:07.247513    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:11.426977 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:11.426938    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:11.530489 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:11.530454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:11.678579 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:11.678503    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"]
Sep 11 20:07:11.678820 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:11.678796    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" containerID="cri-o://4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c" gracePeriod=30
Sep 11 20:07:11.698424 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:11.698397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:11.793506 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:11.793467    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 20:07:11.793665 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:11.793531    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 20:07:12.251944 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:12.251906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:13.302223 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:13.302186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:14.137640 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:14.137598    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:14.993395 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:14.993363    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:16.934163 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.934134    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:07:16.945402 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.945334    2576 generic.go:356] "Generic (PLEG): container finished" podID="d492f47c-42de-4218-b753-b1c4d855f383" containerID="4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c" exitCode=0
Sep 11 20:07:16.945402 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.945372    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"
Sep 11 20:07:16.945612 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.945412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" event={"ID":"d492f47c-42de-4218-b753-b1c4d855f383","Type":"ContainerDied","Data":"4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c"}
Sep 11 20:07:16.945612 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.945473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp" event={"ID":"d492f47c-42de-4218-b753-b1c4d855f383","Type":"ContainerDied","Data":"d54c171667b0a481e4b5f1006e0c9b10c1f8dcb71d3148125c6e580d8f911250"}
Sep 11 20:07:16.945612 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.945505    2576 scope.go:117] "RemoveContainer" containerID="4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c"
Sep 11 20:07:16.954521 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.954502    2576 scope.go:117] "RemoveContainer" containerID="e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1"
Sep 11 20:07:16.963359 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.963339    2576 scope.go:117] "RemoveContainer" containerID="4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c"
Sep 11 20:07:16.963661 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:07:16.963640    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c\": container with ID starting with 4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c not found: ID does not exist" containerID="4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c"
Sep 11 20:07:16.963766 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.963675    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c"} err="failed to get container status \"4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c\": rpc error: code = NotFound desc = could not find container \"4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c\": container with ID starting with 4ec06a109a1341e6448fb71ca8e63e8343d9d09276a80a0aaf7ea16d2e57fc9c not found: ID does not exist"
Sep 11 20:07:16.963766 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.963701    2576 scope.go:117] "RemoveContainer" containerID="e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1"
Sep 11 20:07:16.964022 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:07:16.963971    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1\": container with ID starting with e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1 not found: ID does not exist" containerID="e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1"
Sep 11 20:07:16.964112 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:16.964025    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1"} err="failed to get container status \"e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1\": rpc error: code = NotFound desc = could not find container \"e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1\": container with ID starting with e7e96d209c0604b4a48c04173fe01470740e887335828943700a08a2de83d2d1 not found: ID does not exist"
Sep 11 20:07:17.045690 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-istio-token\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.045890 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045721    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-credential-socket\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.045890 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d492f47c-42de-4218-b753-b1c4d855f383-istiod-ca-cert\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.045890 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045813    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-socket\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.045890 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045879    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d492f47c-42de-4218-b753-b1c4d855f383-istio-podinfo\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.046148 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-envoy\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.046148 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045942    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-certs\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.046148 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.045976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-data\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.046148 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046091    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:07:17.046148 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046126    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:07:17.046413 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcscx\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-kube-api-access-xcscx\") pod \"d492f47c-42de-4218-b753-b1c4d855f383\" (UID: \"d492f47c-42de-4218-b753-b1c4d855f383\") "
Sep 11 20:07:17.046413 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046279    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-data" (OuterVolumeSpecName: "istio-data") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:07:17.046413 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046383    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:07:17.046581 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d492f47c-42de-4218-b753-b1c4d855f383-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:07:17.046778 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046703    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-data\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.046778 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046774    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-credential-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.046877 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046789    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d492f47c-42de-4218-b753-b1c4d855f383-istiod-ca-cert\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.046877 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046802    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-socket\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.046877 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.046818    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-workload-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.048235 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.048210    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d492f47c-42de-4218-b753-b1c4d855f383-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 20:07:17.048402 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.048385    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-kube-api-access-xcscx" (OuterVolumeSpecName: "kube-api-access-xcscx") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "kube-api-access-xcscx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:07:17.048640 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.048618    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-istio-token" (OuterVolumeSpecName: "istio-token") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:07:17.048640 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.048622    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d492f47c-42de-4218-b753-b1c4d855f383" (UID: "d492f47c-42de-4218-b753-b1c4d855f383"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:07:17.147435 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.147403    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-istio-token\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.147435 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.147429    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d492f47c-42de-4218-b753-b1c4d855f383-istio-podinfo\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.147435 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.147439    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d492f47c-42de-4218-b753-b1c4d855f383-istio-envoy\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.147665 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.147448    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcscx\" (UniqueName: \"kubernetes.io/projected/d492f47c-42de-4218-b753-b1c4d855f383-kube-api-access-xcscx\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:17.267247 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.267213    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"]
Sep 11 20:07:17.271454 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:17.271425    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5df0d4-openshift-default-7f5d9cdccd-wp7zp"]
Sep 11 20:07:18.730231 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:18.730189    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d492f47c-42de-4218-b753-b1c4d855f383" path="/var/lib/kubelet/pods/d492f47c-42de-4218-b753-b1c4d855f383/volumes"
Sep 11 20:07:22.503021 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.502966    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"]
Sep 11 20:07:22.503516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.503225    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw" podUID="2b6147dd-60f2-4f55-9523-4eca54decf7d" containerName="maas-api" containerID="cri-o://578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112" gracePeriod=30
Sep 11 20:07:22.564800 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.564757    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:22.662773 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.662742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:22.729746 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.729713    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:22.753665 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.753603    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 20:07:22.795836 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.795807    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-metrics-certs\") pod \"2b6147dd-60f2-4f55-9523-4eca54decf7d\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") "
Sep 11 20:07:22.796059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.795877    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-maas-api-tls\") pod \"2b6147dd-60f2-4f55-9523-4eca54decf7d\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") "
Sep 11 20:07:22.796059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.795907    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6147dd-60f2-4f55-9523-4eca54decf7d-openshift-service-ca\") pod \"2b6147dd-60f2-4f55-9523-4eca54decf7d\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") "
Sep 11 20:07:22.796059 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.795977    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdph7\" (UniqueName: \"kubernetes.io/projected/2b6147dd-60f2-4f55-9523-4eca54decf7d-kube-api-access-jdph7\") pod \"2b6147dd-60f2-4f55-9523-4eca54decf7d\" (UID: \"2b6147dd-60f2-4f55-9523-4eca54decf7d\") "
Sep 11 20:07:22.796335 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.796309    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6147dd-60f2-4f55-9523-4eca54decf7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b6147dd-60f2-4f55-9523-4eca54decf7d" (UID: "2b6147dd-60f2-4f55-9523-4eca54decf7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:07:22.798234 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.798201    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b6147dd-60f2-4f55-9523-4eca54decf7d" (UID: "2b6147dd-60f2-4f55-9523-4eca54decf7d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:22.798356 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.798339    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6147dd-60f2-4f55-9523-4eca54decf7d-kube-api-access-jdph7" (OuterVolumeSpecName: "kube-api-access-jdph7") pod "2b6147dd-60f2-4f55-9523-4eca54decf7d" (UID: "2b6147dd-60f2-4f55-9523-4eca54decf7d"). InnerVolumeSpecName "kube-api-access-jdph7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:07:22.798585 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.798563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b6147dd-60f2-4f55-9523-4eca54decf7d" (UID: "2b6147dd-60f2-4f55-9523-4eca54decf7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:22.897306 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.897268    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdph7\" (UniqueName: \"kubernetes.io/projected/2b6147dd-60f2-4f55-9523-4eca54decf7d-kube-api-access-jdph7\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:22.897306 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.897300    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:22.897306 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.897310    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b6147dd-60f2-4f55-9523-4eca54decf7d-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:22.897635 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.897318    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6147dd-60f2-4f55-9523-4eca54decf7d-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:22.976023 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.975967    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b6147dd-60f2-4f55-9523-4eca54decf7d" containerID="578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112" exitCode=0
Sep 11 20:07:22.976178 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.976035    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"
Sep 11 20:07:22.976178 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.976049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw" event={"ID":"2b6147dd-60f2-4f55-9523-4eca54decf7d","Type":"ContainerDied","Data":"578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112"}
Sep 11 20:07:22.976178 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.976100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw" event={"ID":"2b6147dd-60f2-4f55-9523-4eca54decf7d","Type":"ContainerDied","Data":"e3ffb900a096bcb20da652e6d71a3d462b2ff79fd48edf438c9c272cf12b2a6f"}
Sep 11 20:07:22.976178 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.976121    2576 scope.go:117] "RemoveContainer" containerID="578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112"
Sep 11 20:07:22.985823 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.985805    2576 scope.go:117] "RemoveContainer" containerID="578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112"
Sep 11 20:07:22.986111 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:07:22.986093    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112\": container with ID starting with 578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112 not found: ID does not exist" containerID="578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112"
Sep 11 20:07:22.986166 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.986119    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112"} err="failed to get container status \"578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112\": rpc error: code = NotFound desc = could not find container \"578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112\": container with ID starting with 578950322f4a88afd5ddc603282a400765b041c20132fefc6eb5a2a9d673c112 not found: ID does not exist"
Sep 11 20:07:22.997231 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:22.997205    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"]
Sep 11 20:07:23.000518 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:23.000497    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58c78c-d8b5b8d77-dtlpw"]
Sep 11 20:07:23.086258 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:23.086172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:23.186601 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:23.186560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:23.817445 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:23.817412    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:24.731319 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:24.731282    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6147dd-60f2-4f55-9523-4eca54decf7d" path="/var/lib/kubelet/pods/2b6147dd-60f2-4f55-9523-4eca54decf7d/volumes"
Sep 11 20:07:29.112174 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:29.112133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:29.212271 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:29.212234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:29.356677 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:29.356641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:30.015877 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:30.015845    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:30.832467 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:30.832434    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:31.519108 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:31.519060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:40.301061 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.301027    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"]
Sep 11 20:07:40.301555 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.301273    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv" podUID="cdba8bbf-df63-4f82-aa74-c52eb19476da" containerName="maas-api" containerID="cri-o://327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28" gracePeriod=30
Sep 11 20:07:40.336121 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.336089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:40.410512 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.410479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:40.480778 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.480746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:40.548758 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.548726    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 20:07:40.551638 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.551613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:40.618515 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.618484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:40.663521 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.663487    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdba8bbf-df63-4f82-aa74-c52eb19476da-openshift-service-ca\") pod \"cdba8bbf-df63-4f82-aa74-c52eb19476da\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") "
Sep 11 20:07:40.663689 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.663538    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-metrics-certs\") pod \"cdba8bbf-df63-4f82-aa74-c52eb19476da\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") "
Sep 11 20:07:40.663689 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.663613    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbwpx\" (UniqueName: \"kubernetes.io/projected/cdba8bbf-df63-4f82-aa74-c52eb19476da-kube-api-access-jbwpx\") pod \"cdba8bbf-df63-4f82-aa74-c52eb19476da\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") "
Sep 11 20:07:40.663689 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.663672    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls\") pod \"cdba8bbf-df63-4f82-aa74-c52eb19476da\" (UID: \"cdba8bbf-df63-4f82-aa74-c52eb19476da\") "
Sep 11 20:07:40.663932 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.663910    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdba8bbf-df63-4f82-aa74-c52eb19476da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cdba8bbf-df63-4f82-aa74-c52eb19476da" (UID: "cdba8bbf-df63-4f82-aa74-c52eb19476da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:07:40.664040 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.664023    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdba8bbf-df63-4f82-aa74-c52eb19476da-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:40.665797 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.665759    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cdba8bbf-df63-4f82-aa74-c52eb19476da" (UID: "cdba8bbf-df63-4f82-aa74-c52eb19476da"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:40.665931 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.665913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cdba8bbf-df63-4f82-aa74-c52eb19476da" (UID: "cdba8bbf-df63-4f82-aa74-c52eb19476da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:07:40.666062 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.665949    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdba8bbf-df63-4f82-aa74-c52eb19476da-kube-api-access-jbwpx" (OuterVolumeSpecName: "kube-api-access-jbwpx") pod "cdba8bbf-df63-4f82-aa74-c52eb19476da" (UID: "cdba8bbf-df63-4f82-aa74-c52eb19476da"). InnerVolumeSpecName "kube-api-access-jbwpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:07:40.765204 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.765177    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbwpx\" (UniqueName: \"kubernetes.io/projected/cdba8bbf-df63-4f82-aa74-c52eb19476da-kube-api-access-jbwpx\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:40.765204 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.765204    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:40.765384 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.765214    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdba8bbf-df63-4f82-aa74-c52eb19476da-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:07:40.911770 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:40.911689    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:41.011506 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.011473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:41.062354 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.062317    2576 generic.go:356] "Generic (PLEG): container finished" podID="cdba8bbf-df63-4f82-aa74-c52eb19476da" containerID="327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28" exitCode=0
Sep 11 20:07:41.062525 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.062363    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"
Sep 11 20:07:41.062525 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.062414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv" event={"ID":"cdba8bbf-df63-4f82-aa74-c52eb19476da","Type":"ContainerDied","Data":"327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28"}
Sep 11 20:07:41.062525 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.062461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv" event={"ID":"cdba8bbf-df63-4f82-aa74-c52eb19476da","Type":"ContainerDied","Data":"7cc143ef2eff1731b7b04feab332e616173bf605a73aaac9f3abda876732b6be"}
Sep 11 20:07:41.062525 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.062484    2576 scope.go:117] "RemoveContainer" containerID="327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28"
Sep 11 20:07:41.073507 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.073483    2576 scope.go:117] "RemoveContainer" containerID="327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28"
Sep 11 20:07:41.073834 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:07:41.073811    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28\": container with ID starting with 327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28 not found: ID does not exist" containerID="327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28"
Sep 11 20:07:41.073906 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.073844    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28"} err="failed to get container status \"327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28\": rpc error: code = NotFound desc = could not find container \"327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28\": container with ID starting with 327f9eb15557a263ed6de336de4d156fcec0291b58268188fc009de83f4d3f28 not found: ID does not exist"
Sep 11 20:07:41.079288 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.079261    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"]
Sep 11 20:07:41.082280 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:41.082257    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ae268e-6f4b586cdc-tt7bv"]
Sep 11 20:07:42.726064 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:42.726021    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdba8bbf-df63-4f82-aa74-c52eb19476da" path="/var/lib/kubelet/pods/cdba8bbf-df63-4f82-aa74-c52eb19476da/volumes"
Sep 11 20:07:44.270600 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:44.270568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:46.755251 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:46.755217    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:46.855231 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:46.855196    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:07:47.012707 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:07:47.012600    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:08:42.696006 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:08:42.695950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:08:42.829929 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:08:42.829862    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:09:12.854749 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:09:12.854707    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:09:14.431330 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:09:14.431288    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:11:15.537372 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:15.537341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:11:30.958009 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:30.957904    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 20:11:30.962752 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:30.962725    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 20:11:30.964598 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:30.964576    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 20:11:30.968975 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:30.968958    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kfmp2_474f2d2f-c3d6-4ecd-a0ba-bd8e16344b79/ovn-acl-logging/0.log"
Sep 11 20:11:43.496825 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:43.496795    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:11:45.799191 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:45.799161    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:11:45.900032 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:45.899969    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:11:56.354650 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.354612    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"]
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355163    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" containerName="maas-api"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355182    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" containerName="maas-api"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355197    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355206    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355223    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdba8bbf-df63-4f82-aa74-c52eb19476da" containerName="maas-api"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355232    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdba8bbf-df63-4f82-aa74-c52eb19476da" containerName="maas-api"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355256    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355265    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy"
Sep 11 20:11:56.355270 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355273    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6147dd-60f2-4f55-9523-4eca54decf7d" containerName="maas-api"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355282    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6147dd-60f2-4f55-9523-4eca54decf7d" containerName="maas-api"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355294    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299a76ae-4a3b-4576-87f0-4624805b3bf7" containerName="main"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355301    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="299a76ae-4a3b-4576-87f0-4624805b3bf7" containerName="main"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355396    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355407    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7eb81b0-6cb6-4671-b0c4-a8b71c7aafae" containerName="maas-api"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355415    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355427    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355437    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6147dd-60f2-4f55-9523-4eca54decf7d" containerName="maas-api"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355447    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdba8bbf-df63-4f82-aa74-c52eb19476da" containerName="maas-api"
Sep 11 20:11:56.355732 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.355457    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="299a76ae-4a3b-4576-87f0-4624805b3bf7" containerName="main"
Sep 11 20:11:56.358502 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.358481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.361425 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.361403    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 20:11:56.361531 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.361403    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-92f4f9a0-kserve-self-signed-certs\""
Sep 11 20:11:56.361531 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.361448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cm7wn\""
Sep 11 20:11:56.361531 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.361461    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 20:11:56.366690 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.366669    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"]
Sep 11 20:11:56.446711 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.446674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-dshm\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.446892 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.446785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-model-cache\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.446892 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.446842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r857z\" (UniqueName: \"kubernetes.io/projected/ad9f335e-2f7a-43c2-961f-062f8f5fc808-kube-api-access-r857z\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.446892 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.446875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tls-certs\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.447085 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.446901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-home\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.447085 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.446933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tmp-dir\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.463146 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.463099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:11:56.548386 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r857z\" (UniqueName: \"kubernetes.io/projected/ad9f335e-2f7a-43c2-961f-062f8f5fc808-kube-api-access-r857z\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.548559 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tls-certs\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.548559 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-home\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.548683 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tmp-dir\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.548743 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-dshm\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.548743 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-model-cache\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.548974 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-home\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.549136 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.548981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tmp-dir\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.549305 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.549283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-model-cache\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.551731 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.551706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-dshm\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.551839 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.551711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tls-certs\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.556091 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.556071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r857z\" (UniqueName: \"kubernetes.io/projected/ad9f335e-2f7a-43c2-961f-062f8f5fc808-kube-api-access-r857z\") pod \"e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") " pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.668413 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.668342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:11:56.938648 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:56.938624    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"]
Sep 11 20:11:56.940403 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:11:56.940375    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad9f335e_2f7a_43c2_961f_062f8f5fc808.slice/crio-535e6117b90b1888786686fcb65a8eae4023a03ece2bb9e13d5a9cb23ba79522 WatchSource:0}: Error finding container 535e6117b90b1888786686fcb65a8eae4023a03ece2bb9e13d5a9cb23ba79522: Status 404 returned error can't find the container with id 535e6117b90b1888786686fcb65a8eae4023a03ece2bb9e13d5a9cb23ba79522
Sep 11 20:11:57.241516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:57.241476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts" event={"ID":"ad9f335e-2f7a-43c2-961f-062f8f5fc808","Type":"ContainerStarted","Data":"f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c"}
Sep 11 20:11:57.241516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:57.241519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts" event={"ID":"ad9f335e-2f7a-43c2-961f-062f8f5fc808","Type":"ContainerStarted","Data":"535e6117b90b1888786686fcb65a8eae4023a03ece2bb9e13d5a9cb23ba79522"}
Sep 11 20:11:57.259869 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:11:57.259813    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts" podStartSLOduration=1.259797164 podStartE2EDuration="1.259797164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:11:57.25724236 +0000 UTC m=+2727.006497947" watchObservedRunningTime="2026-09-11 20:11:57.259797164 +0000 UTC m=+2727.009052737"
Sep 11 20:12:06.668731 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:06.668697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:12:06.669214 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:06.668747    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:12:06.680952 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:06.680928    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:12:07.302247 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:07.302217    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:12:27.791837 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:27.791800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:12:44.797262 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:44.797228    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"]
Sep 11 20:12:44.843869 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:44.843837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:12:46.558610 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:46.558583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:12:59.816901 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:12:59.816813    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts" podUID="ad9f335e-2f7a-43c2-961f-062f8f5fc808" containerName="main" containerID="cri-o://f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c" gracePeriod=45
Sep 11 20:13:00.076098 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.076039    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:13:00.194544 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.194504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tls-certs\") pod \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") "
Sep 11 20:13:00.194718 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.194595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-home\") pod \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") "
Sep 11 20:13:00.194718 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.194631    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-dshm\") pod \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") "
Sep 11 20:13:00.194718 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.194680    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r857z\" (UniqueName: \"kubernetes.io/projected/ad9f335e-2f7a-43c2-961f-062f8f5fc808-kube-api-access-r857z\") pod \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") "
Sep 11 20:13:00.194718 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.194701    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tmp-dir\") pod \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") "
Sep 11 20:13:00.194922 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.194787    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-model-cache\") pod \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\" (UID: \"ad9f335e-2f7a-43c2-961f-062f8f5fc808\") "
Sep 11 20:13:00.194922 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.194828    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-home" (OuterVolumeSpecName: "home") pod "ad9f335e-2f7a-43c2-961f-062f8f5fc808" (UID: "ad9f335e-2f7a-43c2-961f-062f8f5fc808"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:00.195097 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.195076    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-home\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:00.195283 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.195125    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad9f335e-2f7a-43c2-961f-062f8f5fc808" (UID: "ad9f335e-2f7a-43c2-961f-062f8f5fc808"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:00.195421 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.195154    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad9f335e-2f7a-43c2-961f-062f8f5fc808" (UID: "ad9f335e-2f7a-43c2-961f-062f8f5fc808"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:00.197488 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.197456    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad9f335e-2f7a-43c2-961f-062f8f5fc808-kube-api-access-r857z" (OuterVolumeSpecName: "kube-api-access-r857z") pod "ad9f335e-2f7a-43c2-961f-062f8f5fc808" (UID: "ad9f335e-2f7a-43c2-961f-062f8f5fc808"). InnerVolumeSpecName "kube-api-access-r857z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:13:00.197587 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.197517    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-dshm" (OuterVolumeSpecName: "dshm") pod "ad9f335e-2f7a-43c2-961f-062f8f5fc808" (UID: "ad9f335e-2f7a-43c2-961f-062f8f5fc808"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 20:13:00.197587 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.197523    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad9f335e-2f7a-43c2-961f-062f8f5fc808" (UID: "ad9f335e-2f7a-43c2-961f-062f8f5fc808"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:13:00.296429 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.296391    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-model-cache\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:00.296429 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.296423    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tls-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:00.296429 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.296435    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-dshm\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:00.296663 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.296448    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r857z\" (UniqueName: \"kubernetes.io/projected/ad9f335e-2f7a-43c2-961f-062f8f5fc808-kube-api-access-r857z\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:00.296663 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.296459    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad9f335e-2f7a-43c2-961f-062f8f5fc808-tmp-dir\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:00.543050 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.543008    2576 generic.go:356] "Generic (PLEG): container finished" podID="ad9f335e-2f7a-43c2-961f-062f8f5fc808" containerID="f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c" exitCode=0
Sep 11 20:13:00.543050 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.543047    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"
Sep 11 20:13:00.543304 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.543082    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts" event={"ID":"ad9f335e-2f7a-43c2-961f-062f8f5fc808","Type":"ContainerDied","Data":"f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c"}
Sep 11 20:13:00.543304 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.543127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts" event={"ID":"ad9f335e-2f7a-43c2-961f-062f8f5fc808","Type":"ContainerDied","Data":"535e6117b90b1888786686fcb65a8eae4023a03ece2bb9e13d5a9cb23ba79522"}
Sep 11 20:13:00.543304 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.543138    2576 scope.go:117] "RemoveContainer" containerID="f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c"
Sep 11 20:13:00.552640 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.552625    2576 scope.go:117] "RemoveContainer" containerID="f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c"
Sep 11 20:13:00.552884 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:13:00.552866    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c\": container with ID starting with f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c not found: ID does not exist" containerID="f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c"
Sep 11 20:13:00.552948 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.552895    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c"} err="failed to get container status \"f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c\": rpc error: code = NotFound desc = could not find container \"f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c\": container with ID starting with f80de5a231d22a1cf663c6ce6240136e514eb183661eebcdd20d3ae264c7446c not found: ID does not exist"
Sep 11 20:13:00.564737 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.564714    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"]
Sep 11 20:13:00.568957 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.568935    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-92f4f9a0-kserve-6c495564b7-mpvts"]
Sep 11 20:13:00.727028 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:00.726968    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad9f335e-2f7a-43c2-961f-062f8f5fc808" path="/var/lib/kubelet/pods/ad9f335e-2f7a-43c2-961f-062f8f5fc808/volumes"
Sep 11 20:13:09.716121 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716083    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"]
Sep 11 20:13:09.716698 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716682    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad9f335e-2f7a-43c2-961f-062f8f5fc808" containerName="main"
Sep 11 20:13:09.716783 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716703    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad9f335e-2f7a-43c2-961f-062f8f5fc808" containerName="main"
Sep 11 20:13:09.716783 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716727    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy"
Sep 11 20:13:09.716783 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716737    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy"
Sep 11 20:13:09.716783 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716769    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy"
Sep 11 20:13:09.716783 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716779    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d492f47c-42de-4218-b753-b1c4d855f383" containerName="istio-proxy"
Sep 11 20:13:09.717074 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716891    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad9f335e-2f7a-43c2-961f-062f8f5fc808" containerName="main"
Sep 11 20:13:09.717074 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.716907    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09fa510-fb97-41f3-be22-63e2d7bb6bf9" containerName="istio-proxy"
Sep 11 20:13:09.719874 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.719853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.722907 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.722884    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 20:13:09.722907 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.722894    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hvn79\""
Sep 11 20:13:09.723118 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.722937    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 20:13:09.723118 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.722933    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 20:13:09.723118 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.722943    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 20:13:09.732324 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.732300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"]
Sep 11 20:13:09.772649 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.772616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-maas-api-tls\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.772649 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.772652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t4j\" (UniqueName: \"kubernetes.io/projected/6c9579e1-2053-4496-82ea-a009be2fc1b6-kube-api-access-57t4j\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.772897 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.772684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-metrics-certs\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.772897 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.772808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9579e1-2053-4496-82ea-a009be2fc1b6-openshift-service-ca\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.874054 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.873980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9579e1-2053-4496-82ea-a009be2fc1b6-openshift-service-ca\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.874266 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.874096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-maas-api-tls\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.874266 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.874115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57t4j\" (UniqueName: \"kubernetes.io/projected/6c9579e1-2053-4496-82ea-a009be2fc1b6-kube-api-access-57t4j\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.874266 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.874132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-metrics-certs\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.874702 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.874676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9579e1-2053-4496-82ea-a009be2fc1b6-openshift-service-ca\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.876707 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.876687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-metrics-certs\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.876776 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.876727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-maas-api-tls\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:09.882279 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:09.882255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t4j\" (UniqueName: \"kubernetes.io/projected/6c9579e1-2053-4496-82ea-a009be2fc1b6-kube-api-access-57t4j\") pod \"maas-api-ccb8f7bdd-h9bf6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") " pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:10.031521 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:10.031476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:10.304942 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:10.304920    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"]
Sep 11 20:13:10.306780 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:13:10.306750    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9579e1_2053_4496_82ea_a009be2fc1b6.slice/crio-3f9ef7399a887bbc300bd98dc1b85a4305b75fbb7aecef0eed76fd3d6dc34902 WatchSource:0}: Error finding container 3f9ef7399a887bbc300bd98dc1b85a4305b75fbb7aecef0eed76fd3d6dc34902: Status 404 returned error can't find the container with id 3f9ef7399a887bbc300bd98dc1b85a4305b75fbb7aecef0eed76fd3d6dc34902
Sep 11 20:13:10.308087 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:10.308065    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 20:13:10.591568 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:10.591490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6" event={"ID":"6c9579e1-2053-4496-82ea-a009be2fc1b6","Type":"ContainerStarted","Data":"3f9ef7399a887bbc300bd98dc1b85a4305b75fbb7aecef0eed76fd3d6dc34902"}
Sep 11 20:13:11.597979 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:11.597938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6" event={"ID":"6c9579e1-2053-4496-82ea-a009be2fc1b6","Type":"ContainerStarted","Data":"a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99"}
Sep 11 20:13:11.598390 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:11.598039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:11.620977 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:11.620917    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6" podStartSLOduration=2.10199135 podStartE2EDuration="2.620900177s" totalImagesPullingTime="518.908827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:13:11.620775712 +0000 UTC m=+2801.370031286" watchObservedRunningTime="2026-09-11 20:13:11.620900177 +0000 UTC m=+2801.370155750"
Sep 11 20:13:16.982012 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:16.981968    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"]
Sep 11 20:13:16.982578 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:16.982182    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6" podUID="6c9579e1-2053-4496-82ea-a009be2fc1b6" containerName="maas-api" containerID="cri-o://a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99" gracePeriod=30
Sep 11 20:13:16.987475 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:16.987453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:17.020946 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.020922    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"]
Sep 11 20:13:17.024178 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.024162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.049357 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.049329    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"]
Sep 11 20:13:17.135800 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.135754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgvw\" (UniqueName: \"kubernetes.io/projected/3d42e261-0cc9-4cb1-8543-ac516da33ae1-kube-api-access-crgvw\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.135964 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.135812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d42e261-0cc9-4cb1-8543-ac516da33ae1-metrics-certs\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.135964 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.135839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d42e261-0cc9-4cb1-8543-ac516da33ae1-maas-api-tls\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.135964 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.135892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d42e261-0cc9-4cb1-8543-ac516da33ae1-openshift-service-ca\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.223897 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.223870    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:17.236541 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.236493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d42e261-0cc9-4cb1-8543-ac516da33ae1-openshift-service-ca\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.236623 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.236579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crgvw\" (UniqueName: \"kubernetes.io/projected/3d42e261-0cc9-4cb1-8543-ac516da33ae1-kube-api-access-crgvw\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.236623 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.236605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d42e261-0cc9-4cb1-8543-ac516da33ae1-metrics-certs\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.236701 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.236635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d42e261-0cc9-4cb1-8543-ac516da33ae1-maas-api-tls\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.237219 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.237193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d42e261-0cc9-4cb1-8543-ac516da33ae1-openshift-service-ca\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.239116 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.239095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d42e261-0cc9-4cb1-8543-ac516da33ae1-metrics-certs\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.239237 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.239216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d42e261-0cc9-4cb1-8543-ac516da33ae1-maas-api-tls\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.250104 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.250079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgvw\" (UniqueName: \"kubernetes.io/projected/3d42e261-0cc9-4cb1-8543-ac516da33ae1-kube-api-access-crgvw\") pod \"maas-api-786f4dddd4-wrm5h\" (UID: \"3d42e261-0cc9-4cb1-8543-ac516da33ae1\") " pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.337337 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.337310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-metrics-certs\") pod \"6c9579e1-2053-4496-82ea-a009be2fc1b6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") "
Sep 11 20:13:17.337451 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.337353    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57t4j\" (UniqueName: \"kubernetes.io/projected/6c9579e1-2053-4496-82ea-a009be2fc1b6-kube-api-access-57t4j\") pod \"6c9579e1-2053-4496-82ea-a009be2fc1b6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") "
Sep 11 20:13:17.337451 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.337393    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9579e1-2053-4496-82ea-a009be2fc1b6-openshift-service-ca\") pod \"6c9579e1-2053-4496-82ea-a009be2fc1b6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") "
Sep 11 20:13:17.337451 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.337429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-maas-api-tls\") pod \"6c9579e1-2053-4496-82ea-a009be2fc1b6\" (UID: \"6c9579e1-2053-4496-82ea-a009be2fc1b6\") "
Sep 11 20:13:17.337754 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.337729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c9579e1-2053-4496-82ea-a009be2fc1b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c9579e1-2053-4496-82ea-a009be2fc1b6" (UID: "6c9579e1-2053-4496-82ea-a009be2fc1b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 20:13:17.339414 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.339387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6c9579e1-2053-4496-82ea-a009be2fc1b6" (UID: "6c9579e1-2053-4496-82ea-a009be2fc1b6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:13:17.339527 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.339511    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c9579e1-2053-4496-82ea-a009be2fc1b6" (UID: "6c9579e1-2053-4496-82ea-a009be2fc1b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 20:13:17.339570 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.339525    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9579e1-2053-4496-82ea-a009be2fc1b6-kube-api-access-57t4j" (OuterVolumeSpecName: "kube-api-access-57t4j") pod "6c9579e1-2053-4496-82ea-a009be2fc1b6" (UID: "6c9579e1-2053-4496-82ea-a009be2fc1b6"). InnerVolumeSpecName "kube-api-access-57t4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 20:13:17.359335 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.359312    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:17.438516 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.438446    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57t4j\" (UniqueName: \"kubernetes.io/projected/6c9579e1-2053-4496-82ea-a009be2fc1b6-kube-api-access-57t4j\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:17.438828 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.438775    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c9579e1-2053-4496-82ea-a009be2fc1b6-openshift-service-ca\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:17.438828 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.438797    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-maas-api-tls\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:17.438828 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.438811    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c9579e1-2053-4496-82ea-a009be2fc1b6-metrics-certs\") on node \"ip-10-0-130-171.ec2.internal\" DevicePath \"\""
Sep 11 20:13:17.628697 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.628621    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c9579e1-2053-4496-82ea-a009be2fc1b6" containerID="a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99" exitCode=0
Sep 11 20:13:17.628697 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.628672    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"
Sep 11 20:13:17.628869 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.628706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6" event={"ID":"6c9579e1-2053-4496-82ea-a009be2fc1b6","Type":"ContainerDied","Data":"a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99"}
Sep 11 20:13:17.628869 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.628773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6" event={"ID":"6c9579e1-2053-4496-82ea-a009be2fc1b6","Type":"ContainerDied","Data":"3f9ef7399a887bbc300bd98dc1b85a4305b75fbb7aecef0eed76fd3d6dc34902"}
Sep 11 20:13:17.628869 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.628794    2576 scope.go:117] "RemoveContainer" containerID="a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99"
Sep 11 20:13:17.637832 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.637813    2576 scope.go:117] "RemoveContainer" containerID="a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99"
Sep 11 20:13:17.638115 ip-10-0-130-171 kubenswrapper[2576]: E0911 20:13:17.638095    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99\": container with ID starting with a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99 not found: ID does not exist" containerID="a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99"
Sep 11 20:13:17.638172 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.638124    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99"} err="failed to get container status \"a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99\": rpc error: code = NotFound desc = could not find container \"a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99\": container with ID starting with a1d1e0a1b390a96645514cc74c0a8f9f63a722010db126aa096154f88ab9cb99 not found: ID does not exist"
Sep 11 20:13:17.653454 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.653436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"]
Sep 11 20:13:17.655261 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:13:17.655243    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d42e261_0cc9_4cb1_8543_ac516da33ae1.slice/crio-56797b70147cf4df05bfceaa2e01bbb92ed44b680e377320ee92a6d1a8eb0460 WatchSource:0}: Error finding container 56797b70147cf4df05bfceaa2e01bbb92ed44b680e377320ee92a6d1a8eb0460: Status 404 returned error can't find the container with id 56797b70147cf4df05bfceaa2e01bbb92ed44b680e377320ee92a6d1a8eb0460
Sep 11 20:13:17.675901 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.675878    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"]
Sep 11 20:13:17.682432 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:17.682412    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-ccb8f7bdd-h9bf6"]
Sep 11 20:13:18.634847 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:18.634811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h" event={"ID":"3d42e261-0cc9-4cb1-8543-ac516da33ae1","Type":"ContainerStarted","Data":"62969cbb6e936f2499f02ffd5a09efc7c245c1a9e29dae847a55dbbb1dba9b46"}
Sep 11 20:13:18.635355 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:18.634871    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h" event={"ID":"3d42e261-0cc9-4cb1-8543-ac516da33ae1","Type":"ContainerStarted","Data":"56797b70147cf4df05bfceaa2e01bbb92ed44b680e377320ee92a6d1a8eb0460"}
Sep 11 20:13:18.635355 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:18.635010    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:18.652785 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:18.652727    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h" podStartSLOduration=1.293850002 podStartE2EDuration="1.652712042s" totalImagesPullingTime="358.86204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 20:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:13:18.652377509 +0000 UTC m=+2808.401633118" watchObservedRunningTime="2026-09-11 20:13:18.652712042 +0000 UTC m=+2808.401967615"
Sep 11 20:13:18.725943 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:18.725914    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c9579e1-2053-4496-82ea-a009be2fc1b6" path="/var/lib/kubelet/pods/6c9579e1-2053-4496-82ea-a009be2fc1b6/volumes"
Sep 11 20:13:24.646007 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:24.645957    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-786f4dddd4-wrm5h"
Sep 11 20:13:44.978878 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:44.978842    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7dsv5_cfb4a10d-ef07-4ce5-bfad-6731cda6347e/server/0.log"
Sep 11 20:13:45.101418 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:45.101384    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kf2t8_95f33bbc-f145-48f2-b21a-77f0f8c09632/manager/0.log"
Sep 11 20:13:45.447008 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:45.446900    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c47b89ccd-wr2jz_3ae6b7fa-202e-48ef-83f6-8687a1817ee9/copy-manifests/0.log"
Sep 11 20:13:45.462654 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:45.462624    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c47b89ccd-wr2jz_3ae6b7fa-202e-48ef-83f6-8687a1817ee9/manager/0.log"
Sep 11 20:13:45.936524 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:45.936496    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-786f4dddd4-wrm5h_3d42e261-0cc9-4cb1-8543-ac516da33ae1/maas-api/0.log"
Sep 11 20:13:48.056613 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:48.056575    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c59pd7_8a0ba881-b73e-4140-8996-05d519d7bd53/istio-proxy/0.log"
Sep 11 20:13:48.166350 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:48.166321    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kxdp5_06a1b97a-12b5-4504-b8dd-3adf01a14f6f/discovery/0.log"
Sep 11 20:13:48.270593 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:48.270566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596df76fbd-8qmvg_b33dabe4-9726-4c62-a2f7-ebade984e79d/kube-auth-proxy/0.log"
Sep 11 20:13:48.683912 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:48.683881    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:13:48.741203 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:48.741169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:13:48.844512 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:48.844488    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f55c6dfc6-v8gfx_aa8815e5-5a2d-44bf-b753-b5ddd918f91d/router/0.log"
Sep 11 20:13:54.677561 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:54.677525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:13:54.760780 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:54.760749    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log" limit=1024
Sep 11 20:13:57.818443 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:57.818381    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rjmgv_e788a1c7-253d-4e32-a0d2-f5e50a7bbcb9/global-pull-secret-syncer/0.log"
Sep 11 20:13:57.860214 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:57.860182    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k6nq5_dfc5fb4c-40c3-4843-a610-920a66c8b08f/konnectivity-agent/0.log"
Sep 11 20:13:57.952052 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:13:57.952024    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-171.ec2.internal_2d1cc5de24426008e9a26b41d0d1c2bf/haproxy/0.log"
Sep 11 20:14:04.637543 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.637511    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-fwxt7_a692649b-8756-4044-9d49-021af267ef5b/cluster-monitoring-operator/0.log"
Sep 11 20:14:04.664405 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.664382    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-88pnf_47767f27-22a1-4c37-a2b9-c6136229b15d/kube-state-metrics/0.log"
Sep 11 20:14:04.679937 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.679912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-88pnf_47767f27-22a1-4c37-a2b9-c6136229b15d/kube-rbac-proxy-main/0.log"
Sep 11 20:14:04.706457 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.706436    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-88pnf_47767f27-22a1-4c37-a2b9-c6136229b15d/kube-rbac-proxy-self/0.log"
Sep 11 20:14:04.731176 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.731157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68c57ff97b-6jkhd_833b9478-3436-4733-a2c6-040fe3d04fd4/metrics-server/0.log"
Sep 11 20:14:04.824652 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.824628    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kt8d_0b575b52-4e73-425c-8c58-a719ce9be1df/node-exporter/0.log"
Sep 11 20:14:04.850455 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.850420    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kt8d_0b575b52-4e73-425c-8c58-a719ce9be1df/kube-rbac-proxy/0.log"
Sep 11 20:14:04.868403 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:04.868383    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kt8d_0b575b52-4e73-425c-8c58-a719ce9be1df/init-textfile/0.log"
Sep 11 20:14:05.516078 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:05.516046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d687f68b-h9d5x_742cb590-8d1d-4556-a4a5-afc267ecb277/thanos-query/0.log"
Sep 11 20:14:05.536100 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:05.536074    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d687f68b-h9d5x_742cb590-8d1d-4556-a4a5-afc267ecb277/kube-rbac-proxy-web/0.log"
Sep 11 20:14:05.554394 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:05.554374    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d687f68b-h9d5x_742cb590-8d1d-4556-a4a5-afc267ecb277/kube-rbac-proxy/0.log"
Sep 11 20:14:05.573318 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:05.573298    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d687f68b-h9d5x_742cb590-8d1d-4556-a4a5-afc267ecb277/prom-label-proxy/0.log"
Sep 11 20:14:05.602425 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:05.602409    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d687f68b-h9d5x_742cb590-8d1d-4556-a4a5-afc267ecb277/kube-rbac-proxy-rules/0.log"
Sep 11 20:14:05.628276 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:05.628260    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67d687f68b-h9d5x_742cb590-8d1d-4556-a4a5-afc267ecb277/kube-rbac-proxy-metrics/0.log"
Sep 11 20:14:07.651073 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:07.651035    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/2.log"
Sep 11 20:14:07.658184 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:07.658158    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qxbdv_43851385-292b-4977-9cb0-8c3e2570086a/console-operator/3.log"
Sep 11 20:14:08.117902 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.117873    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"]
Sep 11 20:14:08.118371 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.118347    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9579e1-2053-4496-82ea-a009be2fc1b6" containerName="maas-api"
Sep 11 20:14:08.118371 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.118373    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9579e1-2053-4496-82ea-a009be2fc1b6" containerName="maas-api"
Sep 11 20:14:08.118557 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.118490    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9579e1-2053-4496-82ea-a009be2fc1b6" containerName="maas-api"
Sep 11 20:14:08.121822 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.121802    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.124001 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.123958    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kx729\"/\"openshift-service-ca.crt\""
Sep 11 20:14:08.124099 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.123958    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kx729\"/\"kube-root-ca.crt\""
Sep 11 20:14:08.124560 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.124545    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kx729\"/\"default-dockercfg-hfjpd\""
Sep 11 20:14:08.135436 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.135410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"]
Sep 11 20:14:08.150607 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.150582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-lib-modules\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.150706 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.150618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-podres\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.150706 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.150653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-sys\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.150706 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.150678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-proc\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.150815 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.150722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fv26\" (UniqueName: \"kubernetes.io/projected/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-kube-api-access-5fv26\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251085 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-podres\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251174 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-sys\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251174 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-proc\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251174 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fv26\" (UniqueName: \"kubernetes.io/projected/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-kube-api-access-5fv26\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251182    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-podres\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-sys\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-lib-modules\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251307 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-proc\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.251480 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.251367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-lib-modules\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.259417 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.259399    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-z678f_cb7194b0-a279-4a4e-b262-dc00a2170895/download-server/0.log"
Sep 11 20:14:08.260080 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.260061    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fv26\" (UniqueName: \"kubernetes.io/projected/cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd-kube-api-access-5fv26\") pod \"perf-node-gather-daemonset-kg2l7\" (UID: \"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd\") " pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.436619 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.436566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.716747 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.716720    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"]
Sep 11 20:14:08.718778 ip-10-0-130-171 kubenswrapper[2576]: W0911 20:14:08.718749    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbb2b7d3_d2fe_4b2c_8271_e4f1451ce6dd.slice/crio-62c12721ac1c4e4f1bf638a469adff5ec687948b544d5aef4b29a93a053f4616 WatchSource:0}: Error finding container 62c12721ac1c4e4f1bf638a469adff5ec687948b544d5aef4b29a93a053f4616: Status 404 returned error can't find the container with id 62c12721ac1c4e4f1bf638a469adff5ec687948b544d5aef4b29a93a053f4616
Sep 11 20:14:08.873466 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.873438    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7" event={"ID":"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd","Type":"ContainerStarted","Data":"e32019336392d75ed91c8a3e1070bcab4f445f8330fe3df1e70816522793dc73"}
Sep 11 20:14:08.873588 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.873485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7" event={"ID":"cbb2b7d3-d2fe-4b2c-8271-e4f1451ce6dd","Type":"ContainerStarted","Data":"62c12721ac1c4e4f1bf638a469adff5ec687948b544d5aef4b29a93a053f4616"}
Sep 11 20:14:08.873588 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.873517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:08.890683 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:08.890612    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7" podStartSLOduration=0.890600158 podStartE2EDuration="890.600158ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 20:14:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 20:14:08.890125696 +0000 UTC m=+2858.639381294" watchObservedRunningTime="2026-09-11 20:14:08.890600158 +0000 UTC m=+2858.639855731"
Sep 11 20:14:10.125911 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:10.125871    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zndxh_6eaf5989-9a58-448b-80da-7f117fd2ea11/dns/0.log"
Sep 11 20:14:10.141994 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:10.141963    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zndxh_6eaf5989-9a58-448b-80da-7f117fd2ea11/kube-rbac-proxy/0.log"
Sep 11 20:14:10.183708 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:10.183686    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-czz7j_a594268e-a505-4a0b-8562-bb85340323ae/dns-node-resolver/0.log"
Sep 11 20:14:10.779874 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:10.779845    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjd5t_8a621433-1bd4-4fc3-892b-9709524f22bf/node-ca/0.log"
Sep 11 20:14:11.716611 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:11.716586    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c59pd7_8a0ba881-b73e-4140-8996-05d519d7bd53/istio-proxy/0.log"
Sep 11 20:14:12.135520 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:12.135446    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kxdp5_06a1b97a-12b5-4504-b8dd-3adf01a14f6f/discovery/0.log"
Sep 11 20:14:12.154879 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:12.154852    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596df76fbd-8qmvg_b33dabe4-9726-4c62-a2f7-ebade984e79d/kube-auth-proxy/0.log"
Sep 11 20:14:12.321230 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:12.321209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f55c6dfc6-v8gfx_aa8815e5-5a2d-44bf-b753-b5ddd918f91d/router/0.log"
Sep 11 20:14:13.214151 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:13.214117    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjlkc_4a318048-1f31-4d7a-888f-5fb7f72d5300/serve-healthcheck-canary/0.log"
Sep 11 20:14:13.746358 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:13.746331    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-gz58s_dec7f412-9871-4a8b-81d9-ce4ac13dc84d/insights-operator/0.log"
Sep 11 20:14:13.747245 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:13.747224    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-gz58s_dec7f412-9871-4a8b-81d9-ce4ac13dc84d/insights-operator/1.log"
Sep 11 20:14:13.765116 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:13.765087    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bg6nc_73abe7bf-a266-452a-9116-3af582379090/kube-rbac-proxy/0.log"
Sep 11 20:14:13.782233 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:13.782209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bg6nc_73abe7bf-a266-452a-9116-3af582379090/exporter/0.log"
Sep 11 20:14:13.800175 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:13.800150    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bg6nc_73abe7bf-a266-452a-9116-3af582379090/extractor/0.log"
Sep 11 20:14:14.889145 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:14.889117    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kx729/perf-node-gather-daemonset-kg2l7"
Sep 11 20:14:16.696470 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:16.696444    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7dsv5_cfb4a10d-ef07-4ce5-bfad-6731cda6347e/server/0.log"
Sep 11 20:14:16.789643 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:16.789621    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kf2t8_95f33bbc-f145-48f2-b21a-77f0f8c09632/manager/0.log"
Sep 11 20:14:16.985382 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:16.985347    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c47b89ccd-wr2jz_3ae6b7fa-202e-48ef-83f6-8687a1817ee9/manager/0.log"
Sep 11 20:14:17.002530 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:17.002509    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c47b89ccd-wr2jz_3ae6b7fa-202e-48ef-83f6-8687a1817ee9/copy-manifests/0.log"
Sep 11 20:14:18.488770 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:18.488746    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d6bf85947-gpfbd_7fade6e9-b798-4b84-8a2a-d47a0cebcbd3/manager/0.log"
Sep 11 20:14:18.759847 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:18.759822    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c59pd7_8a0ba881-b73e-4140-8996-05d519d7bd53/istio-proxy/0.log"
Sep 11 20:14:19.163612 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:19.163587    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kxdp5_06a1b97a-12b5-4504-b8dd-3adf01a14f6f/discovery/0.log"
Sep 11 20:14:19.172709 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:19.172691    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596df76fbd-8qmvg_b33dabe4-9726-4c62-a2f7-ebade984e79d/kube-auth-proxy/0.log"
Sep 11 20:14:19.285333 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:19.285307    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f55c6dfc6-v8gfx_aa8815e5-5a2d-44bf-b753-b5ddd918f91d/router/0.log"
Sep 11 20:14:20.817608 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:20.817577    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c59pd7_8a0ba881-b73e-4140-8996-05d519d7bd53/istio-proxy/0.log"
Sep 11 20:14:21.236459 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:21.236431    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kxdp5_06a1b97a-12b5-4504-b8dd-3adf01a14f6f/discovery/0.log"
Sep 11 20:14:21.258945 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:21.258922    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596df76fbd-8qmvg_b33dabe4-9726-4c62-a2f7-ebade984e79d/kube-auth-proxy/0.log"
Sep 11 20:14:21.386271 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:21.386248    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f55c6dfc6-v8gfx_aa8815e5-5a2d-44bf-b753-b5ddd918f91d/router/0.log"
Sep 11 20:14:23.469016 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:23.468975    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-7n48p_d2c7db81-e05b-4081-8b41-f60deb4730de/migrator/0.log"
Sep 11 20:14:23.484974 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:23.484951    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-7n48p_d2c7db81-e05b-4081-8b41-f60deb4730de/graceful-termination/0.log"
Sep 11 20:14:23.886970 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:23.886910    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-djk59_0d7df0e3-b8f6-4608-8262-1638fef4208b/kube-storage-version-migrator-operator/1.log"
Sep 11 20:14:23.887930 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:23.887912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-djk59_0d7df0e3-b8f6-4608-8262-1638fef4208b/kube-storage-version-migrator-operator/0.log"
Sep 11 20:14:25.053914 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.053883    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfsp6_8d4e7114-d158-457f-a5d5-26398234d6dc/kube-multus-additional-cni-plugins/0.log"
Sep 11 20:14:25.074767 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.074744    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfsp6_8d4e7114-d158-457f-a5d5-26398234d6dc/egress-router-binary-copy/0.log"
Sep 11 20:14:25.095497 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.095473    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfsp6_8d4e7114-d158-457f-a5d5-26398234d6dc/cni-plugins/0.log"
Sep 11 20:14:25.116215 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.116189    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfsp6_8d4e7114-d158-457f-a5d5-26398234d6dc/bond-cni-plugin/0.log"
Sep 11 20:14:25.134535 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.134516    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfsp6_8d4e7114-d158-457f-a5d5-26398234d6dc/routeoverride-cni/0.log"
Sep 11 20:14:25.151602 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.151566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfsp6_8d4e7114-d158-457f-a5d5-26398234d6dc/whereabouts-cni-bincopy/0.log"
Sep 11 20:14:25.171204 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.171176    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfsp6_8d4e7114-d158-457f-a5d5-26398234d6dc/whereabouts-cni/0.log"
Sep 11 20:14:25.412454 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.412385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cwsxc_7803e2e9-a8d7-4ad1-8885-55b3efbd1a65/kube-multus/0.log"
Sep 11 20:14:25.545065 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.545039    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wpt8b_1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e/network-metrics-daemon/0.log"
Sep 11 20:14:25.560225 ip-10-0-130-171 kubenswrapper[2576]: I0911 20:14:25.560205    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wpt8b_1dcf4f3c-3b2d-40f6-89e9-bb59dae2077e/kube-rbac-proxy/0.log"